Semantic Routing with Intent-Based CEL in Agentgateway
Think about this scenario: you're working on a complex application refactor, and after the initial stages of performing said refactor, you decide to run tests and see if the updates worked
Distributed LLM Inference on Kubernetes: Configuring KServe and llm-d
Open Weight Models (Qwen, DeepSeek, Kimi) need a place to run that gives the ability to have shareable GPUs, a first-class orchestration/scheduler, and traffic routing capabilities that engineers are comfortable with.
Implementing Observability For Agent Substrate Actors
Sandboxed Agents means we're going a level deeper in terms of where AI runs. Originally, it could be an Agent Harness like opencode or Codex running on your local terminal. Now,
Live Actor Migration in Agent Substrate: Moving State Across Workers
High Availability (HA) is the cornerstone of an efficient, scalable, performant system. Without it, zero downtime and migrating/scaling state for systems would be impossible. In this case, the "system" is
Virtual Keys in Agentgateway: Per-User Token Budgets for Your LLM Gateway
Cost in AI will vary per user and department. If an engineer is refactoring a codebase or observing an environment to fix anomalies, the token spend may differ from that of someone in