Kong Provides AI Manager to Govern and Observe Agentic Traffic to Thousands of LLMs
Kong is introducing the general availability of AI Manager in Kong Konnect, the platform to manage all API, AI, and event connectivity across all modern digital applications and AI agents.
Kong provides one of the most feature rich AI Gateway technologies to manage LLM traffic (including MCP traffic), and with these new AI Manager capabilities in Konnect, users can now easily expose LLMs for consumption by AI agents, and additionally govern, secure, and observe LLM traffic using a brand-new user interface straight from a browser.
The new AI Manager capabilities are in addition to the existing API and declarative configuration that you can already use to govern all your LLM and MCP traffic across AI agents and applications via Kong’s AI Gateway technology.
With AI Manager, users can now:
- Manage AI policies via Konnect: Govern, secure, accelerate, and observe AI traffic in a self-managed—or fully managed—AI infrastructure that's easy to deploy.
- Curate your LLM catalog: See what LLMs are available for consumption by AI agents and applications, with custom tiers of access and governance controls.
- Visualize the agentic map: Observe at any given time what agents are consuming the LLMs you've decided to expose to the organization.
- Observe LLM analytics: Measure token, cost, and request consumption with custom dashboards and insights for fine-grained understanding of your AI traffic.
The new AI Manager is compatible with both hybrid deployments of AI Gateway—where users can run the data plane in their own infrastructure—and with managed Dedicated Cloud Gateways deployments—where users can press a button and provision AI infrastructure across all major clouds, with private networking, in a fully auto-scalable and managed way. And there's native support for Kubernetes via either the Ingress Controller or Operator.
For more information about this news, visit https://konghq.com.