Kong AI Gateway

Kong AI Gateway is the connectivity and governance layer for AI-native applications. Built on Kong Gateway, it provides a universal LLM API across providers (OpenAI, Anthropic, Gemini, Bedrock, Azure AI, Databricks, Mistral, HuggingFace and more), semantic caching, prompt firewalls and PII guardrails, automated RAG injection, token-level observability, MCP traffic governance, and Agent Gateway support for agent-to-agent (A2A) communication.

API entry from apis.yml

apis.yml Raw ↑
aid: kong:kong-ai-gateway
name: Kong AI Gateway
description: Kong AI Gateway is the connectivity and governance layer for AI-native applications. Built
  on Kong Gateway, it provides a universal LLM API across providers (OpenAI, Anthropic, Gemini, Bedrock,
  Azure AI, Databricks, Mistral, HuggingFace and more), semantic caching, prompt firewalls and PII guardrails,
  automated RAG injection, token-level observability, MCP traffic governance, and Agent Gateway support
  for agent-to-agent (A2A) communication.
humanURL: https://konghq.com/products/kong-ai-gateway
tags:
- AI Gateway
- LLM
- MCP
- A2A
properties:
- type: Documentation
  url: https://developer.konghq.com/ai-gateway/
- type: ChangeLog
  url: https://developer.konghq.com/gateway/changelog/
- type: GitHubRepository
  url: https://github.com/Kong/kong