AI Gateway

Kong AI Gateway

The Kong AI Gateway is delivered as the AI Proxy plugin for Kong Gateway, transforming and proxying requests across 16+ providers including OpenAI, Azure OpenAI, Anthropic, Amazon Bedrock, Gemini, Vertex AI, Cohere, Mistral, Hugging Face, Llama, xAI, Ollama, Alibaba DashScope, Cerebras, DeepSeek, Databricks, and vLLM. Supports chat, completions, embeddings, assistants, audio, image, video, batches, and files routes with template-based model selection.

GitHub

Documentation

📖
Documentation
https://developer.konghq.com/plugins/ai-proxy/

Other Resources

🔗
Portal
https://konghq.com/products/kong-ai-gateway
🔗
GitHubOrganization
https://github.com/Kong

API entry from apis.yml

apis.yml Raw ↑ 
aid: ai-gateway:kong-ai-gateway
name: Kong AI Gateway
description: The Kong AI Gateway is delivered as the AI Proxy plugin for Kong Gateway, transforming and
  proxying requests across 16+ providers including OpenAI, Azure OpenAI, Anthropic, Amazon Bedrock, Gemini,
  Vertex AI, Cohere, Mistral, Hugging Face, Llama, xAI, Ollama, Alibaba DashScope, Cerebras, DeepSeek,
  Databricks, and vLLM. Supports chat, completions, embeddings, assistants, audio, image, video, batches,
  and files routes with template-based model selection.
humanURL: https://konghq.com/products/kong-ai-gateway
baseURL: https://konghq.com
tags:
- AI Gateway
- API Gateway
- Multi-Provider
- Plugin
- Kong
properties:
- type: Portal
  url: https://konghq.com/products/kong-ai-gateway
- type: Documentation
  url: https://developer.konghq.com/plugins/ai-proxy/
- type: GitHubOrganization
  url: https://github.com/Kong
x-deployment:
- cloud
- self-host
- opensource