AI Gateway

Apache APISIX AI Proxy

The Apache APISIX ai-proxy plugin streamlines integration with LLMs by converting plugin settings into the appropriate request format for OpenAI, DeepSeek, Azure OpenAI, Anthropic, Google Gemini, Vertex AI, OpenRouter, AIMLAPI, and OpenAI-compatible services. Supports embedding models, observability of token usage and latency, custom endpoints, and flexible authentication. Apache 2.0 licensed.

GitHub

Documentation

📖
Documentation
https://apisix.apache.org/docs/apisix/plugins/ai-proxy/

SDKs

📦
GitHubRepository
https://github.com/apache/apisix

Other Resources

🔗
Portal
https://apisix.apache.org/

API entry from apis.yml

apis.yml Raw ↑ 
aid: ai-gateway:apisix-ai-proxy
name: Apache APISIX AI Proxy
description: The Apache APISIX ai-proxy plugin streamlines integration with LLMs by converting plugin
  settings into the appropriate request format for OpenAI, DeepSeek, Azure OpenAI, Anthropic, Google Gemini,
  Vertex AI, OpenRouter, AIMLAPI, and OpenAI-compatible services. Supports embedding models, observability
  of token usage and latency, custom endpoints, and flexible authentication. Apache 2.0 licensed.
humanURL: https://apisix.apache.org/
baseURL: https://apisix.apache.org
tags:
- AI Gateway
- API Gateway
- Open Source
- Apache
- Plugin
properties:
- type: Portal
  url: https://apisix.apache.org/
- type: Documentation
  url: https://apisix.apache.org/docs/apisix/plugins/ai-proxy/
- type: GitHubRepository
  url: https://github.com/apache/apisix
x-deployment:
- self-host
- opensource
x-license: Apache-2.0