Kong AI Gateway

AI Proxy Advanced Plugin

The AI Proxy Advanced plugin extends AI Proxy with load balancing, weighted distribution, and fallback across multiple providers and models simultaneously.

AI Proxy Advanced Plugin is one of 21 APIs that Kong AI Gateway publishes on the APIs.io network.

Tagged areas include Plugin, Load Balancing, and LLM. The published artifact set on APIs.io includes API documentation.

GitHub

Documentation

📖
Documentation
https://developer.konghq.com/plugins/ai-proxy-advanced/

API entry from apis.yml

apis.yml Raw ↑ 
aid: kong-ai-gateway:ai-proxy-advanced-plugin
name: AI Proxy Advanced Plugin
description: The AI Proxy Advanced plugin extends AI Proxy with load balancing, weighted distribution,
  and fallback across multiple providers and models simultaneously.
humanURL: https://developer.konghq.com/plugins/ai-proxy-advanced/
tags:
- Plugin
- Load Balancing
- LLM
properties:
- type: Documentation
  url: https://developer.konghq.com/plugins/ai-proxy-advanced/