AI Gateway

Traefik AI Gateway

Traefik AI Gateway is an enterprise, self-hosted, Kubernetes-native AI gateway with safety and governance (NVIDIA Safety NIMs, jailbreak detection, content filtering across 22+ categories), multi-LLM support via an OpenAI-compatible interface (Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral, Ollama), intelligent routing, credential management, semantic caching with claimed 40-70 percent cost savings, PII protection via Presidio (35+ recognizers), and OpenTelemetry observability.

GitHub

Documentation

📖
Documentation
https://doc.traefik.io/

Other Resources

🔗
Portal
https://traefik.io/solutions/ai-gateway/
🔗
GitHubOrganization
https://github.com/traefik

API entry from apis.yml

apis.yml Raw ↑ 
aid: ai-gateway:traefik-ai-gateway
name: Traefik AI Gateway
description: Traefik AI Gateway is an enterprise, self-hosted, Kubernetes-native AI gateway with safety
  and governance (NVIDIA Safety NIMs, jailbreak detection, content filtering across 22+ categories), multi-LLM
  support via an OpenAI-compatible interface (Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral,
  Ollama), intelligent routing, credential management, semantic caching with claimed 40-70 percent cost
  savings, PII protection via Presidio (35+ recognizers), and OpenTelemetry observability.
humanURL: https://traefik.io/solutions/ai-gateway/
baseURL: https://traefik.io
tags:
- AI Gateway
- Kubernetes
- Guardrails
- Semantic Caching
- PII Protection
properties:
- type: Portal
  url: https://traefik.io/solutions/ai-gateway/
- type: Documentation
  url: https://doc.traefik.io/
- type: GitHubOrganization
  url: https://github.com/traefik
x-deployment:
- self-host
- cloud