Traefik Labs

Traefik AI Gateway

Self-hosted Kubernetes-native gateway for LLM traffic. OpenAI-compatible unified API in front of OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral, Ollama, and self-hosted models. Built-in jailbreak detection (NVIDIA Safety NIMs), PII redaction (Presidio, 35+ recognizers), 22+ content-filter categories, semantic caching (vendor-claimed 40-70% cost reduction), identity-based routing, and OpenTelemetry token/cost metrics.

GitHub

Other Resources

🔗
Solution Page
https://traefik.io/solutions/ai-gateway/
🔗
KubernetesCRD
https://raw.githubusercontent.com/api-evangelist/traefik/refs/heads/main/crd/hub-aiservice.yaml

API entry from apis.yml

apis.yml Raw ↑ 
aid: traefik:traefik-ai-gateway
name: Traefik AI Gateway
description: Self-hosted Kubernetes-native gateway for LLM traffic. OpenAI-compatible unified API in front
  of OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral, Ollama, and self-hosted models.
  Built-in jailbreak detection (NVIDIA Safety NIMs), PII redaction (Presidio, 35+ recognizers), 22+ content-filter
  categories, semantic caching (vendor-claimed 40-70% cost reduction), identity-based routing, and OpenTelemetry
  token/cost metrics.
humanURL: https://traefik.io/solutions/ai-gateway/
tags:
- AI Gateway
- LLM
- Guardrails
- Observability
- Enterprise
properties:
- type: Solution Page
  url: https://traefik.io/solutions/ai-gateway/
- type: KubernetesCRD
  url: crd/hub-aiservice.yaml