AI Gateway

LiteLLM

LiteLLM (BerriAI) is an open-source LLM gateway that exposes 100+ LLM providers — OpenAI, Anthropic, Azure, Bedrock, Gemini — through a single OpenAI-compatible API. The LiteLLM Proxy adds virtual keys, load balancing, RPM/TPM limits, spend tracking, and observability hooks for Langfuse, Phoenix, Langsmith, and OpenTelemetry. Self-hostable via Docker; enterprise support available.

GitHub

Documentation

📖
Documentation
https://docs.litellm.ai/

SDKs

📦
GitHubRepository
https://github.com/BerriAI/litellm

Other Resources

🔗
Portal
https://www.litellm.ai/
🔗
PyPI
https://pypi.org/project/litellm/

API entry from apis.yml

apis.yml Raw ↑ 
aid: ai-gateway:litellm
name: LiteLLM
description: LiteLLM (BerriAI) is an open-source LLM gateway that exposes 100+ LLM providers — OpenAI,
  Anthropic, Azure, Bedrock, Gemini — through a single OpenAI-compatible API. The LiteLLM Proxy adds virtual
  keys, load balancing, RPM/TPM limits, spend tracking, and observability hooks for Langfuse, Phoenix,
  Langsmith, and OpenTelemetry. Self-hostable via Docker; enterprise support available.
humanURL: https://www.litellm.ai/
baseURL: https://api.litellm.ai
tags:
- AI Gateway
- LLM Proxy
- Open Source
- Cost Tracking
- Load Balancing
properties:
- type: Portal
  url: https://www.litellm.ai/
- type: Documentation
  url: https://docs.litellm.ai/
- type: GitHubRepository
  url: https://github.com/BerriAI/litellm
- type: PyPI
  url: https://pypi.org/project/litellm/
x-deployment:
- self-host
- opensource
- cloud
x-license: MIT