MLflow

MLflow AI Gateway API

The MLflow AI Gateway provides a unified HTTP interface to LLM providers with routing, rate-limiting, and secret management features.

GitHub

Documentation

📖
Documentation
https://mlflow.org/docs/latest/llms/gateway/index.html

API entry from apis.yml

apis.yml Raw ↑ 
aid: mlflow:mlflow-gateway-api
name: MLflow AI Gateway API
humanURL: https://mlflow.org/docs/latest/llms/gateway/index.html
baseURL: http://{gateway}/gateway
tags:
- GenAI
- LLM Gateway
- REST
description: The MLflow AI Gateway provides a unified HTTP interface to LLM providers with routing, rate-limiting,
  and secret management features.
properties:
- type: Documentation
  url: https://mlflow.org/docs/latest/llms/gateway/index.html