ngrok AI Gateway

ngrok AI Gateway

ngrok AI Gateway exposes an OpenAI-compatible HTTP interface for routing requests across multiple AI providers and self-hosted models. Each AI Gateway instance has a unique base URL of the form https://your-ai-gateway.ngrok.app/v1 and accepts standard OpenAI SDK calls including chat completions. Traffic policies provide rate limiting, prompt inspection, PII redaction, response sanitization, model access control, cost-based routing, and automatic provider failover.

GitHub

Documentation

📖
Documentation
https://ngrok.com/docs/ai-gateway/
📖
GettingStarted
https://ngrok.com/docs/ai-gateway/quickstart/
📖
APIReference
https://ngrok.com/docs/ai-gateway/

API entry from apis.yml

apis.yml Raw ↑ 
aid: ngrok-ai:ai-gateway
name: ngrok AI Gateway
description: ngrok AI Gateway exposes an OpenAI-compatible HTTP interface for routing requests across
  multiple AI providers and self-hosted models. Each AI Gateway instance has a unique base URL of the
  form https://your-ai-gateway.ngrok.app/v1 and accepts standard OpenAI SDK calls including chat completions.
  Traffic policies provide rate limiting, prompt inspection, PII redaction, response sanitization, model
  access control, cost-based routing, and automatic provider failover.
humanURL: https://ngrok.com/docs/ai-gateway/
baseURL: https://your-ai-gateway.ngrok.app/v1
tags:
- AI Gateway
- API Gateway
- LLM
- OpenAI Compatible
- Routing
- Security
properties:
- type: Documentation
  url: https://ngrok.com/docs/ai-gateway/
- type: GettingStarted
  url: https://ngrok.com/docs/ai-gateway/quickstart/
- type: APIReference
  url: https://ngrok.com/docs/ai-gateway/