LiteLLM

LiteLLM Batches API

Provides an OpenAI-compatible /batches endpoint for batch processing operations, enabling bulk request handling across LLM providers.

GitHub

Documentation

📖
Documentation
https://docs.litellm.ai/docs/batches

API entry from apis.yml

apis.yml Raw ↑ 
aid: litellm:batches-api
name: LiteLLM Batches API
description: Provides an OpenAI-compatible /batches endpoint for batch processing operations, enabling
  bulk request handling across LLM providers.
humanURL: https://docs.litellm.ai/docs/batches
tags:
- Batches
- Bulk
- Processing
properties:
- type: Documentation
  url: https://docs.litellm.ai/docs/batches