AI Gateway

Anyscale

Anyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting LLM inference and other data-intensive AI workloads across distributed GPU clusters. Integrates with vLLM and SkyRL; users bring their own models.

GitHub

Documentation

📖
Documentation
https://docs.anyscale.com/

SDKs

📦
GitHubRepository
https://github.com/ray-project/ray

Other Resources

🔗
Portal
https://www.anyscale.com/
🔗
GitHubOrganization
https://github.com/anyscale

API entry from apis.yml

apis.yml Raw ↑ 
aid: ai-gateway:anyscale
name: Anyscale
description: Anyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting
  LLM inference and other data-intensive AI workloads across distributed GPU clusters. Integrates with
  vLLM and SkyRL; users bring their own models.
humanURL: https://www.anyscale.com/
baseURL: https://api.endpoints.anyscale.com
tags:
- Inference
- Ray
- GPU
- Open Source
- Self-Hosted
properties:
- type: Portal
  url: https://www.anyscale.com/
- type: Documentation
  url: https://docs.anyscale.com/
- type: GitHubOrganization
  url: https://github.com/anyscale
- type: GitHubRepository
  url: https://github.com/ray-project/ray
x-deployment:
- cloud
- self-host