Triton Inference Server

Triton HTTP/REST API

RESTful API implementing the KServe V2 inference protocol for model inference, health checks, metadata queries, model repository management, statistics, tracing, and logging.

Documentation GitHub OpenAPI

Documentation

https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_binary_data.md

Specifications

https://github.com/triton-inference-server/server/blob/main/docs/protocol/rest_api.yaml

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/openapi/triton-http-rest-openapi.yml

Other Resources

Postman Collection

https://www.postman.com/nvidia-triton

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-cuda-shared-memory.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-health.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-inference.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-logging.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-model-metadata.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-model-repository.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-server-metadata.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-statistics.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-system-shared-memory.yaml

NaftikoCapability

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/capabilities/http-rest-trace.yaml

OpenAPI Specification