Triton Inference Server

Triton HTTP/REST API

RESTful API implementing the KServe V2 inference protocol for model inference, health checks, metadata queries, model repository management, statistics, tracing, and logging.

Documentation GitHub OpenAPI

Documentation

https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_binary_data.md

Specifications

https://github.com/triton-inference-server/server/blob/main/docs/protocol/rest_api.yaml

https://raw.githubusercontent.com/api-evangelist/triton/refs/heads/main/openapi/triton-http-rest-openapi.yml

Other Resources

Postman Collection

https://www.postman.com/nvidia-triton

OpenAPI Specification