Scalable Inference Serving

NVIDIA Triton Inference Server HTTP API

NVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open Inference Protocol (V2). Supports TensorRT, ONNX, TensorFlow, PyTorch, and Python backends. Provides dynamic batching, model ensembles, model analyzers, and GPU/CPU inference. Used extensively in production ML pipelines requiring maximum throughput.

GitHub

Documentation

📖
Documentation
https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/
📖
GettingStarted
https://github.com/triton-inference-server/tutorials
📖
APIReference
https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/customization_guide/inference_protocols.html

Other Resources

🔗
GitHub
https://github.com/triton-inference-server/server

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/nvidia-triton-inference-server-http-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑ 
name: NVIDIA Triton Inference Server HTTP API
description: NVIDIA Triton Inference Server is an open-source inference serving software that implements
  the KServe Open Inference Protocol (V2). Supports TensorRT, ONNX, TensorFlow, PyTorch, and Python backends.
  Provides dynamic batching, model ensembles, model analyzers, and GPU/CPU inference. Used extensively
  in production ML pipelines requiring maximum throughput.
image: https://developer.nvidia.com/favicon.ico
humanUrl: https://developer.nvidia.com/triton-inference-server
baseUrl: https://triton.example.com
tags:
- GPU
- Inference
- Model Serving
- NVIDIA
- Open-Source
- TensorRT
- Triton
tags_raw:
- GPU
- Inference
- Model Serving
- NVIDIA
- Open Source
- TensorRT
- Triton
properties:
- type: Documentation
  url: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/
- type: GitHub
  url: https://github.com/triton-inference-server/server
- type: GettingStarted
  url: https://github.com/triton-inference-server/tutorials
- type: APIReference
  url: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/customization_guide/inference_protocols.html
contact:
- type: GitHubIssues
  url: https://github.com/triton-inference-server/server/issues
- type: Forums
  url: https://forums.developer.nvidia.com/c/ai-data-science/deep-learning/triton-inference-server/