Triton Inference Server

Triton Inference Server Health API

Server and model health and readiness checks

Documentation GitHub OpenAPI

Operations 4

GET /v2/health/live Triton Inference Server Server Liveness Check #

GET /v2/health/ready Triton Inference Server Server Readiness Check #

GET /v2/models/{model_name}/versions/{model_version}/ready Triton Inference Server Model Version Readiness Check #

GET /v2/models/{model_name}/ready Triton Inference Server Model Readiness Check #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/triton-health-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: Triton Inference Server NVIDIA Triton Inference Server HTTP/REST CUDA Shared Memory Health API
  description: RESTful API for the NVIDIA Triton Inference Server, implementing the KServe V2 inference protocol with Triton-specific extensions. Provides endpoints for model inference, health checks, server and model metadata, model repository management, statistics, tracing, logging, and system shared memory management.
  version: '2.0'
  contact:
    name: NVIDIA Triton Team
    url: https://github.com/triton-inference-server/server
    email: triton@nvidia.com
  license:
    name: BSD 3-Clause
    url: https://github.com/triton-inference-server/server/blob/main/LICENSE
servers:
- url: http://localhost:8000
  description: Triton HTTP endpoint (default)
- url: http://{host}:{port}
  description: Custom Triton HTTP endpoint
  variables:
    host:
      default: localhost
      description: Triton server hostname or IP
    port:
      default: '8000'
      description: Triton HTTP port
tags:
- name: Health
  description: Server and model health and readiness checks
paths:
  /v2/health/live:
    get:
      operationId: serverLive
      summary: Triton Inference Server Server Liveness Check
      description: Check if the Triton server is alive and able to receive requests. This is the KServe V2 standard liveness probe endpoint.
      tags:
      - Health
      responses:
        '200':
          description: Server is live
        '400':
          description: Server is not live
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /v2/health/ready:
    get:
      operationId: serverReady
      summary: Triton Inference Server Server Readiness Check
      description: Check if the Triton server is ready to accept inference requests. The server is ready when all models that are loaded at startup are ready.
      tags:
      - Health
      responses:
        '200':
          description: Server is ready
        '400':
          description: Server is not ready
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /v2/models/{model_name}/versions/{model_version}/ready:
    get:
      operationId: modelVersionReady
      summary: Triton Inference Server Model Version Readiness Check
      description: Check if a specific version of a model is ready to accept inference requests.
      tags:
      - Health
      parameters:
      - $ref: '#/components/parameters/modelName'
      - $ref: '#/components/parameters/modelVersion'
      responses:
        '200':
          description: Model version is ready
        '400':
          description: Model version is not ready
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /v2/models/{model_name}/ready:
    get:
      operationId: modelReady
      summary: Triton Inference Server Model Readiness Check
      description: Check if a model is ready to accept inference requests. Checks the default/latest version of the model.
      tags:
      - Health
      parameters:
      - $ref: '#/components/parameters/modelName'
      responses:
        '200':
          description: Model is ready
        '400':
          description: Model is not ready
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
components:
  parameters:
    modelVersion:
      name: model_version
      in: path
      required: true
      description: Version of the model
      schema:
        type: string
    modelName:
      name: model_name
      in: path
      required: true
      description: Name of the model
      schema:
        type: string
  schemas:
    ErrorResponse:
      type: object
      properties:
        error:
          type: string
          description: Error message describing what went wrong
externalDocs:
  description: Triton Inference Server Protocol Documentation
  url: https://github.com/triton-inference-server/server/blob/main/docs/protocol/README.md