Triton Inference Server · Example Payload

Triton Model Infer Example

Run image classification inference on ResNet-50

AIDeep LearningInferenceMachine LearningModel ServingNVIDIAOpen Source

Triton Model Infer Example is an example object payload from Triton Inference Server, with 4 top-level fields. It illustrates the shape of data this provider's APIs accept or return.

Top-level fields

operationdescriptionrequestresponse

Example Payload

{
  "operation": "modelInfer",
  "description": "Run image classification inference on ResNet-50",
  "request": {
    "method": "POST",
    "url": "http://localhost:8000/v2/models/resnet50/infer",
    "headers": {
      "Content-Type": "application/json"
    },
    "body": {
      "id": "req-001",
      "inputs": [
        {
          "name": "input",
          "shape": [1, 3, 224, 224],
          "datatype": "FP32",
          "data": [0.485, 0.456, 0.406]
        }
      ],
      "outputs": [
        {
          "name": "output",
          "parameters": {
            "classification": 5
          }
        }
      ]
    }
  },
  "response": {
    "status": 200,
    "body": {
      "id": "req-001",
      "model_name": "resnet50",
      "model_version": "1",
      "outputs": [
        {
          "name": "output",
          "shape": [1, 1000],
          "datatype": "FP32",
          "data": [0.00012, 0.00018, 0.00025, 0.00031, 0.0045]
        }
      ]
    }
  }
}