Scalable Inference Serving · Example Payload

Scalable Inference Serving Runinference Example

Artificial IntelligenceCNCFDeploymentInferenceKubernetesLLMMachine-LearningModel ServingMLOpsScalability

Scalable Inference Serving Runinference Example is an example object payload from Scalable Inference Serving, with 6 top-level fields. It illustrates the shape of data this provider's APIs accept or return.

Top-level fields

operationIdmethodpathsummaryrequestExamplesresponseExamples

Example Payload

{
  "operationId": "RunInference",
  "method": "POST",
  "path": "/v2/models/{model_name}/infer",
  "summary": "Run Model Inference",
  "requestExamples": [
    {
      "contentType": "application/json",
      "example": {
        "id": "req-12345",
        "inputs": [
          {
            "name": "text_input",
            "shape": [
              1,
              128
            ],
            "datatype": "INT32",
            "data": [
              [
                101,
                2023,
                2003,
                1037,
                3231,
                102,
                0,
                0
              ]
            ]
          }
        ],
        "outputs": [
          {
            "name": "sentiment_label"
          },
          {
            "name": "confidence_score"
          }
        ]
      }
    }
  ],
  "responseExamples": [
    {
      "status": "200",
      "contentType": "application/json",
      "example": {
        "model_name": "bert-sentiment-classifier",
        "model_version": "3",
        "id": "req-12345",
        "outputs": [
          {
            "name": "sentiment_label",
            "shape": [
              1
            ],
            "datatype": "BYTES",
            "data": [
              "positive"
            ]
          },
          {
            "name": "confidence_score",
            "shape": [
              1
            ],
            "datatype": "FP32",
            "data": [
              0.9423
            ]
          }
        ]
      }
    }
  ]
}

Work with this as data

Every example here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for examples

4 MCP tools reach this

find_examplesBrowse and filter every example in the catalog.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This example

curl "https://apis.io/api/v1/examples/scalable-inference-serving-runinference-example"

All examples

curl "https://apis.io/api/v1/examples?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.