InferenceRequest

Request body for submitting model inference. Contains input tensors and optionally specifies which outputs to return.

Artificial IntelligenceCNCFDeploymentInferenceKubernetesLLMMachine-LearningModel ServingMLOpsScalability

Properties

Name	Type	Description
id	string	Optional request identifier. If provided, it is echoed back in the response for correlation.
parameters	object	Optional key/value parameters passed to the model.
inputs	array	Input tensors for the inference request.
outputs	array	Optional list of output tensors to return. If omitted, all outputs are returned.

View JSON Schema on GitHub

JSON Schema

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/InferenceRequest",
  "title": "InferenceRequest",
  "type": "object",
  "description": "Request body for submitting model inference. Contains input tensors and optionally specifies which outputs to return.",
  "required": [
    "inputs"
  ],
  "properties": {
    "id": {
      "type": "string",
      "description": "Optional request identifier. If provided, it is echoed back in the response for correlation.",
      "example": "req-a1b2c3d4"
    },
    "parameters": {
      "type": "object",
      "additionalProperties": true,
      "description": "Optional key/value parameters passed to the model."
    },
    "inputs": {
      "type": "array",
      "description": "Input tensors for the inference request.",
      "minItems": 1,
      "items": {
        "$ref": "#/components/schemas/RequestInput"
      }
    },
    "outputs": {
      "type": "array",
      "description": "Optional list of output tensors to return. If omitted, all outputs are returned.",
      "items": {
        "$ref": "#/components/schemas/RequestOutput"
      }
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this

find_json_schemasBrowse and filter every JSON Schema in the catalog.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This JSON Schema

curl "https://apis.io/api/v1/json-schemas/scalable-inference-serving-inferencerequest"

All schemas

curl "https://apis.io/api/v1/json-schemas?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.