Scalable Inference Serving · Schema
InferenceRequest
Request body for submitting model inference. Contains input tensors and optionally specifies which outputs to return.
Artificial IntelligenceCNCFDeploymentInferenceKubernetesLLMMachine-LearningModel ServingMLOpsScalability
Properties
| Name | Type | Description |
|---|---|---|
| id | string | Optional request identifier. If provided, it is echoed back in the response for correlation. |
| parameters | object | Optional key/value parameters passed to the model. |
| inputs | array | Input tensors for the inference request. |
| outputs | array | Optional list of output tensors to return. If omitted, all outputs are returned. |
JSON Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "#/components/schemas/InferenceRequest",
"title": "InferenceRequest",
"type": "object",
"description": "Request body for submitting model inference. Contains input tensors and optionally specifies which outputs to return.",
"required": [
"inputs"
],
"properties": {
"id": {
"type": "string",
"description": "Optional request identifier. If provided, it is echoed back in the response for correlation.",
"example": "req-a1b2c3d4"
},
"parameters": {
"type": "object",
"additionalProperties": true,
"description": "Optional key/value parameters passed to the model."
},
"inputs": {
"type": "array",
"description": "Input tensors for the inference request.",
"minItems": 1,
"items": {
"$ref": "#/components/schemas/RequestInput"
}
},
"outputs": {
"type": "array",
"description": "Optional list of output tensors to return. If omitted, all outputs are returned.",
"items": {
"$ref": "#/components/schemas/RequestOutput"
}
}
}
}
Work with this as data
Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for schemas
4 MCP tools reach this
find_json_schemasBrowse and filter every JSON Schema in the catalog.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/scalable-inference-serving-inferencerequest"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"
Discovery needs no key. Ratings and market analysis are Pro.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.