Hugging Face · Schema

Info

Properties

Name	Type	Description
model_id	string	Loaded model ID
model_sha	string	Model revision SHA
model_dtype	string	Model data type
model_device_type	string	Device type (cuda, cpu)
model_pipeline_tag	string	Pipeline task tag
max_concurrent_requests	integer
max_best_of	integer
max_stop_sequences	integer
max_input_length	integer	Maximum input token length
max_total_tokens	integer	Maximum total tokens (input + output)
waiting_served_ratio	number
max_batch_total_tokens	integer
max_waiting_tokens	integer
validation_workers	integer
max_client_batch_size	integer
version	string	TGI version
sha	string	TGI build SHA
docker_label	string	Docker image label

View JSON Schema on GitHub

JSON Schema

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "title": "Info",
  "type": "object",
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Loaded model ID"
    },
    "model_sha": {
      "type": "string",
      "description": "Model revision SHA"
    },
    "model_dtype": {
      "type": "string",
      "description": "Model data type"
    },
    "model_device_type": {
      "type": "string",
      "description": "Device type (cuda, cpu)"
    },
    "model_pipeline_tag": {
      "type": "string",
      "description": "Pipeline task tag"
    },
    "max_concurrent_requests": {
      "type": "integer"
    },
    "max_best_of": {
      "type": "integer"
    },
    "max_stop_sequences": {
      "type": "integer"
    },
    "max_input_length": {
      "type": "integer",
      "description": "Maximum input token length"
    },
    "max_total_tokens": {
      "type": "integer",
      "description": "Maximum total tokens (input + output)"
    },
    "waiting_served_ratio": {
      "type": "number"
    },
    "max_batch_total_tokens": {
      "type": "integer"
    },
    "max_waiting_tokens": {
      "type": "integer"
    },
    "validation_workers": {
      "type": "integer"
    },
    "max_client_batch_size": {
      "type": "integer"
    },
    "version": {
      "type": "string",
      "description": "TGI version"
    },
    "sha": {
      "type": "string",
      "description": "TGI build SHA"
    },
    "docker_label": {
      "type": "string",
      "description": "Docker image label"
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this

find_json_schemasBrowse and filter every JSON Schema in the catalog.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This JSON Schema

curl "https://apis.io/api/v1/json-schemas/hugging-face-text-generation-inference-info"

All schemas

curl "https://apis.io/api/v1/json-schemas?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.