Hugging Face · Example Payload

Hugging Face Text Generation Inference Info Example

Hugging Face Text Generation Inference Info Example is an example object payload from Hugging Face, with 18 top-level fields. It illustrates the shape of data this provider's APIs accept or return.

Top-level fields

model_idmodel_shamodel_dtypemodel_device_typemodel_pipeline_tagmax_concurrent_requestsmax_best_ofmax_stop_sequencesmax_input_lengthmax_total_tokenswaiting_served_ratiomax_batch_total_tokensmax_waiting_tokensvalidation_workersmax_client_batch_sizeversionshadocker_label

Example Payload

Raw ↑ 
{
  "model_id": "500123",
  "model_sha": "example_value",
  "model_dtype": "example_value",
  "model_device_type": "example_value",
  "model_pipeline_tag": "example_value",
  "max_concurrent_requests": 10,
  "max_best_of": 10,
  "max_stop_sequences": 10,
  "max_input_length": 10,
  "max_total_tokens": 10,
  "waiting_served_ratio": 42.5,
  "max_batch_total_tokens": 10,
  "max_waiting_tokens": 10,
  "validation_workers": 10,
  "max_client_batch_size": 10,
  "version": "example_value",
  "sha": "example_value",
  "docker_label": "example_value"
}

Work with this as data

Every example here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for examples

4 MCP tools reach this
  • find_examplesBrowse and filter every example in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This example 
curl "https://apis.io/api/v1/examples/hugging-face-text-generation-inference-info-example"
All examples 
curl "https://apis.io/api/v1/examples?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.