Hugging Face · Example Payload

Hugging Face Text Generation Inference Chat Completion Request Example

Hugging Face Text Generation Inference Chat Completion Request Example is an example object payload from Hugging Face, with 17 top-level fields. It illustrates the shape of data this provider's APIs accept or return.

Top-level fields

modelmessagesfrequency_penaltylogprobsmax_tokenspresence_penaltyresponse_formatseedstopstreamstream_optionstemperaturetool_choicetool_prompttoolstop_logprobstop_p

Example Payload

Raw ↑ 
{
  "model": "example_value",
  "messages": [],
  "frequency_penalty": 42.5,
  "logprobs": true,
  "max_tokens": 10,
  "presence_penalty": 42.5,
  "response_format": "example_value",
  "seed": 10,
  "stop": [],
  "stream": true,
  "stream_options": "example_value",
  "temperature": 42.5,
  "tool_choice": "example_value",
  "tool_prompt": "example_value",
  "tools": [],
  "top_logprobs": 10,
  "top_p": 42.5
}