Hugging Face · JSON Structure

Hugging Face Text Generation Inference Chat Completion Request Structure

Type: object Properties: 17

ChatCompletionRequest is a JSON Structure definition published by Hugging Face, describing 17 properties. It conforms to the https://json-structure.org/draft/2020-12/schema meta-schema.

Properties

model messages frequency_penalty logprobs max_tokens presence_penalty response_format seed stop stream stream_options temperature tool_choice tool_prompt tools top_logprobs top_p

Meta-schema: https://json-structure.org/draft/2020-12/schema

JSON Structure

Raw ↑ 
{
  "$schema": "https://json-structure.org/draft/2020-12/schema",
  "name": "ChatCompletionRequest",
  "type": "object",
  "properties": {
    "model": {
      "type": "string"
    },
    "messages": {
      "type": "array"
    },
    "frequency_penalty": {
      "type": "number"
    },
    "logprobs": {
      "type": "boolean"
    },
    "max_tokens": {
      "type": "integer"
    },
    "presence_penalty": {
      "type": "number"
    },
    "response_format": {
      "type": "string"
    },
    "seed": {
      "type": "integer"
    },
    "stop": {
      "type": "array"
    },
    "stream": {
      "type": "boolean"
    },
    "stream_options": {
      "type": "object"
    },
    "temperature": {
      "type": "number"
    },
    "tool_choice": {
      "type": "string"
    },
    "tool_prompt": {
      "type": "string"
    },
    "tools": {
      "type": "array"
    },
    "top_logprobs": {
      "type": "integer"
    },
    "top_p": {
      "type": "number"
    }
  }
}