Hugging Face · Schema

ChatCompletionRequest

Properties

Name Type Description
model string Model identifier (can be tgi or a model ID)
messages array Conversation messages
frequency_penalty number
logprobs boolean
max_tokens integer Maximum tokens to generate
presence_penalty number
response_format string
seed integer
stop array
stream boolean
stream_options object
temperature number
tool_choice string
tool_prompt string Prompt appended before tools
tools array
top_logprobs integer
top_p number
View JSON Schema on GitHub