Hugging Face · JSON Structure

Hugging Face Text Generation Inference Completion Request Structure

Type: object Properties: 9

CompletionRequest is a JSON Structure definition published by Hugging Face, describing 9 properties. It conforms to the https://json-structure.org/draft/2020-12/schema meta-schema.

Properties

model prompt max_tokens temperature top_p stop stream seed suffix

Meta-schema: https://json-structure.org/draft/2020-12/schema

JSON Structure

Raw ↑ 
{
  "$schema": "https://json-structure.org/draft/2020-12/schema",
  "name": "CompletionRequest",
  "type": "object",
  "properties": {
    "model": {
      "type": "string"
    },
    "prompt": {
      "type": "string"
    },
    "max_tokens": {
      "type": "integer"
    },
    "temperature": {
      "type": "number"
    },
    "top_p": {
      "type": "number"
    },
    "stop": {
      "type": "array"
    },
    "stream": {
      "type": "boolean"
    },
    "seed": {
      "type": "integer"
    },
    "suffix": {
      "type": "string"
    }
  }
}