Hugging Face · JSON Structure

Hugging Face Text Generation Inference Info Structure

Type: object Properties: 18

Info is a JSON Structure definition published by Hugging Face, describing 18 properties. It conforms to the https://json-structure.org/draft/2020-12/schema meta-schema.

Properties

model_id model_sha model_dtype model_device_type model_pipeline_tag max_concurrent_requests max_best_of max_stop_sequences max_input_length max_total_tokens waiting_served_ratio max_batch_total_tokens max_waiting_tokens validation_workers max_client_batch_size version sha docker_label

Meta-schema: https://json-structure.org/draft/2020-12/schema

JSON Structure

Raw ↑ 
{
  "$schema": "https://json-structure.org/draft/2020-12/schema",
  "name": "Info",
  "type": "object",
  "properties": {
    "model_id": {
      "type": "string"
    },
    "model_sha": {
      "type": "string"
    },
    "model_dtype": {
      "type": "string"
    },
    "model_device_type": {
      "type": "string"
    },
    "model_pipeline_tag": {
      "type": "string"
    },
    "max_concurrent_requests": {
      "type": "integer"
    },
    "max_best_of": {
      "type": "integer"
    },
    "max_stop_sequences": {
      "type": "integer"
    },
    "max_input_length": {
      "type": "integer"
    },
    "max_total_tokens": {
      "type": "integer"
    },
    "waiting_served_ratio": {
      "type": "number"
    },
    "max_batch_total_tokens": {
      "type": "integer"
    },
    "max_waiting_tokens": {
      "type": "integer"
    },
    "validation_workers": {
      "type": "integer"
    },
    "max_client_batch_size": {
      "type": "integer"
    },
    "version": {
      "type": "string"
    },
    "sha": {
      "type": "string"
    },
    "docker_label": {
      "type": "string"
    }
  }
}