Hugging Face · JSON Structure

Hugging Face Inference Endpoints Endpoint Metrics Structure

Type: object Properties: 4

EndpointMetrics is a JSON Structure definition published by Hugging Face, describing 4 properties. It conforms to the https://json-structure.org/draft/2020-12/schema meta-schema.

Properties

request_count request_duration_ms error_rate tokens_per_second

Meta-schema: https://json-structure.org/draft/2020-12/schema

JSON Structure

Raw ↑ 
{
  "$schema": "https://json-structure.org/draft/2020-12/schema",
  "name": "EndpointMetrics",
  "type": "object",
  "properties": {
    "request_count": {
      "type": "integer"
    },
    "request_duration_ms": {
      "type": "object"
    },
    "error_rate": {
      "type": "number"
    },
    "tokens_per_second": {
      "type": "number"
    }
  }
}