Hugging Face website screenshot

Hugging Face

The AI community building the future with open-source machine learning models, datasets, and applications.

6 APIs 7 Features

APIs

Hugging Face Inference API

Run inference on 200,000+ machine learning models with a simple HTTP request.

Hugging Face Hub API

Programmatically interact with the Hugging Face Hub - manage models, datasets, and spaces.

Hugging Face Inference Endpoints API

Deploy and scale machine learning models with dedicated, secure infrastructure.

Hugging Face Inference Providers API

Unified proxy layer providing access to 15+ inference partners through a single OpenAI-compatible endpoint.

Hugging Face Dataset Viewer API

Query and visualize datasets stored on the Hugging Face Hub through a lightweight REST API.

Hugging Face Text Generation Inference API

High-performance toolkit for deploying and serving large language models with optimized inference.

Agent Skills

hf-cli

AGENT SKILL

hf-mcp

AGENT SKILL

huggingface-best

AGENT SKILL

huggingface-community-evals

AGENT SKILL

huggingface-datasets

AGENT SKILL

huggingface-gradio

AGENT SKILL

huggingface-llm-trainer

AGENT SKILL

huggingface-local-models

AGENT SKILL

huggingface-paper-publisher

AGENT SKILL

huggingface-papers

AGENT SKILL

huggingface-tool-builder

AGENT SKILL

huggingface-trackio

AGENT SKILL

huggingface-vision-trainer

AGENT SKILL

huggingface-zerogpu

AGENT SKILL

train-sentence-transformers

AGENT SKILL

transformers-js

AGENT SKILL

Collections

Hugging Face Dataset Viewer API

POSTMAN

Hugging Face Hub API

POSTMAN

Hugging Face Inference API

POSTMAN

Hugging Face Inference Endpoints API

POSTMAN

Hugging Face Inference Providers API

POSTMAN

Hugging Face Text Generation Inference API

POSTMAN

Hugging Face Dataset Viewer API

OPEN

Hugging Face Hub API

OPEN

Hugging Face Inference API

OPEN

Hugging Face Inference Endpoints API

OPEN

Hugging Face Inference Providers API

OPEN

Hugging Face Text Generation Inference API

OPEN

Arazzo Workflows

Hugging Face Chat Completion with Model Discovery

Discover an available router model, confirm it exists, then run an OpenAI-compatible chat completion.

ARAZZO

Hugging Face Create Repository and Configure

Identify the authenticated user, create a new repository, then set its visibility and gating.

ARAZZO

Hugging Face Dataset Filter Rows

Confirm a dataset supports filtering, resolve its split, then apply a SQL-like filter.

ARAZZO

Hugging Face Dataset Search and Statistics

Resolve a dataset split, full-text search within it, then pull column statistics.

ARAZZO

Hugging Face Dataset Size and Parquet Files

Confirm a dataset on the Hub, read its size profile, then list its Parquet files.

ARAZZO

Hugging Face Dataset Validate and Preview

Check a dataset is viewer-ready, list its splits, then preview the first rows.

ARAZZO

Hugging Face Deploy Inference Endpoint and Wait

Create a dedicated Inference Endpoint, then poll its status until it is running.

ARAZZO

Hugging Face Discover a Space

Search Hub Spaces by SDK and query, then load the top Space's details.

ARAZZO

Hugging Face Embeddings Pair

Confirm an embedding model is available, then embed a query and a document for comparison.

ARAZZO

Hugging Face Grounded Text Generation

Find a text-generation model on the Hub, confirm it, then run hosted text generation.

ARAZZO

Hugging Face Search and Inspect a Model

Search the Hub for a model, fetch its full record, then inspect a specific revision.

ARAZZO

Hugging Face Summarize Then Translate

Summarize a long document with one model, then translate the summary with another.

ARAZZO

Hugging Face TGI Inspect and Generate

Read a TGI server's info, tokenize a prompt to check its length, then generate text.

ARAZZO

Hugging Face Toggle Inference Endpoint State

Read an endpoint's current state, then pause it if running or resume it if paused.

ARAZZO

GraphQL

Hugging Face GraphQL Schema

This conceptual GraphQL schema models the Hugging Face AI platform, covering the full surface area of its public APIs: the Hub API for managing models, datasets, and spaces; the...

GRAPHQL

Pricing Plans

Hugging Face Plans Pricing

8 plans

PLANS

Rate Limits

Hugging Face Rate Limits

6 limits

RATE LIMITS

FinOps

Hugging Face Finops

FINOPS

Features

Model Inference

Run inference on 200,000+ ML models with a simple HTTP request across NLP, vision, audio, and multimodal tasks.

Hub Repository Management

Programmatically manage models, datasets, and spaces including creation, versioning, and access control.

Dedicated Endpoints

Deploy models on dedicated infrastructure with autoscaling, custom hardware, and private networking.

Multi-Provider Routing

Unified OpenAI-compatible API routing to 15+ inference providers with automatic model selection.

Dataset Exploration

Query, search, filter, and visualize datasets without downloading via the Dataset Viewer API.

Text Generation Inference

High-performance LLM serving with streaming, tool calling, structured output, and grammar constraints.

OpenAI Compatibility

Drop-in replacement for OpenAI API with chat completions, embeddings, and image generation endpoints.

Use Cases

ML Model Prototyping

Rapidly prototype AI applications by running inference on pre-trained models without infrastructure setup.

Production ML Deployment

Deploy and scale ML models for production workloads with dedicated endpoints and autoscaling.

Dataset Curation

Explore, validate, and curate ML datasets programmatically for training pipeline automation.

AI Application Development

Build AI-powered applications using unified inference APIs with multi-provider routing.

Model Benchmarking

Compare model performance across providers and hardware configurations for optimization.

Semantic Vocabularies

Hugging Face Context

4 classes · 15 properties

JSON-LD

Hugging Face Dataset Viewer Context

0 classes · 0 properties

JSON-LD

Hugging Face Hub Context

0 classes · 0 properties

JSON-LD

Hugging Face Inference Context

0 classes · 0 properties

JSON-LD

Hugging Face Inference Endpoints Context

0 classes · 0 properties

JSON-LD

Hugging Face Inference Providers Context

0 classes · 0 properties

JSON-LD

Hugging Face Text Generation Inference Context

0 classes · 0 properties

JSON-LD

API Governance Rules

Hugging Face API Rules

7 rules · 7 errors

SPECTRAL

JSON Structure

Hugging Face Dataset Viewer Error Structure

4 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Parquet Response Structure

2 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Rows Response Structure

5 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Search Response Structure

5 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Size Response Structure

2 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Splits Response Structure

3 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Statistics Response Structure

3 properties

JSON STRUCTURE

Hugging Face Dataset Viewer Validity Response Structure

5 properties

JSON STRUCTURE

Hugging Face Hub Create Repo Request Structure

5 properties

JSON STRUCTURE

Hugging Face Hub Dataset Info Structure

0 properties

JSON STRUCTURE

Hugging Face Hub Dataset Summary Structure

13 properties

JSON STRUCTURE

Hugging Face Hub Error Structure

2 properties

JSON STRUCTURE

Hugging Face Hub Model Info Structure

0 properties

JSON STRUCTURE

Hugging Face Hub Model Summary Structure

15 properties

JSON STRUCTURE

Hugging Face Hub Repo Url Structure

1 properties

JSON STRUCTURE

Hugging Face Hub Space Info Structure

0 properties

JSON STRUCTURE

Hugging Face Hub Space Summary Structure

11 properties

JSON STRUCTURE

Hugging Face Hub User Info Structure

11 properties

JSON STRUCTURE

Hugging Face Inference Classification Result Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Create Endpoint Request Structure

5 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Endpoint Metrics Structure

4 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Endpoint Structure

8 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Error Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Provider Structure

4 properties

JSON STRUCTURE

Hugging Face Inference Endpoints Update Endpoint Request Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Error Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Feature Extraction Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Fill Mask Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Fill Mask Response Structure

4 properties

JSON STRUCTURE

Hugging Face Inference Inference Request Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Inference Response Structure

0 properties

JSON STRUCTURE

Hugging Face Inference Model Loading Response Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Object Detection Result Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Providers Chat Completion Request Structure

18 properties

JSON STRUCTURE

Hugging Face Inference Providers Chat Completion Response Structure

6 properties

JSON STRUCTURE

Hugging Face Inference Providers Chat Completion Stream Response Structure

6 properties

JSON STRUCTURE

Hugging Face Inference Providers Completion Request Structure

8 properties

JSON STRUCTURE

Hugging Face Inference Providers Completion Response Structure

5 properties

JSON STRUCTURE

Hugging Face Inference Providers Completion Stream Response Structure

5 properties

JSON STRUCTURE

Hugging Face Inference Providers Embedding Request Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Providers Embedding Response Structure

4 properties

JSON STRUCTURE

Hugging Face Inference Providers Error Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Providers Image Generation Request Structure

8 properties

JSON STRUCTURE

Hugging Face Inference Providers Image Generation Response Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Providers Usage Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Question Answering Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Question Answering Response Structure

4 properties

JSON STRUCTURE

Hugging Face Inference Sentence Similarity Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Speech Recognition Response Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Summarization Request Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Summarization Response Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Text Classification Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Text Generation Request Structure

3 properties

JSON STRUCTURE

Hugging Face Inference Text Generation Response Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Text To Image Request Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Translation Request Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Translation Response Structure

1 properties

JSON STRUCTURE

Hugging Face Inference Zero Shot Classification Request Structure

2 properties

JSON STRUCTURE

Hugging Face Inference Zero Shot Classification Response Structure

3 properties

JSON STRUCTURE

Hugging Face Structure

0 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Chat Completion Request Structure

17 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Chat Completion Response Structure

6 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Chat Completion Stream Response Structure

6 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Completion Request Structure

9 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Completion Response Structure

5 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Completion Stream Response Structure

5 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Error Response Structure

2 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Generate Request Structure

2 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Generate Response Structure

2 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Info Structure

18 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Stream Response Structure

3 properties

JSON STRUCTURE

Hugging Face Text Generation Inference Usage Structure

3 properties

JSON STRUCTURE

Example Payloads

Hugging Face Automaticspeechrecognition Example

6 fields

EXAMPLE

Hugging Face Chatcompletions Example

6 fields

EXAMPLE

Hugging Face Completions Example

6 fields

EXAMPLE

Hugging Face Createchatcompletion Example

6 fields

EXAMPLE

Hugging Face Createcompletion Example

6 fields

EXAMPLE

Hugging Face Createembeddings Example

6 fields

EXAMPLE

Hugging Face Createendpoint Example

6 fields

EXAMPLE

Hugging Face Createimagegeneration Example

6 fields

EXAMPLE

Hugging Face Createrepo Example

6 fields

EXAMPLE

Hugging Face Createspeech Example

6 fields

EXAMPLE

Hugging Face Createtranscription Example

6 fields

EXAMPLE

Hugging Face Dataset Viewer Error Example

4 fields

EXAMPLE

Hugging Face Dataset Viewer Parquet Response Example

2 fields

EXAMPLE

Hugging Face Dataset Viewer Rows Response Example

5 fields

EXAMPLE

Hugging Face Dataset Viewer Search Response Example

5 fields

EXAMPLE

Hugging Face Dataset Viewer Size Response Example

2 fields

EXAMPLE

Hugging Face Dataset Viewer Splits Response Example

3 fields

EXAMPLE

Hugging Face Dataset Viewer Statistics Response Example

3 fields

EXAMPLE

Hugging Face Dataset Viewer Validity Response Example

5 fields

EXAMPLE

Hugging Face Deleteendpoint Example

6 fields

EXAMPLE

Hugging Face Deleterepo Example

6 fields

EXAMPLE

Hugging Face Featureextraction Example

6 fields

EXAMPLE

Hugging Face Fillmask Example

6 fields

EXAMPLE

Hugging Face Filterrows Example

6 fields

EXAMPLE

Hugging Face Generate Example

6 fields

EXAMPLE

Hugging Face Generatestream Example

6 fields

EXAMPLE

Hugging Face Getcroissantmetadata Example

6 fields

EXAMPLE

Hugging Face Getdataset Example

6 fields

EXAMPLE

Hugging Face Getdatasetparquet Example

6 fields

EXAMPLE

Hugging Face Getdatasetsize Example

6 fields

EXAMPLE

Hugging Face Getendpoint Example

6 fields

EXAMPLE

Hugging Face Getendpointlogs Example

6 fields

EXAMPLE

Hugging Face Getendpointmetrics Example

6 fields

EXAMPLE

Hugging Face Getfirstrows Example

6 fields

EXAMPLE

Hugging Face Getinfo Example

6 fields

EXAMPLE

Hugging Face Getmetrics Example

6 fields

EXAMPLE

Hugging Face Getmodel Example

6 fields

EXAMPLE

Hugging Face Getmodelrevision Example

6 fields

EXAMPLE

Hugging Face Getparquetfiles Example

6 fields

EXAMPLE

Hugging Face Getrows Example

6 fields

EXAMPLE

Hugging Face Getspace Example

6 fields

EXAMPLE

Hugging Face Getsplits Example

6 fields

EXAMPLE

Hugging Face Getstatistics Example

6 fields

EXAMPLE

Hugging Face Hub Create Repo Request Example

5 fields

EXAMPLE

Hugging Face Hub Dataset Info Example

EXAMPLE

Hugging Face Hub Dataset Summary Example

13 fields

EXAMPLE

Hugging Face Hub Error Example

2 fields

EXAMPLE

Hugging Face Hub Model Info Example

EXAMPLE

Hugging Face Hub Model Summary Example

15 fields

EXAMPLE

Hugging Face Hub Repo Url Example

1 fields

EXAMPLE

Hugging Face Hub Space Info Example

EXAMPLE

Hugging Face Hub Space Summary Example

11 fields

EXAMPLE

Hugging Face Hub User Info Example

11 fields

EXAMPLE

Hugging Face Imageclassification Example

6 fields

EXAMPLE

Hugging Face Inference Classification Result Example

2 fields

EXAMPLE

Hugging Face Inference Endpoints Create Endpoint Request Example

5 fields

EXAMPLE

Hugging Face Inference Endpoints Endpoint Example

8 fields

EXAMPLE

Hugging Face Inference Endpoints Endpoint Metrics Example

4 fields

EXAMPLE

Hugging Face Inference Endpoints Error Example

2 fields

EXAMPLE

Hugging Face Inference Endpoints Provider Example

4 fields

EXAMPLE

Hugging Face Inference Endpoints Update Endpoint Request Example

3 fields

EXAMPLE

Hugging Face Inference Error Example

2 fields

EXAMPLE

Hugging Face Inference Feature Extraction Request Example

1 fields

EXAMPLE

Hugging Face Inference Fill Mask Request Example

1 fields

EXAMPLE

Hugging Face Inference Fill Mask Response Example

4 fields

EXAMPLE

Hugging Face Inference Inference Request Example

3 fields

EXAMPLE

Hugging Face Inference Inference Response Example

EXAMPLE

Hugging Face Inference Model Loading Response Example

2 fields

EXAMPLE

Hugging Face Inference Object Detection Result Example

3 fields

EXAMPLE

Hugging Face Inference Providers Chat Completion Request Example

18 fields

EXAMPLE

Hugging Face Inference Providers Chat Completion Response Example

6 fields

EXAMPLE

Hugging Face Inference Providers Chat Completion Stream Response Example

6 fields

EXAMPLE

Hugging Face Inference Providers Completion Request Example

8 fields

EXAMPLE

Hugging Face Inference Providers Completion Response Example

5 fields

EXAMPLE

Hugging Face Inference Providers Completion Stream Response Example

5 fields

EXAMPLE

Hugging Face Inference Providers Embedding Request Example

3 fields

EXAMPLE

Hugging Face Inference Providers Embedding Response Example

4 fields

EXAMPLE

Hugging Face Inference Providers Error Example

1 fields

EXAMPLE

Hugging Face Inference Providers Image Generation Request Example

8 fields

EXAMPLE

Hugging Face Inference Providers Image Generation Response Example

2 fields

EXAMPLE

Hugging Face Inference Providers Usage Example

3 fields

EXAMPLE

Hugging Face Inference Question Answering Request Example

1 fields

EXAMPLE

Hugging Face Inference Question Answering Response Example

4 fields

EXAMPLE

Hugging Face Inference Sentence Similarity Request Example

1 fields

EXAMPLE

Hugging Face Inference Speech Recognition Response Example

1 fields

EXAMPLE

Hugging Face Inference Summarization Request Example

2 fields

EXAMPLE

Hugging Face Inference Summarization Response Example

1 fields

EXAMPLE

Hugging Face Inference Text Classification Request Example

1 fields

EXAMPLE

Hugging Face Inference Text Generation Request Example

3 fields

EXAMPLE

Hugging Face Inference Text Generation Response Example

1 fields

EXAMPLE

Hugging Face Inference Text To Image Request Example

2 fields

EXAMPLE

Hugging Face Inference Translation Request Example

1 fields

EXAMPLE

Hugging Face Inference Translation Response Example

1 fields

EXAMPLE

Hugging Face Inference Zero Shot Classification Request Example

2 fields

EXAMPLE

Hugging Face Inference Zero Shot Classification Response Example

3 fields

EXAMPLE

Hugging Face Isvalid Example

6 fields

EXAMPLE

Hugging Face Listdatasets Example

6 fields

EXAMPLE

Hugging Face Listdatasettags Example

6 fields

EXAMPLE

Hugging Face Listendpoints Example

6 fields

EXAMPLE

Hugging Face Listmetrics Example

6 fields

EXAMPLE

Hugging Face Listmodels Example

6 fields

EXAMPLE

Hugging Face Listmodeltags Example

6 fields

EXAMPLE

Hugging Face Listproviders Example

6 fields

EXAMPLE

Hugging Face Listspaces Example

6 fields

EXAMPLE

Hugging Face Objectdetection Example

6 fields

EXAMPLE

Hugging Face Pauseendpoint Example

6 fields

EXAMPLE

Hugging Face Questionanswering Example

6 fields

EXAMPLE

Hugging Face Resumeendpoint Example

6 fields

EXAMPLE

Hugging Face Runinference Example

6 fields

EXAMPLE

Hugging Face Runpipelineinference Example

6 fields

EXAMPLE

Hugging Face Scaletozero Example

6 fields

EXAMPLE

Hugging Face Searchrows Example

6 fields

EXAMPLE

Hugging Face Sentencesimilarity Example

6 fields

EXAMPLE

Hugging Face Summarization Example

6 fields

EXAMPLE

Hugging Face Text Generation Inference Chat Completion Request Example

17 fields

EXAMPLE

Hugging Face Text Generation Inference Chat Completion Response Example

6 fields

EXAMPLE

Hugging Face Text Generation Inference Chat Completion Stream Response Example

6 fields

EXAMPLE

Hugging Face Text Generation Inference Completion Request Example

9 fields

EXAMPLE

Hugging Face Text Generation Inference Completion Response Example

5 fields

EXAMPLE

Hugging Face Text Generation Inference Completion Stream Response Example

5 fields

EXAMPLE

Hugging Face Text Generation Inference Error Response Example

2 fields

EXAMPLE

Hugging Face Text Generation Inference Generate Request Example

2 fields

EXAMPLE

Hugging Face Text Generation Inference Generate Response Example

2 fields

EXAMPLE

Hugging Face Text Generation Inference Info Example

18 fields

EXAMPLE

Hugging Face Text Generation Inference Stream Response Example

3 fields

EXAMPLE

Hugging Face Text Generation Inference Usage Example

3 fields

EXAMPLE

Hugging Face Textclassification Example

6 fields

EXAMPLE

Hugging Face Textgeneration Example

6 fields

EXAMPLE

Hugging Face Texttoimage Example

6 fields

EXAMPLE

Hugging Face Tokenize Example

6 fields

EXAMPLE

Hugging Face Translation Example

6 fields

EXAMPLE

Hugging Face Updateendpoint Example

6 fields

EXAMPLE

Hugging Face Updatereposettings Example

6 fields

EXAMPLE

Hugging Face Whoami Example

6 fields

EXAMPLE

Hugging Face Zeroshotclassification Example

6 fields

EXAMPLE

Resources

🔗
PostmanWorkspace
PostmanWorkspace
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🔗
Arazzo
Arazzo
🌐
Portal
Portal
🔗
Documentation
Documentation
🚀
GettingStarted
GettingStarted
💰
Pricing
Pricing
📰
Blog
Blog
📄
ChangeLog
ChangeLog
📝
Signup
Signup
🔗
Login
Login
💬
Support
Support
🔗
Contact
Contact
💬
Support
Support
👥
GitHubOrganization
GitHubOrganization
🔗
X
X
🔗
LinkedIn
LinkedIn
💬
Support
Support
👥
YouTube
YouTube
🟢
StatusPage
StatusPage
📜
TermsOfService
TermsOfService
📜
PrivacyPolicy
PrivacyPolicy
📦
SDKs
SDKs
📦
SDKs
SDKs
🔗
JSONSchema
JSONSchema
🔗
JSONSchema
JSONSchema
🔗
JSONSchema
JSONSchema
🔗
JSONSchema
JSONSchema
🔗
JSONSchema
JSONSchema
🔗
JSONLD
JSONLD
🔗
MCPServer
MCPServer
🔗
AgentSkills
AgentSkills

Sources

Raw ↑ 
opencollection: 1.0.0
info:
  name: Hugging Face Text Generation Inference API
  version: 1.0.0
request:
  auth:
    type: bearer
    token: '{{bearerToken}}'
items:
- info:
    name: Text Generation
    type: folder
  items:
  - info:
      name: Generate Text
      type: http
    http:
      method: POST
      url: https://api-inference.huggingface.co/generate
      body:
        type: json
        data: '{}'
    docs: Generate text from a prompt using the loaded model. Returns the full generated text in a single response.
  - info:
      name: Generate Text With Streaming
      type: http
    http:
      method: POST
      url: https://api-inference.huggingface.co/generate_stream
      body:
        type: json
        data: '{}'
    docs: Generate text from a prompt using Server-Sent Events (SSE) streaming. Tokens are returned incrementally as they
      are generated.
  - info:
      name: Create Text Completion (openai Compatible)
      type: http
    http:
      method: POST
      url: https://api-inference.huggingface.co/v1/completions
      body:
        type: json
        data: '{}'
    docs: Create a text completion using the OpenAI-compatible completions API format.
- info:
    name: Chat
    type: folder
  items:
  - info:
      name: Create Chat Completion (openai Compatible)
      type: http
    http:
      method: POST
      url: https://api-inference.huggingface.co/v1/chat/completions
      body:
        type: json
        data: '{}'
    docs: Create a chat completion using the OpenAI-compatible Messages API. Supports conversations, tool calling, structured
      output via JSON schema, and multi-modal inputs (text + images). Fully compatible with OpenAI client libraries.
- info:
    name: Info
    type: folder
  items:
  - info:
      name: List Available Models
      type: http
    http:
      method: GET
      url: https://api-inference.huggingface.co/v1/models
    docs: Get information about the model currently loaded on this TGI server.
  - info:
      name: Get Server Information
      type: http
    http:
      method: GET
      url: https://api-inference.huggingface.co/info
    docs: Get metadata about the TGI server including the loaded model, version, SHA, Docker label, and model-specific parameters.
  - info:
      name: Health Check
      type: http
    http:
      method: GET
      url: https://api-inference.huggingface.co/health
    docs: Check the health of the TGI server. Returns 200 if the model is loaded and ready to serve requests.
  - info:
      name: Get Prometheus Metrics
      type: http
    http:
      method: GET
      url: https://api-inference.huggingface.co/metrics
    docs: Get server metrics in Prometheus format including request counts, latencies, queue sizes, and token throughput.
  - info:
      name: Tokenize Text
      type: http
    http:
      method: POST
      url: https://api-inference.huggingface.co/tokenize
      body:
        type: json
        data: '{}'
    docs: Tokenize a string of text using the model's tokenizer. Returns the token IDs and their string representations.
bundled: true