# Furiosa-LLM OpenAI-Compatible Server

**Canonical:** https://apis.io/apis/furiosa/furiosa-llm-openai-server/  
**Provider:** FuriosaAI — https://apis.io/providers/furiosa/  
**Base URL:** http://{furiosa_llm_host}:8000/v1  
**Documentation:** https://developer.furiosa.ai/latest/en/furiosa_llm/furiosa-llm-serve.html

Furiosa-LLM OpenAI-Compatible Server is one of 5 APIs that [FuriosaAI](https://apis.io/providers/furiosa/) publishes on the [APIs.io](https://apis.io/) network. Tagged areas include LLM, Inference, and OpenAI-Compatible. The published artifact set on APIs.io includes API documentation, an API reference, authentication docs, and rate-limit docs.

The HTTP server started by `furiosa-llm serve <ARTIFACT_PATH>`. It hosts a single model on RNGD NPUs and exposes an OpenAI-compatible surface - /v1/completions, /v1/chat/completions, /v1/responses (OpenResponses), /v1/embeddings, /v1/models, /v1/models/{model_id} - plus the vLLM-originated /score and /rerank pooling endpoints, a tokenizer API (/tokenize, /detokenize, /tokenizer_info), GET /version and a Prometheus GET /metrics endpoint. It is customer-hosted software, so the base URL below is templated on the operator's own host; the documented default is http://localhost:8000/v1. FuriosaAI publishes no OpenAPI for this surface - the parameter tables in the serving docs are the contract.

## Machine-readable artifacts (6)

- **Documentation** — https://developer.furiosa.ai/latest/en/furiosa_llm/furiosa-llm-serve.html
- **APIReference** — https://developer.furiosa.ai/latest/en/furiosa_llm/reference.html
- **Authentication** — https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/authentication/furiosa-authentication.yml
- **Conventions** — https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/conventions/furiosa-conventions.yml
- **RateLimits** — https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/rate-limits/furiosa-rate-limits.yml
- **APIsJSON** — https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/apis.yml

## Other FuriosaAI APIs (4)

- [FuriosaAI Health API](https://apis.io/apis/furiosa/furiosa-health-api/)
- [FuriosaAI Models API](https://apis.io/apis/furiosa/furiosa-models-api/)
- [FuriosaAI Predict API](https://apis.io/apis/furiosa/furiosa-predict-api-api/)
- [FuriosaAI Repository API](https://apis.io/apis/furiosa/furiosa-repository-api/)

## Tags

LLM, Inference, OpenAI-Compatible

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/apis/furiosa/furiosa-llm-openai-server/). The API's provider profile, Kin Score and agent-readiness rating are at https://apis.io/providers/furiosa/.