FuriosaAI

Furiosa-LLM OpenAI-Compatible Server

The HTTP server started by `furiosa-llm serve `. It hosts a single model on RNGD NPUs and exposes an OpenAI-compatible surface - /v1/completions, /v1/chat/completions, /v1/responses (OpenResponses), /v1/embeddings, /v1/models, /v1/models/{model_id} - plus the vLLM-originated /score and /rerank pooling endpoints, a tokenizer API (/tokenize, /detokenize, /tokenizer_info), GET /version and a Prometheus GET /metrics endpoint. It is customer-hosted software, so the base URL below is templated on the operator's own host; the documented default is http://localhost:8000/v1. FuriosaAI publishes no OpenAPI for this surface - the parameter tables in the serving docs are the contract.

GitHub

Documentation

📖
Documentation
https://developer.furiosa.ai/latest/en/furiosa_llm/furiosa-llm-serve.html
📖
APIReference
https://developer.furiosa.ai/latest/en/furiosa_llm/reference.html
📖
Authentication
https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/authentication/furiosa-authentication.yml
📖
RateLimits
https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/rate-limits/furiosa-rate-limits.yml

Other Resources

🔗
Conventions
https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/conventions/furiosa-conventions.yml
🔗
APIsJSON
https://raw.githubusercontent.com/api-evangelist/furiosa/refs/heads/main/apis.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/furiosa-llm-openai-server"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑ 
aid: furiosa-llm-openai-server
name: Furiosa-LLM OpenAI-Compatible Server
description: The HTTP server started by `furiosa-llm serve <ARTIFACT_PATH>`. It hosts a single model on
  RNGD NPUs and exposes an OpenAI-compatible surface - /v1/completions, /v1/chat/completions, /v1/responses
  (OpenResponses), /v1/embeddings, /v1/models, /v1/models/{model_id} - plus the vLLM-originated /score
  and /rerank pooling endpoints, a tokenizer API (/tokenize, /detokenize, /tokenizer_info), GET /version
  and a Prometheus GET /metrics endpoint. It is customer-hosted software, so the base URL below is templated
  on the operator's own host; the documented default is http://localhost:8000/v1. FuriosaAI publishes
  no OpenAPI for this surface - the parameter tables in the serving docs are the contract.
humanURL: https://developer.furiosa.ai/latest/en/furiosa_llm/furiosa-llm-serve.html
baseURL: http://{furiosa_llm_host}:8000/v1
tags:
- LLM
- Inference
- OpenAI-Compatible
tags_raw:
- LLM
- Inference
- OpenAI Compatible
properties:
- type: Documentation
  url: https://developer.furiosa.ai/latest/en/furiosa_llm/furiosa-llm-serve.html
- type: APIReference
  url: https://developer.furiosa.ai/latest/en/furiosa_llm/reference.html
- type: Authentication
  url: authentication/furiosa-authentication.yml
- type: Conventions
  url: conventions/furiosa-conventions.yml
- type: RateLimits
  url: rate-limits/furiosa-rate-limits.yml