Scalable Inference Serving

vLLM OpenAI-Compatible API

vLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for efficient KV cache management. vLLM exposes an OpenAI-compatible REST API allowing seamless migration from OpenAI endpoints. In 2026, vLLM integrates with KServe via LLMInferenceService and llm-d for production-grade distributed LLM inference. Powers major LLM deployments at scale.

GitHub

Documentation

📖
Documentation
https://docs.vllm.ai/en/stable/
📖
APIReference
https://docs.vllm.ai/en/stable/serving/openai_compatible_server.html

Other Resources

🔗
GitHub
https://github.com/vllm-project/vllm
🔗
ChangeLog
https://github.com/vllm-project/vllm/releases

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/vllm-openai-compatible-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑ 
name: vLLM OpenAI-Compatible API
description: vLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention
  for efficient KV cache management. vLLM exposes an OpenAI-compatible REST API allowing seamless migration
  from OpenAI endpoints. In 2026, vLLM integrates with KServe via LLMInferenceService and llm-d for production-grade
  distributed LLM inference. Powers major LLM deployments at scale.
image: https://docs.vllm.ai/en/stable/_static/logo/vllm-logo-text-light.png
humanUrl: https://docs.vllm.ai/
baseUrl: https://vllm.example.com/v1
tags:
- GPU
- Inference
- KV Cache
- LLM
- Model Serving
- Open-Source
- OpenAI-Compatible
tags_raw:
- GPU
- Inference
- KV Cache
- LLM
- Model Serving
- Open Source
- OpenAI-Compatible
properties:
- type: Documentation
  url: https://docs.vllm.ai/en/stable/
- type: GitHub
  url: https://github.com/vllm-project/vllm
- type: APIReference
  url: https://docs.vllm.ai/en/stable/serving/openai_compatible_server.html
- type: ChangeLog
  url: https://github.com/vllm-project/vllm/releases
contact:
- type: GitHubIssues
  url: https://github.com/vllm-project/vllm/issues
- type: Slack
  url: https://vllm-dev.slack.com/