Feature

LLM Inference

Hosted model inference endpoints.

14 providers 190 APIs 13 declared variants

The provider serves text, chat, or completion inference against hosted models, usually with streaming and token-based billing. Integrators care about model choice, context window, and latency.

14 API providers on the APIs.io network offer llm inference. The highest-rated are Databricks, ChatGPT, NVIDIA NIM, Hugging Face, Hyperbolic.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 2 Complete, well-documented, and agent-ready
Databricks Collection of Databricks REST APIs for managing workspaces, clusters, jobs, and data operations. 57 APIs 73.3 ChatGPT OpenAI's ChatGPT API for conversational AI and language model interactions. 13 APIs 70.6
Strong 7 Solid coverage with minor gaps
NVIDIA NIM NVIDIA NIM (NVIDIA Inference Microservices) is a catalog of GPU-accelerated, containerized AI inference mic... 10 APIs 69.9 Hugging Face The AI community building the future with open-source machine learning models, datasets, and applications. 6 APIs 69.0 Hyperbolic Hyperbolic is an open-access AI cloud and decentralized GPU marketplace serving 200,000+ builders with affo... 6 APIs 65.2 Viam Viam is a robotics and edge AI platform founded in 2020 by Eliot Horowitz (MongoDB co-founder and former CT... 14 APIs 64.2 Lakera Lakera is an AI-native security platform that protects GenAI applications, agents, and workforces from prom... 2 APIs 61.2 Vespa Vespa is an open-source AI search engine, big-data serving engine, and vector database originally developed... 8 APIs 60.8 Azure Databricks Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a c... 39 APIs 60.7
Developing 3 Usable, with meaningful gaps to close
Kong Kong is the AI Connectivity Company. Its platform spans Kong Gateway (the open-source API gateway built on ... 10 APIs 57.7 Advanced Micro Devices Advanced Micro Devices (AMD) is a global semiconductor company that develops high-performance computing, gr... 2 APIs 56.8 AIMLAPI AIMLAPI is a unified AI model API gateway providing access to 400+ state-of-the-art AI models from OpenAI, ... 1 API 54.6
Thin 2 Limited public surface area
Marqo Marqo is an open-source, multimodal vector search engine that lets developers index text and images, genera... 1 API 36.6 Kong AI Gateway Kong AI Gateway is the AI-native capability layer built on top of Kong Gateway and managed through Kong Kon... 21 APIs 34.7

What Providers Actually Declared

This feature is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

100+ foundation models exposed through a single API contract — Llama 3.1/3.2/3.3, Mistral, Mixtral, NVIDIA Nemotron, DeepSeek-R1, Qwen 2.5, Microsoft Phi, Google Gemma, IBM Granite, and FalconAI Model ServingChat CompletionsCoinbase x402 payment integration for crypto-native chat completionsModel InferenceModel Serving for low-latency inferenceModel serving endpoints for real-time inferenceNative tensor and ML model inference at serving timeService APIs for motion planning, vision, SLAM, navigation, data management, ML model inference, sensors aggregation, world state, discovery, and generic servicesSingle `docker run` install bundling Vespa storage and embedding model inferenceSingle-endpoint /v2/guard API following the OpenAI chat completions message formatText and Chat CompletionsUniversal LLM API

Scroll for all 13