established · 0.0 capabilitymarket actiondomain

Inference

Score 28.9 / 100 123 providers +40 via APIs 94 APIs Search apis.io →
Business capabilities this tag reaches
Information & Data Management 1
Variants seen in the corpus: Inferenceinference

Providers using this tag (123)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 3 Complete, well-documented, and agent-ready
Strong 8 Solid coverage with minor gaps
Developing 43 Usable, with meaningful gaps to close
CrusoeAI InfrastructureCloud ComputingGPU ComputeMachine-Learning2 APIs53.6InferenceCompanyArtificial IntelligenceMachine-LearningLLM1 API53.6SambaNova SystemsCompanyArtificial IntelligenceMachine-LearningLLM2 APIs52.6Dedalus LabsCompanyArtificial IntelligenceAgentsMCP2 APIs51.8SimplismartCompanyArtificial IntelligenceMachine-Learning19 APIs51.0ParasailArtificial IntelligenceGPULarge Language Models3 APIs50.9RunPodArtificial IntelligenceCloudComputeGPU1 API50.9LambdaArtificial IntelligenceCloudClusterCompute1 API49.5Sail ResearchCompanyArtificial IntelligenceLLM1 API48.3FriendliAICompanyInfrastructureArtificial IntelligenceMachine-Learning1 API48.2OpenRelayCompanyGPUArtificial Intelligence1 API47.9Fastino LabsCompanyArtificial IntelligenceMachine-LearningSmall Language Models1 API47.7ModelRushArtificial IntelligenceLLMMulti-Modal1 API47.2Aleph AlphaCompanyArtificial IntelligenceMachine-LearningLarge Language Models6 APIs46.9TensorWaveCompanyArtificial IntelligenceMachine-LearningCloud Computing1 API46.9Novita AIArtificial IntelligenceLLMGPU1 API46.7SailCompanyArtificial IntelligenceMachine-LearningLLM1 API46.2Pruna AICompanyArtificial IntelligenceMachine-LearningImage-Generation1 API46.1Standard ComputeLLM APIFlat RateSubscriptionAI Agents1 API45.3RouterPlexLLMArtificial IntelligenceAI Gateway1 API44.5CoreWeaveArtificial IntelligenceCloudGPUHPC1 API44.4Superb AIArtificial IntelligenceMachine-LearningComputer-VisionData Labeling1 API44.3BentoMLMachine-LearningModel ServingArtificial Intelligence1 API44.2FuriosaAIArtificial IntelligenceMachine-LearningSemiconductors2 APIs43.8FlexAICompanyAi MlArtificial IntelligenceMachine-Learning1 API43.3AI21 LabsArtificial IntelligenceFoundation ModelsLLMJamba1 API43.1Sahara AICompanyCryptoArtificial IntelligenceMachine-Learning1 API43.0Scalable Inference ServingArtificial IntelligenceCNCFDeployment1 API42.7Arcee AICompanyArtificial IntelligenceMachine-LearningLarge Language Models1 API42.3BeamServerlessGPUPython1 API42.2Featherless AIArtificial IntelligenceLLMServerless1 API42.2ChutesArtificial IntelligenceLLMServerless1 API41.9SUTRA (Two AI)Artificial IntelligenceLLMMultilingual1 API41.3RunwareCompanyArtificial IntelligenceMachine-Learning1 API41.0CentMLArtificial IntelligenceLLMServerless1 API40.9PaleBlueDot.AIArtificial IntelligenceMachine-LearningLarge Language Models2 APIs40.8Adaptive MLCompanyAi MlLLMFine-Tuning1 API40.6CerebriumArtificial IntelligenceGPUServerless1 API40.5NscaleArtificial IntelligenceGPUServerless1 API40.4Triton Inference ServerArtificial IntelligenceDeep LearningMachine-Learning2 APIs39.9InferlessArtificial IntelligenceML InferenceServerless GPUModel Deployment1 API39.5PredibaseArtificial IntelligenceLLMFine-Tuning1 API39.3TargonArtificial IntelligenceLLMDecentralized1 API39.3
Thin 43 Limited public surface area
.txtCompanyArtificial IntelligenceLLMStructured Outputs1 API38.5LocalAIArtificial IntelligenceMachine-LearningLarge Language Models2 APIs38.4OxenCompanyData Version ControlMachine-LearningArtificial Intelligence2 APIs38.4DataCrunchGPU CloudInfrastructureCompute1 API38.3glhfArtificial IntelligenceLLMOpen Source Models1 API38.0SeldonMLOpsMachine-LearningModel Serving3 APIs37.8Qubrid AIArtificial IntelligenceCloud ComputingGPU4 APIs37.3Secton APIArtificial IntelligenceLLMChat Completions1 API37.2OvershootCompanyArtificial IntelligenceComputer-VisionVideo2 APIs36.5Moonshot AIArtificial IntelligenceLLMLong Context1 API36.3Together AIArtificial IntelligenceLLMFoundation Models3 APIs36.1LaminiArtificial IntelligenceLLMFine-TuningMemory Tuning1 API35.7io.netArtificial IntelligenceGPUDecentralized ComputeDePIN8 APIs35.6ModularCompanyArtificial IntelligenceMachine-Learning1 API35.1overshoot.aiCompanyArtificial IntelligenceComputer-VisionVideo2 APIs34.4BasetenArtificial IntelligenceMLDeployment2 APIs34.3GroqArtificial IntelligenceLLMLPU1 API34.3MiniMaxArtificial IntelligenceLLMMulti-Modal1 API33.8Fireworks AIArtificial IntelligenceLLMMulti-Modal5 APIs33.6Recursal AI, Inc.CompanyArtificial IntelligenceMachine-LearningLLM3 APIs33.501.AIArtificial IntelligenceLLMYiOpen-Source1 API33.2DeepInfraArtificial IntelligenceLLMServerless1 API33.2HailoArtificial IntelligenceMachine-LearningSemiconductorsEdge Computing2 APIs33.1QwenArtificial IntelligenceLLMOpen-Source1 API32.8SiliconFlowArtificial IntelligenceLLMOpen-Source1 API32.7poolsideCompanyEnterpriseArtificial IntelligenceMachine-Learning1 API32.6Zhipu AIArtificial IntelligenceLLMGLM1 API32.5GoodfireCompanyArtificial IntelligenceMachine-LearningInterpretability1 API31.4ByteDance DoubaoArtificial IntelligenceLLMByteDance1 API30.2HyperbolicArtificial IntelligenceLLMGPU1 API30.0MangoBoostCompanyArtificial IntelligenceMachine-LearningInfrastructure3 APIs29.8KServeKubernetesMachine-LearningMLOps1 API29.6FluidstackArtificial IntelligenceGPUCloudCompute1 API29.3WomboCompanyArtificial IntelligenceMachine-Learning1 API28.8vLLMLLMOpen-SourceGPU1 API28.4OpenPipeArtificial IntelligenceLLMFine-TuningDistillation1 API28.2LatticaCompanyPrivacyFully Homomorphic EncryptionEncryption1 API27.9StriveworksCompanyArtificial IntelligenceMachine-LearningMLOps1 API27.0AnyscaleArtificial IntelligenceDistributed ComputingRayML Platform10 APIs26.9LM StudioCompanyArtificial IntelligenceLocal LLMMachine-Learning1 API26.8AsterlabCompanyArtificial IntelligenceMachine-LearningLLM1 API26.5TensorZeroCompanyAi MlLLMLLMOps26.5KAITOArtificial IntelligenceGPUKubernetes1 API26.2
Emerging 14 Early or largely undocumented
Minimal 12 Almost no public developer surface

APIs with this tag (90)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 6 Complete, well-documented, and agent-ready
Strong 16 Solid coverage with minor gaps
AIMLAPI Inference APIAI/ML API's own published OpenAPI, served from the API host at https://api.aimlapi.com/docs-yaml and render...65.5Swiss AI Platform Inference Endpoints APIOpenAI-compatible inference endpoints for chat, multimodal, audio, embedding, reasoning and guardrail model...64.9NexGen Cloud Inference APIOpenAI-compatible chat completions endpoint for running inference against deployed models. Use this endpoin...64.3Autoderm – AI Dermatology API Inference APIThe inference API from Autoderm – AI Dermatology API — 5 operation(s) for inference.63.5Model Serving Endpoints APICreate and manage model serving endpoints for deploying machine learning models as REST API endpoints.63.4Amazon SageMaker Runtime APIThe Amazon SageMaker AI runtime API for invoking deployed model endpoints to get real-time inference predic...63.2Infer by Flow7 Inference APIAuthenticated customer inference operations.63.0Compresr Inference APIThe Inference API from Compresr — 1 operation(s) for inference.62.8Seekr Inference APIThe Inference API from Seekr — 12 operation(s) for inference.61.3Paperspace Deployments APIContainer-as-a-service deployments that run user-provided images on Paperspace GPU machines with a managed ...61.0Amazon Nova Inference APISynchronous and streaming inference against the Amazon Nova understanding and generation models through the...60.7Viam Inference APICloud-hosted inference against registry-deployed models.60.2Hugging Face Inference APIServerless inference API for running predictions against thousands of models hosted on the Hugging Face Hub...57.2Pinecone Inference APIModel inference56.5Prime Intellect Inference APIOpenAI-compatible inference API for hosted frontier and open models served at api.pinference.ai. Supports s...56.5Amazon Bedrock Inference APIOperations for invoking models and running inference.56.2
Developing 32 Usable, with meaningful gaps to close
Crusoe Managed Inference APIOpenAI-compatible inference API from the Crusoe Intelligence Foundry. Send chat/completions and embeddings ...53.6Inference.net APIOpenAI-compatible inference API for open-source, frontier, and custom language models — chat completions, b...53.6RunPod ServerlessRunPod Serverless provides pay-as-you-go inference endpoints with autoscaling workers, queue-based and load...50.9Openwork Inference APIThe Inference API from Openwork — 1 operation(s) for inference.49.9Lambda Inference APILambda Inference API is an OpenAI-compatible REST gateway at https://api.lambda.ai/v1 that serves hosted op...49.5Sonde Platform Service APIThe Sonde Platform Service API lets partners run Sonde Vocal Biomarker Health Checks from their own mobile,...49.5OpenRelay Inference APIOpenAI-compatible chat completions API (POST /v1/chat/completions) and, for supporting models, an Anthropic...47.9Fastino Labs inference APIPioneer-native inference endpoint (encoder NER/classification/extraction and decoder text generation).47.7Akkio Inference APIThe Inference API from Akkio — 1 operation(s) for inference.47.5ModelRush APIOpenAI-style hosted inference. GET /v1/models answers keyless with the live catalog (verified 2026-09-09); ...47.20G Labs Inference APIThe Inference API from 0G Labs — 11 operation(s) for inference.47.1Azure OpenAI Inference REST APIData-plane REST API for running inference against deployed Azure OpenAI models, including chat completions,...47.0Huma Inference APIThe Inference API from Huma — 2 operation(s) for inference.46.8Standard Compute Inference APIOpenAI-compatible (and Anthropic Messages-compatible) LLM inference endpoint. Set base URL to https://api.s...45.3CoreWeave Inference APIThe CoreWeave Inference API manages Deployments, Gateways, and Capacity Claims for serverless and dedicated...44.4BentoML Service REST APIAuto-generated REST API endpoints produced when BentoML services are deployed. Each decorated service metho...44.2AkashML Inference APIOpenAI-compatible AI inference API providing access to open-source LLMs hosted on decentralized compute acr...43.7W&B Serverless Inference (CoreWeave)OpenAI-compatible inference API for hosted open-source foundation models, running on CoreWeave GPU infrastr...43.4AI21 Batch APIAsynchronous batch processing for large volumes of Jamba completions. Submit a batch job, poll for status, ...43.1Sahara AI Inference APIOpenAI-compatible chat completion inference.43.0BentoML REST APIBentoML is an open-source unified inference platform for deploying and scaling AI models. It auto-generates...42.7NVIDIA Triton Inference Server HTTP APINVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open...42.7Ray Serve REST APIRay Serve is a scalable model serving library built on Ray, designed for building online inference APIs. Su...42.7Scalable Inference Serving Inference APIModel inference request endpoints42.7vLLM OpenAI-Compatible APIvLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for e...42.7Runware Inference APISingle task-based endpoint for image, video, audio, 3D, and text inference across 400K+ models, reachable o...41.0PBD TokenRouter Inference APIOpenAI-, Anthropic- and Gemini-compatible inference gateway. One API key and one base URL route requests ac...40.8Cerebrium Inference APIThe Inference API from Cerebrium — 1 operation(s) for inference.40.5Triton GRPC APIHigh-performance gRPC API for model inference with support for streaming and binary tensor data.39.9Triton Inference Server Inference APIModel inference requests39.9Inferless Inference APIThe Inference API from Inferless — 1 operation(s) for inference.39.5Predibase Inference APIThe Inference API from Predibase — 4 operation(s) for inference.39.3
Thin 30 Limited public surface area
Ollama Cloud APIOllama Cloud provides cloud-hosted inference for large language models, giving access to larger models and ...39.2LocalAI Inference APIThe inference API from LocalAI — 7 operation(s) for inference.38.4TensorFlow Inference APIModel inference operations including classify, regress, and predict38.2AnyscaleAnyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting LLM inference ...38.1NVIDIA NIMNVIDIA NIM is a set of inference microservices for streamlined AI model deployment, prebuilt and optimized ...38.1Together AITogether AI is a full-stack AI Native Cloud for inference, fine-tuning, and GPU clusters powered by researc...38.1Seldon Inference APIThe Seldon Inference API provides REST and gRPC endpoints for serving machine learning model predictions at...37.8Gcore Inference APIEverywhere Inference edge AI model deployments.37.6King's e-Research AI Hub APIAn OpenAI-compatible LLM inference API operated by King's e-Research for researchers, students and staff. P...36.8TUD:AI LLM APIAn OpenAI-compatible LLM inference API operated by ZIH and ScaDS.AI Dresden/Leipzig for TU Dresden staff, s...36.8Lamini Inference APIText completion and streaming generation endpoints.35.7IO Intelligence APIOpenAI-compatible inference API for open-source AI models hosted on io.net's decentralized GPU network. Exp...35.6MAX Inference REST APIOpenAI-compatible inference API served by MAX. Exposes /v1/chat/completions, /v1/completions, /v1/embedding...35.1Tinker APIManaged training/fine-tuning and sampling API for open-weight language models, consumed through the officia...34.7Taalas APITaalas-native REST interface for running inference against the HC1 hardcore-model silicon. Three operations...34.3EigenAIEigenAI exposes deterministic, verifiable LLM inference over an OpenAI-compatible API surface, with executi...33.3Inworld LLM Router APIRouting layer over 220+ LLM models, billed at provider cost via Inworld's unified API.32.8Poolside APIOpenAI-compatible inference API for poolside's Laguna agentic-coding models. Send chat-completion and model...32.6Ember APIHosted mechanistic-interpretability API. OpenAI-compatible chat-completions sampling plus feature discovery...31.4SAP AI Core APIREST API for SAP AI Core, enabling training, deployment, and inference of AI and machine learning models wi...30.9Mango LLMBoost Inference Server APILLMBoost is MangoBoost's enterprise LLM inference server. It serves the OpenAI REST API on /v1 so an existi...29.8KServe Inference APIKServe's standardized model inference protocol for serving predictions across multiple ML frameworks on Kub...29.6Modelbit Deployment REST APIEvery Modelbit deployment is exposed as a versioned REST inference endpoint. POST an inference request (sin...29.4Lattica Platform APIThe LatticaAI platform API for deploying and operating encrypted workloads. An RPC-style HTTPS surface root...27.9Lightning AI Model APIsHosted inference API that serves frontier and open models behind a Lightning API key, billed per token with...27.2Chariot Platform APIPer-tenant REST API for the Chariot AI operations platform, organized as versioned microservice paths under...27.0Anyscale Services APIDeploys and manages production Ray Serve applications as long-running, autoscaling, multi-version services ...26.9Ray Serve HTTP APIHTTP interface for invoking models and applications deployed via Ray Serve. Each deployed application is ex...26.7Aster Inference APIOpenAI-compatible inference API from Aster serving open-weight models (gpt-oss-120b, gpt-oss-120b-fast, GLM...26.5KAITO RAGEngine APIRAGEngine exposes endpoints for managing retrieval-augmented generation services with embedded vector datab...26.2
Emerging 5 Early or largely undocumented
Minimal 1 Almost no public developer surface

Companies reaching this through an API (40)

These companies publish an API, specification or operation carrying “Inference” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

0G Labs Aarav Unmanned Systems (Aereo) AI Gateway AIMLAPI Akash Network Akkio Aleph Alpha2 Amazon Bedrock Amazon Nova Autoderm – AI Dermatology API Azure Databricks Azure OpenAI Service Compresr EigenLayer Elastic Stack (ELK Stack) Gcore H Company Hugging Face Transformers Huma Infer by Flow7 Inworld AI King's College London Lightning AI Modelbit OctoAI Ollama Openwork Paperspace Pinecone Ray SAP Business Technology Platform Snowflake Sonde Health Swisscom Taalas TensorFlow Thinking Machines TU Dresden Viam Weights and Biases

Score breakdown

Frequency
65.5
log-scaled weighted occurrences
Breadth
3.4
spread across providers
Quality lift
40.3
mean composite of providers using it
Cohesion
24.3
strength of nearest seed neighbor

Related tags

OpenAI-Compatible 43 co-occurrences GPU 47 co-occurrences LLM 81 co-occurrences Models 54 co-occurrences Fine-Tuning 23 co-occurrences Completions 23 co-occurrences Embeddings 28 co-occurrences Chat 41 co-occurrences

Where this tag comes from

Provider tag123
Api tag93
Openapi tag27
Openapi op tag88

Cohort brief

Auto-generated

The 120 providers in the APIs.io catalog tagged Inference, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
120
all scored
Mean Kin Score
36.2
+12.3 vs catalog 23.9
Mean Agent Readiness
20.7
+8.7 vs catalog 12
Spread
5–68.3
median 37.6 · σ 14.7
How the 120 split by band
Exemplar 3Strong 8Developing 43Thin 43Emerging 14Minimal 9
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Developer Ergonomics 43.8 23.4 +20.4 120
Contract Quality 39 19.8 +19.2 120
Operational Transparency 24.4 14 +10.4 120
Discoverability 69.6 61.2 +8.4 120
Access Clarity 34.3 26.5 +7.8 120
Contract Governance 7.8 6.4 +1.4 120

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 17% 10% +7
MCP server (first-party) 21% 13% +8
Agent Skills 0% 0% 0
OAuth scopes 3% 11% -8
Security 98% 97% +1
Arazzo workflows 5% 2% +3
Governance rules 24% 14% +10

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 NVIDIA NIM 68.3
  2. 2 fal 67.6
  3. 3 Segmind 67.2
  4. 4 Modal 64.4
  5. 5 NexGen Cloud 64.3
  6. 6 Amazon SageMaker 63.2
  7. 7 Seekr 61.3
  8. 8 Cerebras Systems 60.4
  9. 9 Hyperbolic 59.4
  10. 10 Prime Intellect 56.5
Top by Agent Readiness
  1. 1 Roboflow 54
  2. 2 Fastino Labs 52
  3. 3 NexGen Cloud 47.2
  4. 4 Sail 43.2
  5. 5 Sail Research 41.4
  6. 6 Dedalus Labs 40.7
  7. 7 OpenRelay 40.6
  8. 8 Superb AI 39.7
  9. 9 FriendliAI 37.9
  10. 10 RouterPlex 37.2
All 123 members of this roster resolve to a scored provider in the catalog.Generated from the catalog build of 15 September 2026, across 27661 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag
curl "https://apis.io/api/v1/tags/inference"
All tags
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort
curl "https://apis.io/api/v1/cohorts/tag/inference"
The distribution (Pro)
curl "https://apis.io/api/v1/cohorts/tag/inference/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.