established · -1.6 capabilitymarket actiondomain

Inference

Score 27.9 / 100 160 providers +37 via APIs 102 APIs Search apis.io →
Workflows using this tag
TensorFlow Serving Preflight and Predict · TensorFlow TensorFlow Serving Preflight and Regress · TensorFlow TensorFlow Serving Preflight and Classify · TensorFlow TensorFlow Serving Compare a Candidate Version Against the Default · TensorFlow TensorFlow Serving Pinned Reproducible Example Scoring · TensorFlow TensorFlow Serving Route Inference by Version Label · TensorFlow TensorFlow Serving Gate a Rollout on Version Readiness · TensorFlow Viam Machine Health Check · Viam
Business capabilities this tag reaches
Information & Data Management 20
Variants seen in the corpus: AI InferenceLLM InferenceInference APIInference

Providers using this tag (160)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 5 Complete, well-documented, and agent-ready
SegmindArtificial IntelligenceMachine LearningGenerative AI1 API66.9TelnyxCommunicationsCPaaSVoiceSMS2 APIs86.2Hive CivilizationAgentsAgentic CommerceA2AMCP3 APIs74.7Hugging FaceComputer VisionEmbeddingsImage GenerationLLM6 APIs66.7NexGen CloudCompanyCloudGPUArtificial Intelligence3 APIs66.5
Strong 19 Solid coverage with minor gaps
NVIDIA NIMArtificial IntelligenceMicroservicesLLM3 APIs60.6RightNow AICompanyArtificial IntelligenceMachine Learning1 API59.5Cerebras SystemsCompanyAI InfrastructureArtificial IntelligenceMachine Learning2 APIs59.2SimplismartCompanyArtificial IntelligenceMachine Learning18 APIs57.0OpenRelayCompanyGPUArtificial Intelligence1 API55.2Atlas CloudCompanyArtificial IntelligenceLLMModel Routing10 APIs54.5InferenceCompanyArtificial IntelligenceMachine LearningLLM1 API54.4Amazon SageMakerArtificial IntelligenceMachine LearningMLOps1 API65.9falArtificial IntelligenceGenerative AIGenerative MediaImage Generation3 APIs65.6SeekrArtificial IntelligenceGenerative AIAgentsLLM4 APIs63.4RoboflowComputer VisionMachine LearningArtificial IntelligenceObject Detection1 API62.2Dedalus LabsCompanyArtificial IntelligenceAgentsMCP2 APIs59.0brick.blueAI AgentsAgent MarketplaceAgent DiscoveryTask Exchange1 API58.8SambaNova SystemsCompanyArtificial IntelligenceMachine LearningLLM2 APIs58.7Atomadic TechCompanyAI AgentsAgent InfrastructureMCP1 API57.4CrusoeAI InfrastructureCloud ComputingGPU ComputeMachine Learning2 APIs57.4CONNSKILLCompanyAPI ProviderSEOSERP2 APIs56.6ReplicateArtificial IntelligenceMachine LearningImage GenerationLanguage Models1 API55.9Phala NetworkCompanyConfidential ComputingTrusted Execution Environments1 API55.3
Developing 40 Usable, with meaningful gaps to close
Sail ResearchCompanyArtificial IntelligenceLLM1 API53.9HyperbolicArtificial IntelligenceComputeDecentralizedDePIN5 APIs53.7FriendliAICompanyInfrastructureArtificial IntelligenceMachine Learning1 API53.4GMI CloudCompanyArtificial IntelligenceGPU Cloud3 APIs53.1TARXANCompanyAI AgentsAgent RuntimeLocal-First AI3 APIs50.4RuncrateArtificial IntelligenceGPUCompute1 API49.9RunwareCompanyArtificial IntelligenceMachine Learning1 API49.5RunPodArtificial IntelligenceCloudComputeGPU1 API49.2Multiverse ComputingArtificial IntelligenceMachine LearningModel Compression2 APIs48.0Standard ComputeLLM APIFlat RateSubscriptionAI Agents1 API47.0Novita AIArtificial IntelligenceLLMGPU1 API44.6ParasailArtificial IntelligenceGPULLM3 APIs43.9FuriosaAIArtificial IntelligenceMachine LearningSemiconductors2 APIs43.4LibertAICompanyArtificial IntelligenceModel Routing2 APIs42.9ModularCompanyArtificial IntelligenceMachine Learning1 API42.9Qubrid AIArtificial IntelligenceCloud ComputingGPU4 APIs41.1Prime IntellectArtificial IntelligenceReinforcement LearningGPU ComputeDecentralized Compute3 APIs53.9TypeSafe AIArtificial IntelligenceMachine LearningClassificationContent Moderation2 APIs51.6Pruna AICompanyArtificial IntelligenceMachine LearningImage Generation1 API51.4LambdaArtificial IntelligenceCloudClusterCompute1 API50.10G LabsArtificial IntelligenceLLMGPU Compute1 API48.8Moore ThreadsCompanyGPUArtificial IntelligenceMachine Learning4 APIs48.1TensorWaveCompanyArtificial IntelligenceMachine LearningCloud Computing1 API48.1Fastino LabsCompanyArtificial IntelligenceMachine LearningSmall Language Models1 API47.6LLM GatewayArtificial IntelligenceLLM GatewayDecision SupportStructured Outputs1 API47.6ModelRushArtificial IntelligenceLLMMulti-Modal1 API46.8Akash NetworkCloud ComputingDecentralizedBlockchainKubernetes3 APIs46.0Arcee AICompanyArtificial IntelligenceMachine LearningLLM1 API46.0Aleph AlphaCompanyArtificial IntelligenceMachine LearningLLM6 APIs45.3Superb AIArtificial IntelligenceMachine LearningComputer VisionData Labeling1 API45.3BerrerAgentsAgentic CommerceA2AMCP1 API44.0RouterPlexLLMArtificial IntelligenceAI Gateway1 API43.5QuantCDNCDNEdgeStatic HostingJAMstack1 API43.3OxenCompanyData Version ControlMachine LearningArtificial Intelligence2 APIs43.1PaleBlueDot.AIArtificial IntelligenceMachine LearningLLM2 APIs42.4Sahara AICompanyCryptocurrencyArtificial IntelligenceMachine Learning1 API42.4Adaptive MLCompanyArtificial IntelligenceLLMFine-Tuning1 API39.7AI21 LabsArtificial IntelligenceFoundation ModelsLLMJamba1 API39.7Preferred NetworksCompanyArtificial IntelligenceMachine LearningLLM1 API39.7GoodfireCompanyArtificial IntelligenceMachine LearningInterpretability1 API39.3
Thin 46 Limited public surface area
Avian.ioComputeOpenAI CompatibilityGPU Compute2 APIs38.6LocalAIArtificial IntelligenceMachine LearningLLM1 API38.5Fireworks AIArtificial IntelligenceLLMMulti-Modal5 APIs37.9Secton APIArtificial IntelligenceLLMChat Completions1 API37.3UltraSafe AICompanyArtificial IntelligenceEnterprisePlatform2 APIs37.3Triton Inference ServerArtificial IntelligenceDeep LearningMachine Learning2 APIs36.7Featherless AIArtificial IntelligenceLLMServerless2 APIs36.1InferlessArtificial IntelligenceML InferenceServerless GPUModel Deployment1 API34.7WeaveAPI - OpenAI-compatible AI API GatewayArtificial IntelligenceLLMAPI Gateway2 APIs34.1Scalable Inference ServingArtificial IntelligenceCNCFDeployment1 API33.8GroqArtificial IntelligenceLLMLPU1 API32.9BentoMLMachine LearningModel ServingArtificial Intelligence1 API32.7PositronArtificial Intelligenceinference-hardwareAI Accelerators2 APIs32.2SeldonMLOpsMachine LearningModel Serving3 APIs32.0BasetenArtificial IntelligenceMachine LearningDeployment2 APIs31.301.AIArtificial IntelligenceLLMYiOpen Source1 API29.6TargonArtificial IntelligenceLLMDecentralized1 API29.3NscaleArtificial IntelligenceGPUServerless1 API28.9CentMLArtificial IntelligenceLLMServerless1 API28.7LatticaCompanyPrivacyFully Homomorphic EncryptionEncryption1 API28.7PredibaseArtificial IntelligenceLLMFine-Tuning1 API27.9SiliconFlowArtificial IntelligenceLLMOpen Source1 API27.6Cumulus LabsCompanyLLMAI Infrastructure1 API26.8HeabsyArtificial IntelligenceOpenAI-CompatibleEU-regulated26.2Moonshot AIArtificial IntelligenceLLMLong Context1 API38.0Zhipu AIArtificial IntelligenceLLMGLM1 API37.2CerebriumArtificial IntelligenceGPUServerless1 API36.1io.netArtificial IntelligenceGPUDecentralized ComputeDePIN8 APIs35.9MiniMaxArtificial IntelligenceLLMMulti-Modal1 API35.0OvershootCompanyArtificial IntelligenceComputer VisionVideo2 APIs34.7Together AIArtificial IntelligenceLLMFoundation Models3 APIs34.6AsterlabCompanyArtificial IntelligenceMachine LearningLLM1 API33.0HailoArtificial IntelligenceMachine LearningSemiconductorsEdge Computing2 APIs32.9TaalasCompanyArtificial IntelligenceSemiconductors2 APIs32.5MangoBoostCompanyArtificial IntelligenceMachine LearningInfrastructure3 APIs30.8BeamServerlessGPUPython1 API30.6SUTRA (Two AI)Artificial IntelligenceLLMMultilingual1 API29.8ByteDance DoubaoArtificial IntelligenceLLMByteDance1 API28.8dottxtCompanyArtificial IntelligenceLLMStructured Outputs1 API28.7QwenArtificial IntelligenceLLMOpen Source1 API28.7WomboCompanyArtificial IntelligenceMachine Learning1 API28.7LM StudioCompanyArtificial IntelligenceLocal LLMMachine Learning1 API28.5glhfArtificial IntelligenceLLMOpen Source Models1 API27.9TensorZeroCompanyArtificial IntelligenceLLMLLMOps27.5Nous ResearchCompanyArtificial IntelligenceMachine LearningLLM2 APIs27.0FluidstackArtificial IntelligenceGPUCloudCompute1 API26.7
Emerging 24 Early or largely undocumented
IronlaneCompanyArtificial IntelligenceRouting1 API25.7OpenPipeArtificial IntelligenceLLMFine-TuningDistillation1 API25.5KServeKubernetesMachine LearningMLOps1 API25.2vLLMLLMOpen SourceGPU1 API24.7AnyscaleArtificial IntelligenceDistributed ComputingRayML Platform10 APIs21.7HyperbolicArtificial IntelligenceLLMGPU1 API21.5KAITOArtificial IntelligenceGPUKubernetes1 API21.0MiraiCompanyArtificial IntelligenceOn-Device AI1 API19.9Gimlet LabsCompanyArtificial IntelligenceAI InfrastructureMachine Learning16.6ConiferCompanyArtificial IntelligenceLocal AI16.3LuminalCompanyArtificial IntelligenceMachine Learning14.6d-MatrixCompanyComputeArtificial Intelligence14.5RebellionsCompanyTools InfrastructureArtificial Intelligence13.6NeurophosCompanyPhotonicsOptical Computing1 API11.4StriveworksCompanyArtificial IntelligenceMachine LearningMLOps1 API25.6OumiCompanyEconomic HealthArtificial IntelligenceMachine Learning25.2Aleph Alpha2CompanyArtificial IntelligenceLLMMachine Learning1 API25.1NebiusArtificial IntelligenceCloudComputeGPU6 APIs24.7GradientCompanyWeb3Artificial IntelligenceMachine Learning1 API24.1RunAnywhereCompanyOn-Device AIMachine Learning1 API21.4Community LabsCompanyArtificial IntelligenceMachine Learning1 API19.7Ginkgo BioworksCompanySynthetic BiologyBiotechnologyArtificial Intelligence1 API18.3Liquid AIArtificial IntelligenceLLMFoundation Models1 API15.3Ampere ComputingCompanySemiconductorsProcessorsCloud Infrastructure14.6
Minimal 25 Almost no public developer surface
Ai FabrikCompanyArtificial IntelligenceInfrastructure10.8BlaizeCompanyArtificial IntelligenceEdge ComputingMachine Learning10.6VSORACompanyArtificial IntelligenceSemiconductors9.9Applied ComputeCompanyArtificial IntelligenceMachine LearningLLM9.8TensordyneCompanyArtificial IntelligenceSemiconductors9.7FractileCompanyArtificial IntelligenceSemiconductors9.6Machine LearningMachine LearningMLOpsModel Serving9.1Theta EdgeCloudDistributed ComputingGPU ComputeAI Compute6.7EtchedAI HardwareASICTransformer5.6Axera TechCompanySemiconductorsArtificial IntelligenceEdge Computing4.8Sagence AICompanyArtificial IntelligenceSemiconductors4.8MatXCompanySemiconductorsArtificial IntelligenceHardware4.2MipsologyCompanyArtificial IntelligenceMachine LearningDeep Learning3.7ArilincCompanySemiconductorsAI ProcessorsRISC-V3.4InferactCompanyArtificial IntelligenceMachine Learning3.4MythicCompanyArtificial IntelligenceAI HardwareSemiconductors3.4OctoAIAcquiredDefunctGenerative AI5 APIs0.0Lepton AIArtificial IntelligenceMachine LearningCloud1 API10.8RadixArkCompanyArtificial IntelligenceAI InfrastructureMachine Learning10.4PlumeraiCompanyArtificial IntelligenceEdge AIComputer Vision9.2SteadyGatewayEnterprise AI gatewayModel RoutingOpenAI-compatible API1 API7.3Deci AICompanyArtificial IntelligenceMachine LearningDeep Learning4.3General InstinctCompanyArtificial IntelligenceMachine LearningEdge AI3.9Piris LabsCompanyArtificial IntelligenceNetworking3.4Talking ComputersCompanyArtificial IntelligenceAI InfrastructureMachine Learning2.6
Unrated 1 Not yet scored
NeuralMagicCompanyArtificial IntelligenceMachine Learning

APIs with this tag (101)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 7 Complete, well-documented, and agent-ready
Cortex Chat Completions APIThe Snowflake Cortex Chat Completions API is a REST API that performs LLM text completion inference using t...81.2Cortex Messages APIThe Snowflake Cortex Messages API is a REST API that performs LLM text completion inference using the Corte...81.2Cloudflare AI Inference APIExecute AI models for text generation, embeddings, image classification, and other machine learning tasks.80.6Elastic Inference APIInference APIs enable you to use certain services, such as built-in machine learning models (ELSER, E5), mo...77.6Elastic Stack (ELK Stack) Inference APIThe inference API from Elastic Stack (ELK Stack) — 40 operation(s) for inference.76.9Segmind Inference APISynchronous (v1) and asynchronous (v2) model inference. v2 is the current contract — submit a job, poll a l...66.9NexGen Cloud Inference APIOpenAI-compatible chat completions endpoint for running inference against deployed models. Use this endpoin...66.5
Strong 22 Solid coverage with minor gaps
Amazon SageMaker Runtime APIThe Amazon SageMaker AI runtime API for invoking deployed model endpoints to get real-time inference predic...65.9Infer by Flow7 Inference APIAuthenticated customer inference operations.65.9fal Realtime APIWebSocket-based realtime inference for ultra-low latency interactive generative experiences such as LCM/SDX...65.6fal Streaming APIHTTP streaming endpoint (`/{model-id}/stream`) that emits progressive partial outputs as a model runs — use...65.6Paperspace Deployments APIContainer-as-a-service deployments that run user-provided images on Paperspace GPU machines with a managed ...64.2Openwork Inference APIThe Inference API from Openwork — 1 operation(s) for inference.64.1Seekr Inference APIThe Inference API from Seekr — 12 operation(s) for inference.63.4Autoderm – AI Dermatology API Inference APIThe inference API from Autoderm – AI Dermatology API — 5 operation(s) for inference.60.5Amazon Nova Inference APISynchronous and streaming inference against the Amazon Nova understanding and generation models through the...60.2invinoveritas Inference APIReasoning and decision endpoints60.0Compresr Inference APIThe Inference API from Compresr — 1 operation(s) for inference.59.7Pinecone Inference APIModel inference59.2Viam Inference APICloud-hosted inference against registry-deployed models.59.2Swiss AI Platform Inference Endpoints APIOpenAI-compatible inference endpoints for chat, multimodal, audio, embedding, reasoning and guardrail model...59.0Model Serving Endpoints APICreate and manage model serving endpoints for deploying machine learning models as REST API endpoints.57.9Hugging Face Inference APIServerless inference API for running predictions against thousands of models hosted on the Hugging Face Hub...57.8H Company Holo Models APIOpenAI-compatible inference API serving the Holo3 and Holo3.1 vision-language models for computer use — cha...57.7Atomadic Tech Inference APILLM inference with built-in hallucination guard57.4Crusoe Managed Inference APIOpenAI-compatible inference API from the Crusoe Intelligence Foundry. Send chat/completions and embeddings ...57.4Phala Private AI APIOpenAI-compatible confidential inference API (chat completions, responses, Anthropic-format messages, compl...55.3OpenRelay Inference APIOpenAI-compatible chat completions API (POST /v1/chat/completions) and, for supporting models, an Anthropic...55.2Inference.net APIOpenAI-compatible inference API for open-source, frontier, and custom language models — chat completions, b...54.4
Developing 24 Usable, with meaningful gaps to close
Prime Intellect Inference APIOpenAI-compatible inference API for hosted frontier and open models served at api.pinference.ai. Supports s...53.9TARX Supercomputer APIOpenAI-compatible hosted inference API. GET /v1/models lists the single model t-supercomputer (owned_by tar...50.4Lambda Inference APILambda Inference API is an OpenAI-compatible REST gateway at https://api.lambda.ai/v1 that serves hosted op...50.1Runware Inference APISingle task-based endpoint for image, video, audio, 3D, and text inference across 400K+ models, reachable o...49.5Akkio Inference APIThe Inference API from Akkio — 1 operation(s) for inference.49.2RunPod ServerlessRunPod Serverless provides pay-as-you-go inference endpoints with autoscaling workers, queue-based and load...49.20G Labs Inference APIThe Inference API from 0G Labs — 11 operation(s) for inference.48.8Amazon Bedrock Inference APIOperations for invoking models and running inference.48.8TrueFoundry Model Serving APITrueFoundry's Model Serving capability enables deployment and management of LLM and embedding models using ...48.5KUAE Cloud Coding Plan APIAn LLM inference endpoint operated on Moore Threads MTT S5000 GPUs and sold as a subscription for AI coding...48.1Fastino Labs Inference APIPioneer-native inference endpoint (encoder NER/classification/extraction and decoder text generation).47.6Sonde Platform Service APIThe Sonde Platform Service API lets partners run Sonde Vocal Biomarker Health Checks from their own mobile,...46.8Huma Inference APIThe Inference API from Huma — 2 operation(s) for inference.46.5AkashML Inference APIOpenAI-compatible AI inference API providing access to open-source LLMs hosted on decentralized compute acr...46.0Furiosa-LLM OpenAI-Compatible ServerThe HTTP server started by `furiosa-llm serve `. It hosts a single model on RNGD NPUs and exposes an Open43.4QuantCDN AI Inference APIChat inference, embeddings, and image generation services43.3ReqArchitect Inference APIThe inference API from ReqArchitect — 9 operation(s) for inference.43.2Azure OpenAI Inference REST APIData-plane REST API for running inference against deployed Azure OpenAI models, including chat completions,...43.0MAX Inference REST APIOpenAI-compatible inference API served by MAX. Exposes /v1/chat/completions, /v1/completions, /v1/embedding...42.9PBD TokenRouter Inference APIOpenAI-, Anthropic- and Gemini-compatible inference gateway. One API key and one base URL route requests ac...42.4Sahara AI Inference APIOpenAI-compatible chat completion inference.42.4Tinker APIManaged training/fine-tuning and sampling API for open-weight language models, consumed through the officia...42.3AI21 Batch APIAsynchronous batch processing for large volumes of Jamba completions. Submit a batch job, poll for status, ...39.7Ember APIHosted mechanistic-interpretability API. OpenAI-compatible chat-completions sampling plus feature discovery...39.3
Thin 33 Limited public surface area
CoreWeave Inference APIThe CoreWeave Inference API manages Deployments, Gateways, and Capacity Claims for serverless and dedicated...39.2LocalAI Inference APIThe inference API from LocalAI — 7 operation(s) for inference.38.5AnyscaleAnyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting LLM inference ...37.4NVIDIA NIMNVIDIA NIM is a set of inference microservices for streamlined AI model deployment, prebuilt and optimized ...37.4Together AITogether AI is a full-stack AI Native Cloud for inference, fine-tuning, and GPU clusters powered by researc...37.4Triton GRPC APIHigh-performance gRPC API for model inference with support for streaming and binary tensor data.36.7Triton Inference Server Inference APIModel inference requests36.7W&B Serverless Inference (CoreWeave)OpenAI-compatible inference API for hosted open-source foundation models, running on CoreWeave GPU infrastr...36.4Cerebrium Inference APIThe Inference API from Cerebrium — 1 operation(s) for inference.36.1IO Intelligence APIOpenAI-compatible inference API for open-source AI models hosted on io.net's decentralized GPU network. Exp...35.9Ollama Cloud APIOllama Cloud provides cloud-hosted inference for large language models, giving access to larger models and ...35.3TensorFlow Inference APIModel inference operations including classify, regress, and predict35.1Inferless Inference APIThe Inference API from Inferless — 1 operation(s) for inference.34.7WeaveAPI Anthropic-compatible Messages APIAnthropic/Claude-wire-compatible messages route served from the bare api.weaveapi.dev host. The Claude Code...34.1WeaveAPI OpenAI-compatible APIOpenAI-wire-compatible REST API for chat completions, responses-style requests and the model catalog, authe...34.1BentoML REST APIBentoML is an open-source unified inference platform for deploying and scaling AI models. It auto-generates...33.8NVIDIA Triton Inference Server HTTP APINVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open...33.8Ray Serve REST APIRay Serve is a scalable model serving library built on Ray, designed for building online inference APIs. Su...33.8Scalable Inference Serving Inference APIModel inference request endpoints33.8vLLM OpenAI-Compatible APIvLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for e...33.8Aster Inference APIOpenAI-compatible inference API from Aster serving open-weight models (gpt-oss-120b, gpt-oss-120b-fast, GLM...33.0HailoRTHailoRT is Hailo's production runtime library for the Hailo-8, Hailo-10 and Hailo-15 device families. It is...32.9BentoML Service REST APIAuto-generated REST API endpoints produced when BentoML services are deployed. Each decorated service metho...32.7Taalas APITaalas-native REST interface for running inference against the HC1 hardcore-model silicon. Three operations...32.5Seldon Inference APIThe Seldon Inference API provides REST and gRPC endpoints for serving machine learning model predictions at...32.0Mango LLMBoost Inference Server APILLMBoost is MangoBoost's enterprise LLM inference server. It serves the OpenAI REST API on /v1 so an existi...30.8Ray Serve HTTP APIHTTP interface for invoking models and applications deployed via Ray Serve. Each deployed application is ex...29.8Inworld LLM Router APIRouting layer over 220+ LLM models, billed at provider cost via Inworld's unified API.29.7Lattica Platform APIThe LatticaAI platform API for deploying and operating encrypted workloads. An RPC-style HTTPS surface root...28.7Predibase Inference APIThe Inference API from Predibase — 4 operation(s) for inference.27.9Modelbit Deployment REST APIEvery Modelbit deployment is exposed as a versioned REST inference endpoint. POST an inference request (sin...27.8TUD:AI LLM APIAn OpenAI-compatible LLM inference API operated by ZIH and ScaDS.AI Dresden/Leipzig for TU Dresden staff, s...27.0Cumulus Inference GatewayOpenAI-compatible HTTP inference gateway. One client works against every upstream provider; per-workflow ro...26.8
Emerging 13 Early or largely undocumented
Lightning AI Model APIsHosted inference API that serves frontier and open models behind a Lightning API key, billed per token with...26.1King's e-Research AI Hub APIAn OpenAI-compatible LLM inference API operated by King's e-Research for researchers, students and staff. P...26.0Chariot Platform APIPer-tenant REST API for the Chariot AI operations platform, organized as versioned microservice paths under...25.6KServe Inference APIKServe's standardized model inference protocol for serving predictions across multiple ML frameworks on Kub...25.2PhariaInference APIThe PhariaInference HTTP API provides access to Aleph Alpha's specialized language models for text completi...25.1Nebius Token FactoryNebius Token Factory is the AI model inference platform offering OpenAI-compatible endpoints for serving op...24.7EigenAIEigenAI exposes deterministic, verifiable LLM inference over an OpenAI-compatible API surface, with executi...24.4SAP AI Core APIREST API for SAP AI Core, enabling training, deployment, and inference of AI and machine learning models wi...23.5Anyscale Services APIDeploys and manages production Ray Serve applications as long-running, autoscaling, multi-version services ...21.7KAITO RAGEngine APIRAGEngine exposes endpoints for managing retrieval-augmented generation services with embedded vector datab...21.0Mirai uzu Inference SDKuzu is Mirai's first-party, high-performance on-device inference engine. A single high-level API — shared a...19.9Hypura Ollama-Compatible Inference APIHypura is a storage-tier-aware LLM inference scheduler for Apple Silicon that places model tensors across G...19.7Ginkgo AI Model APIAsync, job-polling REST API for running inference on public and Ginkgo-proprietary biological foundation mo...18.3
Minimal 2 Almost no public developer surface
SteadyGateway GatewayOpenAI-compatible HTTP API for enterprise LLM inference across GLM, Qwen, MiniMax, DeepSeek and Kimi. Contr...7.3OctoStackOctoStack was OctoAI's self-contained generative-AI production stack for deploying open and customer-traine...0.0

Companies reaching this through an API (37)

These companies publish an API, specification or operation carrying “Inference” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

AI Gateway Akkio Amazon Bedrock Amazon Nova Autoderm – AI Dermatology API Azure Databricks Azure OpenAI Service Cloudflare Compresr EigenLayer Elastic Elastic Stack H Company Hugging Face Transformers Huma Infer by Flow7 invinoveritas Inworld AI King's College London Lightning AI Modelbit Ollama Openwork Paperspace Pinecone Ray ReqArchitect SAP Business Technology Platform Snowflake Sonde Health Swisscom TensorFlow Thinking Machines TrueFoundry TU Dresden Viam Weights and Biases

Score breakdown

Frequency
66.5
log-scaled weighted occurrences
Breadth
3.6
spread across providers
Quality lift
36.0
mean composite of providers using it
Cohesion
21.1
strength of nearest seed neighbor

Where this tag sits

160 providers carry this tag directly, and 167 counting the 1 narrower tag below — 7 more to reach.

Artificial Intelligence broader Model Serving 16 providers

Related tags

OpenAI-Compatible 47 co-occurrences LLM 97 co-occurrences Chat Completions 50 co-occurrences GPU 47 co-occurrences Models 60 co-occurrences Embeddings 31 co-occurrences Completions 24 co-occurrences Fine-Tuning 22 co-occurrences

Where this tag comes from

Provider tag166
Api tag102
Openapi tag27
Openapi op tag87

Markets provisional

Kin Score markets whose measured providers carry this tag. Share is the fraction of the market's measured providers that carry it — it describes the market, not this tag.

MarketShare of the market's providers
AI Model Routing35%
Typed Decision Models27%
MLOps and AI/ML Infrastructure (LF AI & Data, MLPerf, Kubeflow)21%
Hugging Face Hub Organisations20%
Speech and Voice AI20%

Cohort brief

Auto-generated

The 156 providers in the APIs.io catalog tagged Inference, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
156
of 160 in the catalog
Mean Kin Score
34.8
+12.6 vs catalog 22.2
Mean Agent Readiness
21.1
+9.1 vs catalog 12
Spread
0–86.1
median 34.7 · σ 17.8
How the 156 split by band
Exemplar 5Strong 19Developing 40Thin 46Emerging 23Minimal 23
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Developer Ergonomics 43.3 23.2 +20.1 156
Contract Quality 31.8 17.2 +14.6 156
Access Clarity 37.1 23.9 +13.2 156
Discoverability 66.7 57.9 +8.8 156
Operational Transparency 21.6 13 +8.6 156
Contract Governance 8.8 6.5 +2.3 156

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 26% 13% +13
MCP server (first-party) 27% 12% +15
Agent Skills 0% 0% 0
OAuth scopes 4% 11% -7
Security 96% 98% -2
Arazzo workflows 5% 2% +3
Governance rules 25% 16% +9

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 Telnyx 86.1
  2. 2 Hive Civilization 74.7
  3. 3 Segmind 66.9
  4. 4 Hugging Face 66.7
  5. 5 NexGen Cloud 66.5
  6. 6 Amazon SageMaker 65.9
  7. 7 fal 65.6
  8. 8 Seekr 63.4
  9. 9 Roboflow 62.2
  10. 10 NVIDIA NIM 60.6
Top by Agent Readiness
  1. 1 Telnyx 78.1
  2. 2 brick.blue 60.1
  3. 3 GMI Cloud 56.3
  4. 4 Fastino Labs 54.6
  5. 5 Roboflow 52.8
  6. 6 Replicate 49.8
  7. 7 LLM Gateway 48.6
  8. 8 fal 48.1
  9. 9 Inference 47.1
  10. 10 Hive Civilization 45.5
All 160 members of this roster resolve to a provider in the catalog; 156 carry a score (98%). The figures above describe the scored members only.
Coverage caveat. 125 of 156 scored members had under half their catalog-attributable points satisfied at all (catalog_earned / catalog_max < 0.5). They are INCLUDED in the mean above. A large share here means the cohort mean is partly a measurement of how far our enrichment reached, not only of how these providers publish.Generated from the catalog build of 24 October 2026, across 31984 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/inference"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort 
curl "https://apis.io/api/v1/cohorts/tag/inference"
The distribution (Pro) 
curl "https://apis.io/api/v1/cohorts/tag/inference/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.