established · -1.4 capabilitymarket actiondomain

Inference

Score 26.6 / 100 182 providers +49 via APIs 118 APIs Search apis.io →
Workflows using this tag
TensorFlow Serving Preflight and Predict · TensorFlow TensorFlow Serving Preflight and Regress · TensorFlow TensorFlow Serving Preflight and Classify · TensorFlow TensorFlow Serving Compare a Candidate Version Against the Default · TensorFlow TensorFlow Serving Pinned Reproducible Example Scoring · TensorFlow TensorFlow Serving Route Inference by Version Label · TensorFlow TensorFlow Serving Gate a Rollout on Version Readiness · TensorFlow Viam Machine Health Check · Viam
Business capabilities this tag reaches
Information & Data Management 20 AI Model Services 5
Variants seen in the corpus: AI InferenceLLM InferenceInference APIInference

Providers using this tag (182)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 7 Complete, well-documented, and agent-ready
EmpirioLabs AICompanyArtificial IntelligenceCloud1 API69.0SegmindArtificial IntelligenceMachine LearningGenerative AI1 API68.8TelnyxCommunicationsCPaaSVoiceSMS3 APIs93.5Hive CivilizationAgentsAgentic CommerceA2AMCP3 APIs78.0Amazon SageMakerArtificial IntelligenceAmazon Web ServicesMachine Learning82 APIs76.6NexGen CloudCompanyCloudGPUArtificial Intelligence3 APIs69.8Hugging FaceComputer VisionEmbeddingsImage GenerationLLM6 APIs69.1
Strong 26 Solid coverage with minor gaps
RightNow AICompanyArtificial IntelligenceMachine Learning1 API62.5Cerebras SystemsCompanyAI InfrastructureArtificial IntelligenceMachine Learning2 APIs62.1OpenRelayCompanyGPUArtificial Intelligence1 API60.4NVIDIA NIMArtificial IntelligenceMicroservicesLLM3 APIs59.7SimplismartCompanyArtificial IntelligenceMachine Learning18 APIs59.4Sail ResearchCompanyArtificial IntelligenceLLM1 API58.6FriendliAICompanyInfrastructureArtificial IntelligenceMachine Learning1 API58.1GMI CloudCompanyArtificial IntelligenceGPU Cloud3 APIs57.8inference-shArtificial IntelligenceMachine LearningPlatform1 API55.7InferenceCompanyArtificial IntelligenceMachine LearningLLM1 API55.3RunPodArtificial IntelligenceCloudComputeGPU1 API54.3RoboflowComputer VisionMachine LearningArtificial IntelligenceObject Detection1 API65.5falArtificial IntelligenceGenerative AIGenerative MediaImage Generation3 APIs65.2SeekrArtificial IntelligenceGenerative AIAgentsLLM4 APIs65.1Phala NetworkCompanyConfidential ComputingTrusted Execution Environments1 API64.9Kimi (Moonshot AI)Artificial IntelligenceLLMLong Context2 APIs64.8CrusoeAI InfrastructureCloud ComputingGPU ComputeMachine Learning2 APIs62.5brick.blueAI AgentsAgent MarketplaceAgent DiscoveryTask Exchange2 APIs62.2Atomadic TechCompanyAI AgentsAgent InfrastructureMCP1 API62.0SambaNova SystemsCompanyArtificial IntelligenceMachine LearningLLM2 APIs62.0Dedalus LabsCompanyArtificial IntelligenceAgentsMCP2 APIs61.9TypeSafe AIArtificial IntelligenceMachine LearningClassificationContent Moderation2 APIs59.7CONNSKILLCompanySEOSERPKeyword Research2 APIs58.9ReplicateArtificial IntelligenceMachine LearningImage GenerationLanguage Models1 API58.3ModelRushArtificial IntelligenceLLMMulti-Modal1 API55.5Pruna AICompanyArtificial IntelligenceMachine LearningImage Generation1 API55.5
Developing 42 Usable, with meaningful gaps to close
ai&Artificial IntelligenceJapanMachine Learning1 API53.7Atlas CloudCompanyArtificial IntelligenceLLMModel Routing10 APIs53.6RuncrateArtificial IntelligenceGPUCompute1 API52.7FlexAICompanyArtificial IntelligenceMachine Learning1 API52.5Novita AIArtificial IntelligenceLLMGPU1 API52.3Multiverse ComputingArtificial IntelligenceMachine LearningModel Compression2 APIs51.3RunwareCompanyArtificial IntelligenceMachine Learning1 API51.0Standard ComputeLLM APIFlat RateSubscriptionAI Agents1 API50.6TARXANCompanyAI AgentsAgent RuntimeLocal-First AI3 APIs49.2cheapestinference-comArtificial IntelligenceLLMFlat Rate4 APIs47.5HyperbolicArtificial IntelligenceComputeDecentralizedDePIN5 APIs46.8ParasailArtificial IntelligenceGPULLM3 APIs44.7LibertAICompanyArtificial IntelligenceModel Routing2 APIs44.4ModularCompanyArtificial IntelligenceMachine Learning1 API44.2FuriosaAIArtificial IntelligenceMachine LearningSemiconductors2 APIs44.1LocalAIArtificial IntelligenceMachine LearningLLM1 API41.3CoreWeaveArtificial IntelligenceCloudGPUHPC1 API41.1Qubrid AIArtificial IntelligenceCloud ComputingGPU4 APIs41.0UltraSafe AICompanyArtificial IntelligenceEnterprisePlatform2 APIs39.3Superb AIArtificial IntelligenceMachine LearningComputer VisionData Labeling1 API53.8LambdaArtificial IntelligenceCloudClusterCompute1 API52.5Arcee AICompanyArtificial IntelligenceMachine LearningLLM1 API52.1TensorWaveCompanyArtificial IntelligenceMachine LearningCloud Computing1 API52.1LLM GatewayArtificial IntelligenceLLM GatewayDecision SupportStructured Outputs1 API51.6OxenCompanyData Version ControlMachine LearningArtificial Intelligence2 APIs51.5Fastino LabsCompanyArtificial IntelligenceMachine LearningSmall Language Models1 API51.40G LabsArtificial IntelligenceLLMGPU Compute1 API51.1Prime IntellectArtificial IntelligenceReinforcement LearningGPU ComputeDecentralized Compute3 APIs50.9RouterPlexLLMArtificial IntelligenceAI Gateway1 API48.5Moore ThreadsCompanyGPUArtificial IntelligenceMachine Learning4 APIs48.1Akash NetworkCloud ComputingDecentralizedBlockchainKubernetes4 APIs48.0Aleph AlphaCompanyArtificial IntelligenceMachine LearningLLM6 APIs47.8ComputeGpuCompanyGPU CloudAI InfrastructureCompute1 API46.7BerrerAgentsAgentic CommerceA2AMCP1 API45.6Sahara AICompanyCryptocurrencyArtificial IntelligenceMachine Learning1 API44.8QuantCDNCDNEdgeStatic HostingJAMstack1 API44.7ClutchCallCompanyVoice AIReal-Time CommunicationQUIC2 APIs44.1PaleBlueDot.AIArtificial IntelligenceMachine LearningLLM2 APIs43.2Preferred NetworksCompanyArtificial IntelligenceMachine LearningLLM1 API41.6GoodfireCompanyArtificial IntelligenceMachine LearningInterpretability1 API40.7Adaptive MLCompanyArtificial IntelligenceLLMFine-Tuning1 API40.5AI21 LabsArtificial IntelligenceFoundation ModelsLLMJamba1 API39.7
Thin 55 Limited public surface area
Secton APIArtificial IntelligenceLLMChat Completions1 API39.1Avian.ioComputeOpenAI CompatibilityGPU Compute2 APIs38.8Triton Inference ServerArtificial IntelligenceDeep LearningMachine Learning2 APIs37.2Fireworks AIArtificial IntelligenceLLMMulti-Modal5 APIs35.4InferlessArtificial IntelligenceML InferenceServerless GPUModel Deployment1 API34.0Featherless AIArtificial IntelligenceLLMServerless2 APIs33.8DeepInfraArtificial IntelligenceLLMServerless1 API33.5Scalable Inference ServingArtificial IntelligenceCNCFDeployment1 API33.4PositronArtificial IntelligenceInference HardwareAI Accelerators2 APIs33.2BentoMLMachine LearningModel ServingArtificial Intelligence1 API32.3GroqArtificial IntelligenceLLMLPU1 API32.3BasetenArtificial IntelligenceMachine LearningDeployment3 APIs31.9DataCrunchGPU CloudInfrastructureCompute1 API31.5AgentgatesArtificial IntelligenceComputeBlockchain1 API31.2SeldonMLOpsMachine LearningModel Serving3 APIs31.0BridgeNodeArtificial IntelligencePaymentsSolana1 API30.8WeaveAPI - OpenAI-compatible AI API GatewayArtificial IntelligenceLLMAPI Gateway2 APIs30.7LatticaCompanyPrivacyFully Homomorphic EncryptionEncryption1 API30.0InferenceIndexer.aiArtificial IntelligencePricingData1 API29.801.AIArtificial IntelligenceLLMYiOpen Source1 API29.2Flow AIArtificial IntelligenceManagedOpenAI1 API29.2KinferenceCompanyKubernetesvLLM2 APIs28.9Cumulus LabsCompanyLLMAI Infrastructure1 API28.4NscaleArtificial IntelligenceGPUServerless1 API28.4TargonArtificial IntelligenceLLMDecentralized1 API28.4RouterPlusArtificial IntelligenceLLMRouting1 API28.3CentMLArtificial IntelligenceLLMServerless1 API27.8SiliconFlowArtificial IntelligenceLLMOpen Source1 API27.5PredibaseArtificial IntelligenceLLMFine-Tuning1 API26.9IronlaneCompanyArtificial IntelligenceRouting1 API26.7KServeKubernetesMachine LearningMLOps1 API26.7Zhipu AIArtificial IntelligenceLLMGLM1 API38.1io.netArtificial IntelligenceGPUDecentralized ComputeDePIN8 APIs37.4dottxtCompanyArtificial IntelligenceLLMStructured Outputs1 API37.1OvershootCompanyArtificial IntelligenceComputer VisionVideo2 APIs36.9ChutesArtificial IntelligenceLLMServerless1 API36.3TaalasCompanyArtificial IntelligenceSemiconductors2 APIs36.2CerebriumArtificial IntelligenceGPUServerless1 API35.9Together AIArtificial IntelligenceLLMFoundation Models3 APIs34.4MiniMaxArtificial IntelligenceLLMMulti-Modal1 API33.6AsterlabCompanyArtificial IntelligenceMachine LearningLLM1 API32.3LM StudioCompanyArtificial IntelligenceLocal LLMMachine Learning1 API32.2MangoBoostCompanyArtificial IntelligenceMachine LearningInfrastructure3 APIs32.0HailoArtificial IntelligenceMachine LearningSemiconductorsEdge Computing2 APIs31.4BeamServerlessGPUPython1 API29.7ByteDance DoubaoArtificial IntelligenceLLMByteDance1 API29.6WomboCompanyArtificial IntelligenceMachine Learning1 API28.9SUTRA (Two AI)Artificial IntelligenceLLMMultilingual1 API28.8TensorZeroCompanyArtificial IntelligenceLLMLLMOps28.8Nous ResearchCompanyArtificial IntelligenceMachine LearningLLM2 APIs28.3QwenArtificial IntelligenceLLMOpen Source1 API28.1OumiCompanyEconomic HealthArtificial IntelligenceMachine Learning27.0glhfArtificial IntelligenceLLMOpen Source Models1 API26.8FluidstackArtificial IntelligenceGPUCloudCompute1 API26.7LaminiArtificial IntelligenceLLMFine-TuningMemory Tuning1 API26.7
Emerging 30 Early or largely undocumented
HeabsyArtificial IntelligenceOpenAI-CompatibleEU-regulated26.0OpenPipeArtificial IntelligenceLLMFine-TuningDistillation1 API25.9vLLMLLMOpen SourceGPU1 API25.2KAITOArtificial IntelligenceGPUKubernetes1 API22.5AnyscaleArtificial IntelligenceDistributed ComputingRayML Platform10 APIs20.0MiraiCompanyArtificial IntelligenceOn-Device AI1 API19.6Gimlet LabsCompanyArtificial IntelligenceAI InfrastructureMachine Learning19.4d-MatrixCompanyComputeArtificial Intelligence15.7ConiferCompanyArtificial IntelligenceLocal AI14.6Applied ComputeCompanyArtificial IntelligenceMachine LearningLLM14.4LuminalCompanyArtificial IntelligenceMachine Learning13.9Infini-AI (无问芯穹)CompanyArtificial IntelligenceMachine LearningLLM1 API13.4RebellionsCompanyTools InfrastructureArtificial Intelligence12.9Attic StandardArtificial IntelligenceBenchmarksPricing12.8Ai FabrikCompanyArtificial IntelligenceInfrastructure12.2VSORACompanyArtificial IntelligenceSemiconductors11.2FractileCompanyArtificial IntelligenceSemiconductors11.0TensordyneCompanyArtificial IntelligenceSemiconductors11.0KeldMarketplaceModel MarketplaceEnterprise AI25.8GradientCompanyWeb3Artificial IntelligenceMachine Learning1 API25.0StriveworksCompanyArtificial IntelligenceMachine LearningMLOps1 API24.8Aleph Alpha2CompanyArtificial IntelligenceLLMMachine Learning1 API24.4NebiusArtificial IntelligenceCloudComputeGPU6 APIs23.2RunAnywhereCompanyOn-Device AIMachine Learning1 API21.7Community LabsCompanyArtificial IntelligenceMachine Learning1 API19.0Ginkgo BioworksCompanySynthetic BiologyBiotechnologyArtificial Intelligence1 API17.6Ampere ComputingCompanySemiconductorsProcessorsCloud Infrastructure14.8Liquid AIArtificial IntelligenceLLMFoundation Models1 API14.8RadixArkCompanyArtificial IntelligenceAI InfrastructureMachine Learning12.1Flixconomy GmbHArtificial IntelligenceHuman-in-the-LoopMCP1 API11.0
Minimal 21 Almost no public developer surface
NeurophosCompanyPhotonicsOptical Computing1 API10.9DensityCompanyArtificial IntelligencePlatform10.1BlaizeCompanyArtificial IntelligenceEdge ComputingMachine Learning9.0Theta EdgeCloudDistributed ComputingGPU ComputeAI Compute5.9EtchedAI HardwareASICTransformer5.6Axera TechCompanySemiconductorsArtificial IntelligenceEdge Computing4.0Sagence AICompanyArtificial IntelligenceSemiconductors4.0MatXCompanySemiconductorsArtificial IntelligenceHardware3.7MipsologyCompanyArtificial IntelligenceMachine LearningDeep Learning3.2ArilincCompanySemiconductorsAI ProcessorsRISC-V2.6InferactCompanyArtificial IntelligenceMachine Learning2.6MythicCompanyArtificial IntelligenceAI HardwareSemiconductors2.6TorquantisCompanyAI AgentsAgent MarketplaceA2A1.4OctoAIAcquiredDefunctGenerative AI5 APIs0.0Lepton AIArtificial IntelligenceMachine LearningCloud1 API10.0PlumeraiCompanyArtificial IntelligenceEdge AIComputer Vision8.7SteadyGatewayEnterprise AI gatewayModel RoutingOpenAI-compatible API1 API6.9Deci AICompanyArtificial IntelligenceMachine LearningDeep Learning4.6General InstinctCompanyArtificial IntelligenceMachine LearningEdge AI3.0Piris LabsCompanyArtificial IntelligenceNetworking2.6Talking ComputersCompanyArtificial IntelligenceAI InfrastructureMachine Learning2.6
Unrated 1 Not yet scored
NeuralMagicCompanyArtificial IntelligenceMachine Learning

APIs with this tag (117)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 14 Complete, well-documented, and agent-ready
Cloudflare AI Inference APIExecute AI models for text generation, embeddings, image classification, and other machine learning tasks.82.5Cortex Chat Completions APIThe Snowflake Cortex Chat Completions API is a REST API that performs LLM text completion inference using t...82.3Cortex Messages APIThe Snowflake Cortex Messages API is a REST API that performs LLM text completion inference using the Corte...82.3Elastic Stack (ELK Stack) Inference APIThe inference API from Elastic Stack (ELK Stack) — 40 operation(s) for inference.80.8Elastic Inference APIInference APIs enable you to use certain services, such as built-in machine learning models (ELSER, E5), mo...78.4Amazon SageMaker Runtime APIThe Amazon SageMaker AI runtime API for invoking deployed model endpoints to get real-time inference predic...76.6Model Serving Endpoints APICreate and manage model serving endpoints for deploying machine learning models as REST API endpoints.71.6Scale AI Inference APIThe Inference API from Scale AI — 5 operation(s) for inference.71.1NexGen Cloud Inference APIOpenAI-compatible chat completions endpoint for running inference against deployed models. Use this endpoin...69.8HUD Inference APIThe inference API from HUD — 1 operation(s) for inference.69.1Segmind Inference APISynchronous (v1) and asynchronous (v2) model inference. v2 is the current contract — submit a job, poll a l...68.8Azure OpenAI Inference REST APIData-plane REST API for running inference against deployed Azure OpenAI models, including chat completions,...68.3Infer by Flow7 Inference APIAuthenticated customer inference operations.67.7Codebase Inference APIThe Inference API from Codebase — 1 operation(s) for inference.67.4
Strong 24 Solid coverage with minor gaps
Openwork Inference APIThe Inference API from Openwork — 1 operation(s) for inference.65.5Hugging Face Inference APIServerless inference API for running predictions against thousands of models hosted on the Hugging Face Hub...65.4fal Realtime APIWebSocket-based realtime inference for ultra-low latency interactive generative experiences such as LCM/SDX...65.2fal Streaming APIHTTP streaming endpoint (`/{model-id}/stream`) that emits progressive partial outputs as a model runs — use...65.2Seekr Inference APIThe Inference API from Seekr — 12 operation(s) for inference.65.1Autoderm – AI Dermatology API Inference APIThe inference API from Autoderm – AI Dermatology API — 5 operation(s) for inference.64.9Phala Private AI APIOpenAI-compatible confidential inference API (chat completions, responses, Anthropic-format messages, compl...64.9Paperspace Deployments APIContainer-as-a-service deployments that run user-provided images on Paperspace GPU machines with a managed ...64.5Amazon Bedrock Inference APIOperations for invoking models and running inference.64.3Amazon Bedrock Mantle (OpenAI-compatible) APIOpenAI-compatible inference endpoint for Amazon Bedrock (bedrock-mantle), serving most models under /v1 and...64.3Amazon Nova Inference APISynchronous and streaming inference against the Amazon Nova understanding and generation models through the...63.6invinoveritas Inference APIReasoning and decision endpoints63.2Crusoe Managed Inference APIOpenAI-compatible inference API from the Crusoe Intelligence Foundry. Send chat/completions and embeddings ...62.5Atomadic Tech Inference APILLM inference with built-in hallucination guard62.0H Company Holo Models APIOpenAI-compatible inference API serving the Holo3 and Holo3.1 vision-language models for computer use — cha...61.8Compresr Inference APIThe Inference API from Compresr — 1 operation(s) for inference.61.2OpenRelay Inference APIOpenAI-compatible chat completions API (POST /v1/chat/completions) and, for supporting models, an Anthropic...60.4Pinecone Inference APIModel inference60.1Swiss AI Platform Inference Endpoints APIOpenAI-compatible inference endpoints for chat, multimodal, audio, embedding, reasoning and guardrail model...59.7Akkio Inference APIThe Inference API from Akkio — 1 operation(s) for inference.56.8Viam Inference APICloud-hosted inference against registry-deployed models.56.6Inference.net APIOpenAI-compatible inference API for open-source, frontier, and custom language models — chat completions, b...55.3Anomaly Detection Inference APIInference APIs enable you to use certain services, such as built-in machine learning models (ELSER, E5), mo...54.6RunPod ServerlessRunPod Serverless provides pay-as-you-go inference endpoints with autoscaling workers, queue-based and load...54.3
Developing 27 Usable, with meaningful gaps to close
Lambda Inference APILambda Inference API is an OpenAI-compatible REST gateway at https://api.lambda.ai/v1 that serves hosted op...52.5Fastino Labs Inference APIPioneer-native inference endpoint (encoder NER/classification/extraction and decoder text generation).51.4Auxen Inference APIThe Inference API from Auxen — 2 operation(s) for inference.51.2TrueFoundry Model Serving APITrueFoundry's Model Serving capability enables deployment and management of LLM and embedding models using ...51.20G Labs Inference APIThe Inference API from 0G Labs — 11 operation(s) for inference.51.1Cure Cancer With AI Inference APIModel inference endpoints (require an API key).51.0Runware Inference APISingle task-based endpoint for image, video, audio, 3D, and text inference across 400K+ models, reachable o...51.0Antfly Inference APIThe Inference API from Antfly — 1 operation(s) for inference.50.9Prime Intellect Inference APIOpenAI-compatible inference API for hosted frontier and open models served at api.pinference.ai. Supports s...50.9ReqArchitect Inference APIThe inference API from ReqArchitect — 9 operation(s) for inference.50.1TARX Supercomputer APIOpenAI-compatible hosted inference API. GET /v1/models lists the single model t-supercomputer (owned_by tar...49.2Sonde Platform Service APIThe Sonde Platform Service API lets partners run Sonde Vocal Biomarker Health Checks from their own mobile,...48.7Huma Inference APIThe Inference API from Huma — 2 operation(s) for inference.48.1KUAE Cloud Coding Plan APIAn LLM inference endpoint operated on Moore Threads MTT S5000 GPUs and sold as a subscription for AI coding...48.1AkashML Inference APIOpenAI-compatible AI inference API providing access to open-source LLMs hosted on decentralized compute acr...48.0Tinker APIManaged training/fine-tuning and sampling API for open-weight language models, consumed through the officia...45.1Sahara AI Inference APIOpenAI-compatible chat completion inference.44.8QuantCDN AI Inference APIChat inference, embeddings, and image generation services44.7MAX Inference REST APIOpenAI-compatible inference API served by MAX. Exposes /v1/chat/completions, /v1/completions, /v1/embedding...44.2ClutchCall OpenAI-Compatible Inference APIOpenAI-compatible HTTP surface for deployed clutch-layers models (/chat/completions, /audio/transcriptions,...44.1Furiosa-LLM OpenAI-Compatible ServerThe HTTP server started by `furiosa-llm serve `. It hosts a single model on RNGD NPUs and exposes an Open44.1PBD TokenRouter Inference APIOpenAI-, Anthropic- and Gemini-compatible inference gateway. One API key and one base URL route requests ac...43.2Lightning AI Model APIsHosted inference API that serves frontier and open models behind a Lightning API key, billed per token with...42.0LocalAI Inference APIThe inference API from LocalAI — 7 operation(s) for inference.41.3CoreWeave Inference APIThe CoreWeave Inference API manages Deployments, Gateways, and Capacity Claims for serverless and dedicated...41.1Ember APIHosted mechanistic-interpretability API. OpenAI-compatible chat-completions sampling plus feature discovery...40.7AI21 Batch APIAsynchronous batch processing for large volumes of Jamba completions. Submit a batch job, poll for status, ...39.7
Thin 39 Limited public surface area
Ditto Audio Inference APIThe pure text+model→audio inference service — stateless, no book/persistence awareness38.3TensorFlow Inference APIModel inference operations including classify, regress, and predict38.2W&B Serverless Inference (CoreWeave)OpenAI-compatible inference API for hosted open-source foundation models, running on CoreWeave GPU infrastr...38.1AnyscaleAnyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting LLM inference ...37.8NVIDIA NIMNVIDIA NIM is a set of inference microservices for streamlined AI model deployment, prebuilt and optimized ...37.8Together AITogether AI is a full-stack AI Native Cloud for inference, fine-tuning, and GPU clusters powered by researc...37.8IO Intelligence APIOpenAI-compatible inference API for open-source AI models hosted on io.net's decentralized GPU network. Exp...37.4Triton GRPC APIHigh-performance gRPC API for model inference with support for streaming and binary tensor data.37.2Triton Inference Server Inference APIModel inference requests37.2Ollama Cloud APIOllama Cloud provides cloud-hosted inference for large language models, giving access to larger models and ...37.0Taalas APITaalas-native REST interface for running inference against the HC1 hardcore-model silicon. Three operations...36.2Cerebrium Inference APIThe Inference API from Cerebrium — 1 operation(s) for inference.35.9Inferless Inference APIThe Inference API from Inferless — 1 operation(s) for inference.34.0DeepInfra Inference APINative DeepInfra inference API for models and deployments.33.5BentoML REST APIBentoML is an open-source unified inference platform for deploying and scaling AI models. It auto-generates...33.4NVIDIA Triton Inference Server HTTP APINVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open...33.4Ray Serve REST APIRay Serve is a scalable model serving library built on Ray, designed for building online inference APIs. Su...33.4Scalable Inference Serving Inference APIModel inference request endpoints33.4vLLM OpenAI-Compatible APIvLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for e...33.4Trajectory Inference APIThe inference API from Trajectory — 9 operation(s) for inference.33.0Ray Serve HTTP APIHTTP interface for invoking models and applications deployed via Ray Serve. Each deployed application is ex...32.4Aster Inference APIOpenAI-compatible inference API from Aster serving open-weight models (gpt-oss-120b, gpt-oss-120b-fast, GLM...32.3BentoML Service REST APIAuto-generated REST API endpoints produced when BentoML services are deployed. Each decorated service metho...32.3Mango LLMBoost Inference Server APILLMBoost is MangoBoost's enterprise LLM inference server. It serves the OpenAI REST API on /v1 so an existi...32.0HailoRTHailoRT is Hailo's production runtime library for the Hailo-8, Hailo-10 and Hailo-15 device families. It is...31.4Agentgates Inference APIThe Inference API from Agentgates — 4 operation(s) for inference.31.2Seldon Inference APIThe Seldon Inference API provides REST and gRPC endpoints for serving machine learning model predictions at...31.0WeaveAPI Anthropic-compatible Messages APIAnthropic/Claude-wire-compatible messages route served from the bare api.weaveapi.dev host. The Claude Code...30.7WeaveAPI OpenAI-compatible APIOpenAI-wire-compatible REST API for chat completions, responses-style requests and the model catalog, authe...30.7Inworld LLM Router APIRouting layer over 220+ LLM models, billed at provider cost via Inworld's unified API.30.6Lattica Platform APIThe LatticaAI platform API for deploying and operating encrypted workloads. An RPC-style HTTPS surface root...30.0Foresea Inference APIRun forecast and market-edge analysis for binary, multiple-choice, numeric, and date questions.28.9TUD:AI LLM APIAn OpenAI-compatible LLM inference API operated by ZIH and ScaDS.AI Dresden/Leipzig for TU Dresden staff, s...28.6Cumulus Inference GatewayOpenAI-compatible HTTP inference gateway. One client works against every upstream provider; per-workflow ro...28.4Predibase Inference APIThe Inference API from Predibase — 4 operation(s) for inference.26.9Modelbit Deployment REST APIEvery Modelbit deployment is exposed as a versioned REST inference endpoint. POST an inference request (sin...26.8ExchangeRebel LLM Inference APIThe LLM Inference API from ExchangeRebel — 4 operation(s) for llm inference.26.7KServe Inference APIKServe's standardized model inference protocol for serving predictions across multiple ML frameworks on Kub...26.7King's e-Research AI Hub APIAn OpenAI-compatible LLM inference API operated by King's e-Research for researchers, students and staff. P...26.4
Emerging 11 Early or largely undocumented
Chariot Platform APIPer-tenant REST API for the Chariot AI operations platform, organized as versioned microservice paths under...24.8PhariaInference APIThe PhariaInference HTTP API provides access to Aleph Alpha's specialized language models for text completi...24.4Nebius Token FactoryNebius Token Factory is the AI model inference platform offering OpenAI-compatible endpoints for serving op...23.2EigenAIEigenAI exposes deterministic, verifiable LLM inference over an OpenAI-compatible API surface, with executi...23.0SAP AI Core APIREST API for SAP AI Core, enabling training, deployment, and inference of AI and machine learning models wi...22.7KAITO RAGEngine APIRAGEngine exposes endpoints for managing retrieval-augmented generation services with embedded vector datab...22.5Anyscale Services APIDeploys and manages production Ray Serve applications as long-running, autoscaling, multi-version services ...20.0Mirai uzu Inference SDKuzu is Mirai's first-party, high-performance on-device inference engine. A single high-level API — shared a...19.6Hypura Ollama-Compatible Inference APIHypura is a storage-tier-aware LLM inference scheduler for Apple Silicon that places model tensors across G...19.0Ginkgo AI Model APIAsync, job-polling REST API for running inference on public and Ginkgo-proprietary biological foundation mo...17.6Infini-AI GenStudio Large-Model Service (MaaS)OpenAI-compatible model-inference API over Infini-AI's catalog of open- and closed-source models. Bearer (A...13.4
Minimal 2 Almost no public developer surface
SteadyGateway GatewayOpenAI-compatible HTTP API for enterprise LLM inference across GLM, Qwen, MiniMax, DeepSeek and Kimi. Contr...6.9OctoStackOctoStack was OctoAI's self-contained generative-AI production stack for deploying open and customer-traine...0.0

Companies reaching this through an API (49)

These companies publish an API, specification or operation carrying “Inference” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

AI Gateway Akkio Amazon Bedrock Amazon Nova Anomaly Detection Antfly Autoderm – AI Dermatology API Auxen Azure Databricks Azure OpenAI Service Cloudflare Codebase Compresr Cure Cancer With AI Ditto Audio EigenLayer Elastic Elastic Stack ExchangeRebel Foresea Gcore H Company HUD Hugging Face Transformers Huma Infer by Flow7 invinoveritas Inworld AI King's College London Lightning AI Modelbit Ollama Openwork Paperspace Pinecone Ray ReqArchitect SAP Business Technology Platform Scale AI Snowflake Sonde Health Swisscom TensorFlow Thinking Machines Trajectory TrueFoundry TU Dresden Viam Weights and Biases

Score breakdown

Frequency
64.2
log-scaled weighted occurrences
Breadth
2.3
spread across providers
Quality lift
35.7
mean composite of providers using it
Cohesion
19.1
strength of nearest seed neighbor

Where this tag sits

182 providers carry this tag directly, and 187 counting the 1 narrower tag below — 5 more to reach.

Artificial Intelligence broader Model Serving 13 providers

Related tags

OpenAI-Compatible 51 co-occurrences Chat Completions 54 co-occurrences LLM 106 co-occurrences GPU 49 co-occurrences Models 74 co-occurrences Fine-Tuning 26 co-occurrences Completions 27 co-occurrences Embeddings 35 co-occurrences

Where this tag comes from

Provider tag182
Api tag118
Openapi tag34
Openapi op tag110

Markets provisional

Kin Score markets whose measured providers carry this tag. Share is the fraction of the market's measured providers that carry it — it describes the market, not this tag.

MarketShare of the market's providers
AI Model Routing35%
Typed Decision Models27%
MLOps and AI/ML Infrastructure (LF AI & Data, MLPerf, Kubeflow)21%
Hugging Face Hub Organisations20%
Speech and Voice AI20%

Cohort brief

Auto-generated

The 173 providers in the APIs.io catalog tagged Inference, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
173
of 182 in the catalog
Mean Kin Score
36.2
+12.1 vs catalog 24.1
Mean Agent Readiness
22
+7.9 vs catalog 14.1
Spread
0–93.5
median 33.8 · σ 18.6
How the 173 split by band
Exemplar 6Strong 25Developing 42Thin 55Emerging 28Minimal 17
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Developer Ergonomics 43.8 24.5 +19.3 173
Contract Quality 32.8 18.6 +14.2 173
Access Clarity 41 30 +11 173
Operational Transparency 22 13.2 +8.8 173
Discoverability 67.6 59.1 +8.5 173
Contract Governance 14.2 9.7 +4.5 173

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 26% 18% +8
MCP server (first-party) 28% 16% +12
Agent Skills 0% 0% 0
OAuth scopes 6% 13% -7
Security 97% 99% -2
Arazzo workflows 5% 1% +4
Governance rules 64% 36% +28

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 Telnyx 93.5
  2. 2 Hive Civilization 78
  3. 3 Amazon SageMaker 76.6
  4. 4 NexGen Cloud 69.8
  5. 5 Hugging Face 69.1
  6. 6 EmpirioLabs AI 69
  7. 7 Segmind 68.8
  8. 8 Roboflow 65.5
  9. 9 fal 65.2
  10. 10 Seekr 65.1
Top by Agent Readiness
  1. 1 Telnyx 79.5
  2. 2 GMI Cloud 58
  3. 3 LLM Gateway 56.8
  4. 4 brick.blue 56.7
  5. 5 Fastino Labs 54.6
  6. 6 ai& 53.7
  7. 7 Roboflow 52.8
  8. 8 EmpirioLabs AI 52.3
  9. 9 Agentgates 49.9
  10. 10 Replicate 49.8
All 182 members of this roster resolve to a provider in the catalog; 173 carry a score (95%). The figures above describe the scored members only.
Coverage caveat. 129 of 173 scored members had under half their catalog-attributable points satisfied at all (catalog_earned / catalog_max < 0.5). They are INCLUDED in the mean above. A large share here means the cohort mean is partly a measurement of how far our enrichment reached, not only of how these providers publish.Generated from the catalog build of 14 November 2026, across 41591 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/inference"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort (paid plan)
The distribution (Pro)

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.