Model Serving
Providers using this tag (14)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Strong 1 Solid coverage with minor gaps
Developing 2 Usable, with meaningful gaps to close
Thin 9 Limited public surface area
Emerging 1 Early or largely undocumented
Minimal 1 Almost no public developer surface
APIs with this tag (11)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Strong 3 Solid coverage with minor gaps
Model Serving Endpoints APICreate and manage model serving endpoints for deploying machine learning models as REST API endpoints.Databricks Serving Endpoints APIThe Databricks Serving Endpoints API allows you to create, update, query, and delete model serving endpoint...TrueFoundry Model Serving APITrueFoundry's Model Serving capability enables deployment and management of LLM and embedding models using ...
Thin 7 Limited public surface area
Seldon Inference APIThe Seldon Inference API provides REST and gRPC endpoints for serving machine learning model predictions at...BentoML REST APIBentoML is an open-source unified inference platform for deploying and scaling AI models. It auto-generates...NVIDIA Triton Inference Server HTTP APINVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open...Ray Serve REST APIRay Serve is a scalable model serving library built on Ray, designed for building online inference APIs. Su...vLLM OpenAI-Compatible APIvLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for e...BentoML Service REST APIAuto-generated REST API endpoints produced when BentoML services are deployed. Each decorated service metho...KServe Inference APIKServe's standardized model inference protocol for serving predictions across multiple ML frameworks on Kub...
Emerging 1 Early or largely undocumented
Companies reaching this through an API (2)
These companies publish an API, specification or operation carrying “Model Serving” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.
Score breakdown
Frequency
38.3
log-scaled weighted occurrences
Breadth
0.4
spread across providers
Quality lift
31.7
mean composite of providers using it
Cohesion
8.3
strength of nearest seed neighbor
Where this tag sits
Related tags
MLOps 8 co-occurrences
Inference 14 co-occurrences
Models 8 co-occurrences
Deployment 5 co-occurrences
Kubernetes 6 co-occurrences
Machine Learning 18 co-occurrences
LLM 5 co-occurrences
Open Source 7 co-occurrences
Where this tag comes from
Provider tag16
Api tag11
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.