Model Serving
Providers using this tag (13)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Strong 2 Solid coverage with minor gaps
Developing 1 Usable, with meaningful gaps to close
Thin 9 Limited public surface area
Minimal 1 Almost no public developer surface
APIs with this tag (11)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Exemplar 1 Complete, well-documented, and agent-ready
Strong 1 Solid coverage with minor gaps
Developing 1 Usable, with meaningful gaps to close
Thin 8 Limited public surface area
BentoML REST APIBentoML is an open-source unified inference platform for deploying and scaling AI models. It auto-generates...NVIDIA Triton Inference Server HTTP APINVIDIA Triton Inference Server is an open-source inference serving software that implements the KServe Open...Ray Serve REST APIRay Serve is a scalable model serving library built on Ray, designed for building online inference APIs. Su...vLLM OpenAI-Compatible APIvLLM is a high-throughput and memory-efficient inference engine for LLMs, implementing PagedAttention for e...Ray Serve HTTP APIHTTP interface for invoking models and applications deployed via Ray Serve. Each deployed application is ex...BentoML Service REST APIAuto-generated REST API endpoints produced when BentoML services are deployed. Each decorated service metho...Seldon Inference APIThe Seldon Inference API provides REST and gRPC endpoints for serving machine learning model predictions at...KServe Inference APIKServe's standardized model inference protocol for serving predictions across multiple ML frameworks on Kub...
Companies reaching this through an API (2)
These companies publish an API, specification or operation carrying “Model Serving” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.
Score breakdown
Frequency
34.2
log-scaled weighted occurrences
Breadth
0.1
spread across providers
Quality lift
35.6
mean composite of providers using it
Cohesion
6.5
strength of nearest seed neighbor
Where this tag sits
Related tags
MLOps 7 co-occurrences
Inference 13 co-occurrences
Models 7 co-occurrences
Kubernetes 6 co-occurrences
Deployment 5 co-occurrences
Machine Learning 15 co-occurrences
LLM 5 co-occurrences
Health 6 co-occurrences
Where this tag comes from
Provider tag13
Api tag11
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.