Topic · concept
MLOps
MLOps (Machine Learning Operations) is an engineering discipline that unifies machine learning development with operations to deploy, monitor, govern, and maintain machine learning models in production. MLOps.org publishes an end-to-end reference for designing, building, and managing reproducible, testable, and evolvable ML-powered software, including the CRISP-ML(Q) process model, the MLOps Stack Canvas, MLOps principles, and ML model governance practices. This index curates the canonical references, frameworks, and ecosystem resources for practicing MLOps across data engineering, ML pipelines, and model serving.
41 related providers on APIs.io
Source repository →
Links
DomainSecurityWebsiteMotivationDesigning ML SoftwareML Workflow LifecycleThree Levels of ML SoftwareMLOps PrinciplesCRISP-ML(Q)MLOps Stack CanvasML Model GovernanceReferencesState of MLOpsPublisherLicenseJSONLDJSONSchemaJSONSchema
Providers working in MLOps
Providers whose own tags share at least two of this topic's tags, most shared first — the top 30 of 41.
| Provider | About | Rating | APIs |
|---|---|---|---|
| Seldon | Seldon is a Kubernetes-native MLOps platform that enables enterprises to deploy, monitor, manage, and explain machine learning models at scale. The platform provides REST and gRPC inference APIs that follow the Open Inference Protocol, ena… | thin | 3 |
| Striveworks | Striveworks is an Austin, Texas enterprise AI operations (AIOps) company whose platform, Chariot, lets organizations build, deploy, monitor and continuously retrain machine-learning models — in hours rather than months — across cloud, on-p… | emerging | 1 |
| Amazon CodeGuru Profiler | Amazon CodeGuru Profiler collects runtime performance data from your live applications, providing recommendations to help you reduce CPU utilization, cut costs, and improve application performance. The profiler analyzes your application's… | exemplar | 1 |
| Edge Impulse | Edge Impulse is the end-to-end edge AI MLOps platform for building datasets, training and optimizing machine learning models, and deploying them directly on device — from the smallest microcontrollers to gateways with the latest neural acc… | exemplar | 2 |
| IBM | IBM offers solutions that protect identities and sensitive access for enterprise customers. Its IBM Vault® product is highlighted as a tool for identity protection and regulatory compliance, and IBM hosts webinars on trust, identity, and g… | exemplar | 1 |
| RightNow AI | RightNow AI (RunInfra) turns plain-English descriptions of an inference workload into production, OpenAI-compatible AI endpoints. The platform selects open-source models from Hugging Face, benchmarks GPU options, applies kernel optimizatio… | strong | 1 |
| Amazon DevOps Guru | Amazon DevOps Guru is a machine learning-powered service that makes it easy to improve an application's operational performance and availability. It detects behaviors that deviate from normal operating patterns so you can identify operatio… | strong | 1 |
| Simplismart | Simplismart is an AI inference and model-deployment platform that lets teams run, fine-tune, and self-host generative AI models on optimized GPU infrastructure. It offers OpenAI-compatible LLM chat inference (Llama, Qwen, Gemma, Mixtral, D… | strong | 18 |
| Replicate | Replicate lets you run machine learning models in the cloud with a simple API. Thousands of open-source models are available, and you can run your own custom models at scale. Run image generation, language models, audio synthesis, video ge… | strong | 1 |
| Databricks | Collection of Databricks REST APIs for managing workspaces, clusters, jobs, and data operations. | strong | 1 |
| H2O.ai | H2O.ai is an open-source artificial-intelligence and machine-learning company whose platform spans H2O-3 (a distributed, in-memory ML engine), H2O Driverless AI (automatic machine learning), H2O MLOps (model deployment, scoring and monitor… | strong | 2 |
| Inference | Inference (inference.net) is an AI infrastructure platform for AI-native teams. It offers an OpenAI-compatible inference API for open-source, frontier, and custom fine-tuned language models, alongside Catalyst — its observability, tracing,… | strong | 1 |
| fiddler.ai | Fiddler AI is an enterprise AI Observability and Security platform — an "AI Control Plane" for AI agents, LLM applications, and traditional ML models. It delivers unified monitoring, real-time guardrails (safety, hallucination/faithfulness… | strong | 1 |
| Launchable | Launchable is a software development intelligence platform for continuous integration that applies machine learning to CI and test data to speed up software delivery. Its flagship capability, Predictive Test Selection, records builds, test… | developing | 1 |
| Oxen | Oxen.ai is a blazing-fast data version control system and AI platform for teams building with their own data. Its open-source Rust core (liboxen) versions, branches, and shares terabyte-scale datasets, model weights, and experiments withou… | developing | 2 |
| FuriosaAI | FuriosaAI is a South Korean semiconductor company that designs data-center AI inference chips and the software stack that runs on them. Its second-generation NPU, RNGD, implements a Tensor Contraction Processor architecture on TSMC 5nm and… | developing | 2 |
| Triton Inference Server | NVIDIA Triton Inference Server provides a cloud and edge inferencing solution optimized for both CPUs and GPUs. Triton supports an HTTP/REST and gRPC protocol that allows remote clients to request inferencing for any model being managed by… | thin | 2 |
| Domino Data Lab | Domino Data Lab is an enterprise MLOps and AI platform used by data science and machine learning teams to build, deploy, monitor, and govern models and data-science applications across hybrid and multi-cloud infrastructure. The platform ex… | thin | 1 |
| TensorFlow | TensorFlow is an end-to-end open source machine learning platform developed by Google. It provides a comprehensive ecosystem of tools, libraries, and community resources for building and deploying ML-powered applications, including model t… | thin | 1 |
| ModelOp | ModelOp is enterprise software for governing and operationalizing artificial intelligence at scale. Founded as Open Data Group and headquartered in Chicago, Illinois, it sells an "AI system of record" — the Enterprise AI Command Center, po… | thin | 1 |
| Scalable Inference Serving | A collection of APIs, frameworks, and platforms for scalable machine learning model inference serving, deployment, and management. This includes the KServe Open Inference Protocol (the CNCF standard for model serving on Kubernetes), BentoM… | thin | 1 |
| Kubeflow | Kubeflow is an open-source machine learning platform for Kubernetes, designed to make deployments of ML workflows on Kubernetes simple, portable, and scalable. It provides tools for training, serving, tuning, and managing ML models across… | thin | 1 |
| BentoML | BentoML is an open-source unified inference platform for building, packaging, and deploying machine learning models as scalable REST API services. Developers define services using Python class decorators that automatically expose model inf… | thin | 1 |
| Ray | Ray is an open-source unified compute framework, stewarded by Anyscale, that scales Python and AI workloads from a laptop to a cluster. It consists of Ray Core (a distributed runtime) and a set of AI libraries (Ray Train, Ray Data, Ray Tun… | thin | 1 |
| Modelbit | Modelbit is an MLOps platform (backed by Homebrew) that lets data scientists rapidly deploy and manage machine-learning models. You train and register a model in a notebook, then deploy a Python function with the first-party modelbit Pytho… | thin | 1 |
| Cumulus Labs | Cumulus Labs is a Y Combinator (W26) company building a unified inference platform for production AI. Cumulus consolidates the eight subsystems teams normally assemble from separate vendors — an OpenAI-compatible gateway, a per-workflow ro… | thin | 1 |
| KServe | KServe is a standard model inference platform on Kubernetes, built for highly scalable use cases. It provides performant, standardized inference protocol across ML frameworks including TensorFlow, PyTorch, scikit-learn, XGBoost, and more. | thin | 1 |
| Comet | Comet is an MLOps and GenAI observability platform. It exposes a REST API (read, write, and Model Production Monitoring endpoints) plus a Python SDK. Opik is the GenAI observability product line; MLOps is the classical experiment-tracking… | thin | 2 |
| Vianai Systems | Vianai Systems is an enterprise AI company whose hila platform delivers GenAI-based conversational analytics ("talk to your data") alongside a machine-learning model monitoring, deployment, and observability platform. The hila REST APIs an… | emerging | 1 |
| StormForge | StormForge provides machine learning-based Kubernetes resource optimization (rightsizing) for reducing cloud infrastructure costs while maintaining application performance. The Optimize Live product deploys an agent to Kubernetes clusters… | emerging | 2 |
A term in the Machine learning area.
Tags
AI OperationsCRISP-ML(Q)DevOpsMachine LearningML EngineeringML GovernanceML PipelinesModel DeploymentModel MonitoringModel Serving