Model Serving

Cumulus Labs Databricks Google TensorFlow Inferact Inferact KServe Kubeflow MLOps Ray Scalable Inference Serving Seldon TensorFlow Triton Inference Server TrueFoundry

BentoML REST API scalable-inference-serving Databricks Serving Endpoints API databricks KServe Inference API kserve NVIDIA Triton Inference Server HTTP API scalable-inference-serving Ray Serve HTTP API ray Ray Serve REST API scalable-inference-serving Seldon Inference API seldon TrueFoundry Model Serving API truefoundry vLLM OpenAI-Compatible API scalable-inference-serving