# OctoAI

**Canonical:** https://apis.io/providers/octoai/  
**Website:** https://octo.ai  
**APIs profiled:** 5

OctoAI (formerly OctoML) was a Seattle-based AI inference platform founded in 2019 as a University of Washington Allen School spin-out of the Apache TVM project. The company originally focused on machine-learning model optimization and compilation across CPUs, GPUs, and accelerators, and in June 2023 launched a generative-AI SaaS inference platform that served open-source foundation models (Llama 2, Mixtral, SDXL, Stable Diffusion, Whisper) behind OpenAI-style REST APIs with Python and TypeScript SDKs. In January 2024 OctoML formally rebranded to OctoAI and in April 2024 unveiled OctoStack, a self-contained generative-AI production stack for deploying models inside customer VPC and on-premises environments across NVIDIA GPUs, AMD GPUs, and AWS Inferentia. NVIDIA acquired OctoAI in September 2024 for a reported $165M (down from a 2021 peak valuation of ~$900M), with CEO Luis Ceze and key staff joining NVIDIA. OctoAI sent customers a "Wind down of OctoAI Services" notice and terminated all hosted endpoints, accounts, and SDK access on 31 October 2024. The octo.ai domain now 301-redirects to nvidia.com and no public OctoAI product, API, dashboard, or developer portal remains; the technology has been absorbed into NVIDIA's internal AI inference stack and is not separately purchasable. This catalog entry is a historical record of the former OctoAI developer surface and the GitHub artifacts that remain.

## Kin Score — 8.2 / 100 (minimal)

Scored 2026-08-25 under rubric 0.14.0. Trend: flat (+0.0 from 8.2).

| Facet | Score |
|---|---|
| Discoverability | 64.8 |
| Contract Quality | 0.0 |
| Governance | 0.0 |
| Contract Governance | 0.0 |
| Operational Transparency | 2.6 |
| Developer Ergonomics | 7.1 |
| Commercial Clarity | 0.0 |
| Access Clarity | 0.0 |

## Agent readiness — 0.0 (human-only)

| Dimension | Value |
|---|---|
| Spec Presence | no |
| Agentic Access | no |
| Reversibility Documented | no |
| MCP Server | no |
| Auth Clarity | no |
| Idempotency | no |
| Error Semantics | no |
| OpenAPI Examples | no |
| Rate Limit Signal | no |
| Event Surface Described | no |
| Agent Skills | no |
| Well Known Catalog | no |
| Consent Identity | no |
| Agent Card | no |
| Dry Run Mode | no |
| Delegated Identity | no |
| Protected Resource Metadata | no |
| Dynamic Client Registration | no |
| Agentic Commerce | no |

## Access

Unknown — onboarding: unknown, pricing: unknown, trial: no (confidence: low).

## APIs (5)

- **OctoAI Text Gen Inference API** — OpenAI-compatible chat and text-completion endpoints serving open-source LLMs including Llama 2, Llama 3, Mixtral 8x7B, Mistral 7B, Code Llama, and customer fine-tunes. Supporte...
- **OctoAI Image Gen Inference API** — Text-to-image and image-to-image inference for SDXL, SDXL-Lightning, Stable Diffusion 1.5, and SSD-1B with ControlNet, LoRA, and adapter support, plus inpainting and asset-manag...
- **OctoAI Asset Library API** — Endpoints for uploading, listing, and managing user assets — checkpoints, LoRAs, textual inversions, ControlNets, and VAE files — used by the image and text inference APIs. The ...
- **OctoAI Compute Service API** — Container-deployment API ("Compute Service") that let customers build, register, and serve their own custom model containers on OctoAI's managed GPU fleet, with autoscaling and ...
- **OctoStack** — OctoStack was OctoAI's self-contained generative-AI production stack for deploying open and customer-trained foundation models inside a customer's VPC or on-premises environment...

## Security (1)

- **Octoai Domain Security** — TLSv1.2 · DMARC

## Use cases (4)

- **Repointing OpenAI Workloads to Open Models** — Teams used the OpenAI-compatible endpoints to swap GPT-3.5/4 calls for Llama 2 / Mixtral at lower cost without rewriting client code.
- **Generative Image Pipelines** — Product, marketing, and creative teams ran SDXL-based image generation with custom LoRAs and ControlNets for branded asset production.
- **Private Generative AI in Regulated Industries** — Healthcare, financial-services, and government customers deployed OctoStack in-VPC or on-premises to keep prompts, completions, and model weights inside their security boundary.
- **Custom Fine-Tune Hosting** — Teams fine-tuned open-weights models and served the resulting adapters and full-weight checkpoints behind OctoAI inference endpoints without managing GPU infrastructure.

## Tags

Acquired, Defunct, AI Inference, Generative AI, LLM, Foundation Models, Model Optimization, Apache TVM, GPU, Private AI, NVIDIA

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/providers/octoai/). Scores are computed from the provider's own public artifacts under a published rubric.