OctoAI

OctoAI Text Gen Inference API

OpenAI-compatible chat and text-completion endpoints serving open-source LLMs including Llama 2, Llama 3, Mixtral 8x7B, Mistral 7B, Code Llama, and customer fine-tunes. Supported streaming, function calling, JSON mode, and a shared model catalog. The API was reachable at https://text.octoai.run/v1 and shut down on 31 October 2024.

Documentation GitHub

Other Resources

https://raw.githubusercontent.com/api-evangelist/octoai/refs/heads/main/apis.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/octoai-text-gen-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

aid: octoai:octoai-text-gen-api
name: OctoAI Text Gen Inference API
description: OpenAI-compatible chat and text-completion endpoints serving open-source LLMs including Llama
  2, Llama 3, Mixtral 8x7B, Mistral 7B, Code Llama, and customer fine-tunes. Supported streaming, function
  calling, JSON mode, and a shared model catalog. The API was reachable at https://text.octoai.run/v1
  and shut down on 31 October 2024.
humanURL: https://octo.ai
baseURL: https://text.octoai.run/v1
tags:
- LLM
- Chat
- Completions
- OpenAI-Compatible
- Defunct
tags_raw:
- LLM
- Chat
- Completions
- OpenAI Compatible
- Defunct
properties:
- type: StatusPage
  url: https://octo.ai
  description: Domain now 301-redirects to nvidia.com; service terminated 31 October 2024.