OpenRelay

OpenRelay Inference API

OpenAI-compatible chat completions API (POST /v1/chat/completions) and, for supporting models, an Anthropic-compatible Messages API (POST /v1/messages). Drop-in: point the official OpenAI SDKs at the base URL with an OpenRelay key. Also offers an asynchronous Batch API over JSONL files.

GitHub

Documentation

📖
Documentation
https://docs.openrelay.inc/docs/inference
📖
GettingStarted
https://docs.openrelay.inc/docs/inference/quickstart

Other Resources

🔗
APIsJSON
https://raw.githubusercontent.com/api-evangelist/openrelay/refs/heads/main/apis.yml

API entry from apis.yml

apis.yml Raw ↑ 
name: OpenRelay Inference API
description: 'OpenAI-compatible chat completions API (POST /v1/chat/completions) and, for supporting models,
  an Anthropic-compatible Messages API (POST /v1/messages). Drop-in: point the official OpenAI SDKs at
  the base URL with an OpenRelay key. Also offers an asynchronous Batch API over JSONL files.'
humanURL: https://docs.openrelay.inc/docs/inference
baseURL: https://inference.openrelay.inc/v1
tags:
- Inference
- OpenAI-Compatible
- LLM
properties:
- type: Documentation
  url: https://docs.openrelay.inc/docs/inference
- type: GettingStarted
  url: https://docs.openrelay.inc/docs/inference/quickstart