# Mango LLMBoost Inference Server API

**Canonical:** https://apis.io/apis/mangoboost/llmboost-inference/  
**Provider:** MangoBoost — https://apis.io/providers/mangoboost/  
**Base URL:** http://localhost:8000/v1  
**Documentation:** https://llmboost.mangoboost.io/docs/features/openai-api

Mango LLMBoost Inference Server API is one of 3 APIs that [MangoBoost](https://apis.io/providers/mangoboost/) publishes on the [APIs.io](https://apis.io/) network. Tagged areas include Inference, Artificial Intelligence, LLM, OpenAI-Compatible, and Self-Hosted. The published artifact set on APIs.io includes API documentation, a getting-started guide, and an API reference.

LLMBoost is MangoBoost's enterprise LLM inference server. It serves the OpenAI REST API on /v1 so an existing OpenAI client migrates with a base-URL change: POST /v1/chat/completions, POST /v1/completions, POST /v1/embeddings, POST /v1/responses, POST /v1/audio/transcriptions and /translations, GET /v1/models, plus GET /health and GET /metrics (Prometheus). Streaming, JSON-schema structured output, tool/function calling and multimodal image input are supported. The server is self-hosted on the customer's own AMD Instinct GPUs — there is no MangoBoost-hosted endpoint — and is started with `lbh serve <Repo/Model>` or `llmboost serve <model>` inside the LLMBoost container.

## Machine-readable artifacts (4)

- **Documentation** — https://llmboost.mangoboost.io/docs/
- **GettingStarted** — https://llmboost.mangoboost.io/docs/quickstart
- **APIReference** — https://llmboost.mangoboost.io/docs/features/openai-api
- **APIsJSON** — https://raw.githubusercontent.com/api-evangelist/mangoboost/refs/heads/main/apis.yml

## Other MangoBoost APIs (2)

- [Mango SDK Device API (libmango)](https://apis.io/apis/mangoboost/mango-sdk/)
- [Mango OPI Storage Bridge gRPC API](https://apis.io/apis/mangoboost/opi-storage-bridge/)

## Tags

Inference, Artificial Intelligence, LLM, OpenAI-Compatible, Self-Hosted

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/apis/mangoboost/llmboost-inference/). The API's provider profile, Kin Score and agent-readiness rating are at https://apis.io/providers/mangoboost/.