LiteLLM

LiteLLM Rag API

The Rag API from LiteLLM — 2 operation(s) for rag.

GitHub OpenAPI

Documentation

📖
Documentation
https://docs.litellm.ai/docs/completion
📖
GettingStarted
https://docs.litellm.ai/docs/proxy/quick_start

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/litellm/refs/heads/main/openapi/litellm-rag-api-openapi.yml

OpenAPI Specification

litellm-rag-api-openapi.yml Raw ↑ 
openapi: 3.1.0
info:
  title: LiteLLM Proxy Assistants Rag API
  description: Minimal OpenAPI 3.1 specification for the LiteLLM proxy server, covering chat completions, completions, embeddings, audio, images, moderations, fine-tuning, batches, assistants, vector stores, messages, OCR, rerank, and RAG endpoints.
  version: 1.0.0
servers:
- url: http://localhost:4000
  description: LiteLLM proxy server
tags:
- name: Rag
paths:
  /rag/ingest:
    post:
      operationId: ragIngest
      summary: Ingest documents into a RAG index
      responses:
        '200':
          description: Ingestion accepted
        default:
          description: Error response
      tags:
      - Rag
  /rag/query:
    post:
      operationId: ragQuery
      summary: Query a RAG index
      responses:
        '200':
          description: Query result
        default:
          description: Error response
      tags:
      - Rag
x-generated-from: https://docs.litellm.ai/docs/completion
x-generated-by: claude-crawl-2026-05-08