The Rerank API from LLM Gateway — 1 operation(s) for rerank.
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/llmgateway-io:llmgateway-io-rerank-api"curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
version: 1.0.0
title: LLM Gateway Rerank API
description: 'OpenAI-compatible LLM gateway: chat completions, embeddings, images, audio, video, moderation, OCR, rerank, web search and typed decisions across providers with one API key.'
servers:
- url: https://api.llmgateway.io
- url: http://localhost:4001
tags:
- name: Rerank
paths:
/v1/rerank:
post:
operationId: v1_rerank
summary: Rerank
description: Rerank documents against a query using a cross-encoder reranker. Cohere-compatible API.
security:
- bearerAuth: []
requestBody:
content:
application/json:
schema:
type: object
properties:
model:
type: string
description: ID of the rerank model to use.
example: deepinfra/qwen3-reranker-8b
query:
type: string
minLength: 1
description: The search query to rank documents against.
example: What is the capital of France?
documents:
type: array
items:
type: string
minItems: 1
description: Array of document strings to rerank.
example:
- Paris is the capital of France.
- Berlin is the capital of Germany.
- Madrid is the capital of Spain.
top_n:
type: integer
description: Number of top results to return. Defaults to all documents when omitted.
example: 2
exclusiveMinimum: 0
return_documents:
type: boolean
description: Whether to include the document text in the response. Default false.
example: true
max_chunks_per_doc:
type: integer
description: Maximum number of chunks per document (accepted, but not all providers support this).
example: 10
exclusiveMinimum: 0
required:
- model
- query
- documents
responses:
'200':
description: Rerank response with ranked results.
headers:
RateLimit-Policy:
schema:
type: string
description: Quota policy as an HTTP Structured Fields list, e.g. "requests";q=60;w=60.
RateLimit:
schema:
type: string
description: Available quota and reset delay, e.g. "requests";r=59;t=60.
RateLimit-Limit:
schema:
type: string
description: Request limit for the current window.
RateLimit-Remaining:
schema:
type: string
description: Requests remaining in the current window.
RateLimit-Reset:
schema:
type: string
description: Seconds until the current window resets.
content:
application/json:
schema:
type: object
properties:
id:
type: string
model:
type: string
results:
type: array
items:
type: object
properties:
index:
type: integer
relevance_score:
type: number
document:
type: string
required:
- index
- relevance_score
meta:
type: object
properties:
api_version:
type: object
properties:
version:
type: string
billed_units:
type: object
properties:
input_tokens:
type: integer
total_tokens:
type: integer
required:
- model
- results
description: Cohere-compatible rerank response payload.
'400':
description: Invalid request body or parameters.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'401':
description: Missing or invalid API key.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'402':
description: Insufficient credits or plan limits reached.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'403':
description: Forbidden request or upstream response.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'404':
description: Unknown model or upstream not-found response.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'408':
description: Request timeout.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'410':
description: Archived or unavailable project.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'413':
description: Request too large.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'415':
description: Unsupported media type.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'429':
description: Rate limited. Response headers describe only LLMGateway-enforced limits; upstream provider headers are not forwarded. Honor Retry-After when present.
headers:
RateLimit-Policy:
schema:
type: string
description: Quota policy as an HTTP Structured Fields list, e.g. "requests";q=60;w=60.
RateLimit:
schema:
type: string
description: Available quota and reset delay, e.g. "requests";r=59;t=60.
RateLimit-Limit:
schema:
type: string
description: Request limit for the current window.
RateLimit-Remaining:
schema:
type: string
description: Requests remaining in the current window.
RateLimit-Reset:
schema:
type: string
description: Seconds until the current window resets.
Retry-After:
schema:
type: string
description: Seconds to wait before retrying.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'500':
description: Internal server error.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'502':
description: Failed to connect to the upstream provider.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'503':
description: Service unavailable upstream response.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'504':
description: Upstream provider timeout.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
'529':
description: Gateway overloaded.
headers:
Retry-After:
schema:
type: string
description: Seconds to wait before retrying.
content:
application/json:
schema:
$ref: '#/components/schemas/OpenAIError'
tags:
- Rerank
components:
schemas:
OpenAIError:
type: object
properties:
error:
type: object
properties:
message:
type: string
type:
type: string
param:
type:
- string
- 'null'
code:
type:
- string
- 'null'
required:
- message
- type
- param
- code
required:
- error
description: OpenAI-compatible error object.
securitySchemes:
bearerAuth:
type: http
scheme: bearer
description: Bearer token authentication using API keys
externalDocs:
url: https://docs.llmgateway.io
description: LLMGateway Documentation