Fireworks AI website screenshot

Fireworks AI

Fireworks AI is a production-grade inference platform for open-source and proprietary generative models. The Fireworks API hosts Llama, DeepSeek, Qwen, Mixtral, Stable Diffusion, and other models with serverless pay-per-token, on-demand dedicated GPU, and batch deployment options, plus managed fine-tuning.

13 APIs 0 Features
AILLMInferenceMultimodalFine-tuningGPU

APIs

Fireworks Chat Completions API

OpenAI-compatible chat completions across 100+ open-source and proprietary models including Llama, DeepSeek, Qwen, and Mixtral, with streaming, function calling, and structured ...

Fireworks Completions API

Legacy text completion endpoint, OpenAI-compatible.

Fireworks Vision API

Vision-language inference for image and document understanding through chat completions.

Fireworks Embeddings API

Generate dense vector embeddings for retrieval, RAG, and semantic search using nomic, Qwen3, BGE, and other open embedding models.

Fireworks Rerank API

Cross-encoder reranking of candidate passages for higher-quality retrieval and RAG pipelines.

Fireworks Images API

Text-to-image and image-to-image generation across Stable Diffusion, FLUX, and other diffusion model families.

Fireworks Audio API

OpenAI-compatible audio transcription, translation, and TTS endpoints for Whisper and other audio models with low-latency streaming.

Fireworks Batch Inference API

Asynchronous batch inference at 50% of serverless rates for both input and output tokens.

Fireworks Fine-Tuning API

Supervised fine-tuning (LoRA and full-parameter) and reinforcement fine-tuning, with one-click deployment of fine-tuned weights at the same per-token price as base models.

Fireworks Files API

Upload and manage training datasets, batch input files, and fine-tuning artifacts.

Fireworks Models API

Lists models, deployments, and metadata across the Fireworks catalog.

Fireworks Deployments API

Provision and autoscale on-demand dedicated GPU deployments (H100, H200, B200, B300) billed per GPU-second.

Fireworks Account API

Programmatic access to account, billing, usage, and team management.

Collections

GraphQL

Fireworks AI GraphQL Schema

This directory contains a conceptual GraphQL schema for the Fireworks AI fast inference platform. The schema is derived from the public Fireworks AI REST API surface documented ...

GRAPHQL

Pricing Plans

Rate Limits

Fireworks Ai Rate Limits

6 limits

RATE LIMITS

FinOps

Event Specifications

Fireworks AI Streaming Inference API

AsyncAPI description of the Fireworks AI streaming inference surface. Fireworks streams generation deltas over HTTP using Server-Sent Events (SSE) on a single `text/event-stream...

ASYNCAPI

Resources

👥
GitHubOrganization
GitHubOrganization
🔗
LinkedIn
LinkedIn
🔗
Website
Website
🔗
Documentation
Documentation
🔗
Plans
Plans
🔗
RateLimits
RateLimits
🔗
FinOps
FinOps
🔗
LlmsText
LlmsText

Sources

Raw ↑
opencollection: 1.0.0
info:
  name: Fireworks Text Completion API
  version: 0.1.0
request:
  auth:
    type: bearer
    token: '{{bearerToken}}'
items:
- info:
    name: Create Completion
    type: http
  http:
    method: POST
    url: https://api.fireworks.ai/inference/v1/completions
    body:
      type: json
      data: '{}'
  docs: 'Create a completion for the provided prompt and parameters.


    For RL / agent rollouts, Fireworks inference exposes additional

    rollout-specific features:

    [`x-session-affinity` and `x-multi-turn-session-id`](https://docs.fireworks.ai/guides/rollout-inference#session-affinity)

    for multi-turn trajectories, and

    [MoE Router Replay (R3)](https://docs.fireworks.ai/guides/rollout-inference#moe-router-replay)

    for MoE expert tracing during rollouts.'
- info:
    name: Create Chat Completion
    type: http
  http:
    method: POST
    url: https://api.fireworks.ai/inference/v1/chat/completions
    body:
      type: json
      data: '{}'
  docs: 'Create a completion for the provided prompt and parameters.


    For RL / agent rollouts, Fireworks inference exposes additional

    rollout-specific features:

    [`x-session-affinity` and `x-multi-turn-session-id`](https://docs.fireworks.ai/guides/rollout-inference#session-affinity)

    for multi-turn trajectories, and

    [MoE Router Replay (R3)](https://docs.fireworks.ai/guides/rollout-inference#moe-router-replay)

    for MoE expert tracing during rollouts.'
bundled: true