Surge AI

Surge AI is a human-data company that provides large-scale, expert-quality labeled data for training and evaluating frontier AI models. The product surface spans RL environments and agents (rich, complex environments that challenge agentic models), rubrics and verifiers (scoring systems for AI outputs), RLHF (preference and reward data), SFT (foundational skill demonstrations), human evaluation, expert professional domains, internationalization across 70+ languages, multimodal (image, audio, video) data, and off-the-shelf datasets. Surge ships an official Python SDK (surge-python) wrapping the Surge API, with API-key authentication, and exposes the dashboard and API reference at app.surgehq.ai. Public datasets published by Surge include the toxicity dataset (the world's largest social-media toxicity dataset).

11 APIs 11 Features

Human DataRLHFSFTRubricsVerifiersRL EnvironmentsMultimodalInternationalizationLabeling

Python SDK

Official surge-python SDK on PyPI, MIT-licensed, Python 3.10+.

RL Environments and Agents

Complex environments that challenge agentic models.

Rubrics and Verifiers

Scoring systems for AI outputs across domains.

RLHF and SFT

Preference, reward, and demonstration data for foundation-model training.

Human Evaluation

Expert workforce grades AI output quality.

Expert Professional Domains

Specialized expertise across finance, law, medicine, and more.

70+ Languages

Internationalization coverage spanning more than 70 languages.

Multimodal Data

Image, audio, and video collection and labeling.

Off-The-Shelf Datasets

Pre-built datasets available for licensing.

Open Datasets

Public releases including the world's largest social-media toxicity dataset.

Use Cases

Frontier Model RLHF

Preference and reward data for reinforcement learning from human feedback.

Supervised Fine-Tuning

Demonstration data for SFT across professional domains.

Agentic Evals

Benchmark agents in complex RL environments with structured rubrics.

Multilingual Model Evaluation

Evaluate model quality across 70+ languages.

Trust and Safety Research

Use the toxicity dataset and human evaluation pipelines for trust and safety work.

Integrations

Python SDK

Programmatic integration via the official surge-python SDK.

API Key Authentication

Standard API-key auth (SURGE_API_KEY env var or programmatic configuration).

Custom Project Blueprints

Use Surge blueprints as templates for new labeling projects.

Resources

GitHubOrganization

Sources

opencollection: 1.0.0
info:
  name: Surge AI API
  version: 1.0.0
request:
  auth:
    type: basic
    username: '{{username}}'
    password: '{{password}}'
items:
- info:
    name: Projects
    type: folder
  items:
  - info:
      name: List projects
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects
    docs: List projects
  - info:
      name: Create project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects
      body:
        type: json
        data: '{}'
    docs: Create project
  - info:
      name: List organization-wide (shared) projects
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects/shared
    docs: List organization-wide (shared) projects
  - info:
      name: List blueprint projects
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects/blueprints
    docs: List blueprint projects
  - info:
      name: Retrieve a project
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects/:project_id
      params:
      - name: project_id
        value: ''
        type: path
    docs: Retrieve a project
  - info:
      name: Update a project
      type: http
    http:
      method: PUT
      url: https://app.surgehq.ai/api/projects/:project_id
      params:
      - name: project_id
        value: ''
        type: path
      body:
        type: json
        data: '{}'
    docs: Update a project
  - info:
      name: List project copies
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects/:project_id/copies
      params:
      - name: project_id
        value: ''
        type: path
    docs: List project copies
  - info:
      name: Launch a project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/launch
      params:
      - name: project_id
        value: ''
        type: path
    docs: Launch a project
  - info:
      name: Pause a project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/pause
      params:
      - name: project_id
        value: ''
        type: path
    docs: Pause a project
  - info:
      name: Resume a paused project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/resume
      params:
      - name: project_id
        value: ''
        type: path
    docs: Resume a paused project
  - info:
      name: Cancel a project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/cancel
      params:
      - name: project_id
        value: ''
        type: path
    docs: Cancel a project
- info:
    name: Tasks
    type: folder
  items:
  - info:
      name: List tasks within a project
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/projects/:project_id/tasks
      params:
      - name: project_id
        value: ''
        type: path
    docs: List tasks within a project
  - info:
      name: Create a single task within a project
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/tasks
      params:
      - name: project_id
        value: ''
        type: path
      body:
        type: json
        data: '{}'
    docs: Create a single task within a project
  - info:
      name: Create multiple tasks (bulk)
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/projects/:project_id/tasks/create_tasks
      params:
      - name: project_id
        value: ''
        type: path
      body:
        type: json
        data: '{}'
    docs: Create multiple tasks (bulk)
  - info:
      name: Retrieve a task
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/tasks/:task_id
      params:
      - name: task_id
        value: ''
        type: path
    docs: Retrieve a task
  - info:
      name: Create a response for a task
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/tasks/:task_id/create-response
      params:
      - name: task_id
        value: ''
        type: path
      body:
        type: json
        data: '{}'
    docs: Create a response for a task
  - info:
      name: Set gold standards for a task
      type: http
    http:
      method: POST
      url: https://app.surgehq.ai/api/tasks/:task_id/gold-standards
      params:
      - name: task_id
        value: ''
        type: path
      body:
        type: json
        data: '{}'
    docs: Set gold standards for a task
- info:
    name: Teams
    type: folder
  items:
  - info:
      name: List teams
      type: http
    http:
      method: GET
      url: https://app.surgehq.ai/api/teams
    docs: List teams
bundled: true

Surge AI

APIs

Surge API

Surge Python SDK

Surge RL Environments and Agents

Surge Rubrics and Verifiers

Surge RLHF

Surge SFT

Surge Human Evaluation

Surge Multimodal Data

Surge Internationalization

Surge Off-The-Shelf Data

Surge Toxicity Dataset

Collections

Surge AI API

Pricing Plans

Surge Ai Plans Pricing

Rate Limits

Surge Ai Rate Limits

FinOps

Surge Ai Finops

Features

Use Cases

Integrations

Resources

Sources