Runloop

Runloop is the AI Agent Accelerator — secure code sandboxes (Devboxes), evaluation infrastructure (Benchmarks, Scenarios), and production-grade orchestration for AI coding agents at enterprise scale. The platform provides a single REST API and matched Python/TypeScript SDKs covering Devbox lifecycle, Blueprint image building, Snapshot branching, Agent registry, Axon event streams with Broker bridges, Storage Objects, Secrets, Network Policies, Agent Gateways, MCP Configs, and a turnkey eval framework (SWE-Bench Verified, SWE-smith, custom benchmarks). Runloop runs on a custom bare-metal hypervisor with microVM-level isolation and is SOC 2 Type II, HIPAA, and GDPR compliant, with VPC deployment available for regulated workloads. Founded 2023 by Jonathan Wall (Google File System lead, Google Wallet co-founder, Index CTO acquired by Stripe).

13 APIs 0 Features

AIAI AgentsCoding AgentsSandboxesDevboxesCode ExecutionEvaluationBenchmarksSWE-BenchMCPSnapshotsmicroVMEnterpriseSOC 2

APIs

Runloop Devbox API

Create, configure, and operate Devboxes — isolated Linux microVM-backed sandbox environments purpose-built for AI coding agents. The Devbox API covers the full lifecycle (create...

Runloop Blueprint API

Build, preview, list, and manage Blueprints — Dockerfile-based container image templates that Devboxes launch from. Blueprints capture pre-installed system packages, language ru...

Runloop Benchmark API

Define, configure, and run Benchmarks against your agents. Runloop ships SWE-Bench Verified and SWE-smith out of the box; the Benchmark API also supports custom benchmarks built...

Runloop Scenario API

Author and run individual evaluation Scenarios — the atomic test unit for AI coding agents. Each Scenario captures input context, environment setup, an agent invocation, and one...

Runloop Agents API

Register and version Agents — packaged agent definitions sourced from Git, npm, pip, or pre-packaged storage objects. Once registered, an Agent can be mounted to any Devbox at c...

Runloop Axons API

Create and operate Axons — Runloop's distributed event streams for sequencing, recording, and observing agent interactions. Each Axon supports event publish, SSE subscription, S...

Runloop Storage Objects API

Upload and manage Storage Objects — managed files with presigned download URLs that can be mounted into Devboxes or shared between agent runs. Two-step upload (create -> complet...

Runloop Secrets API

Securely manage account-level Secrets (API keys, tokens, credentials) that Runloop injects into Devboxes at runtime. Raw secret values are never exposed to agent code or to the ...

Runloop Network Policies API

Define and manage egress Network Policies that restrict outbound network access from Devboxes. Allow/deny rules at account scope, attachable per Devbox at launch.

Runloop Gateway Configs API

Configure Agent Gateways — proxy configurations that let Devbox-resident agents call external AI provider APIs (OpenAI, Anthropic, etc.) without exposing the raw provider creden...

Runloop MCP Configs API

Configure and manage Model Context Protocol (MCP) server bindings for Devboxes. Each MCP Config is a declarative mount that Runloop wires into Devbox agent runtimes so the agent...

Runloop API Keys API

Create and manage Runloop account API keys and Restricted Keys (scoped, narrower-permission tokens). API keys are the standard auth credential for SDK and REST API access; Restr...

Runloop Executions Streaming API

Stream stdout and stderr updates from in-flight Devbox executions in real time. Use alongside the Devbox execute endpoints for long-running command output capture.

Collections

Runloop Agents API

POSTMAN

Runloop API Keys API

POSTMAN

Runloop Axons API

POSTMAN

Runloop Benchmark API

POSTMAN

Runloop Blueprint API

POSTMAN

Runloop Devbox API

POSTMAN

Runloop Executions API

POSTMAN

Runloop Gateway Configs API

POSTMAN

Runloop MCP Configs API

POSTMAN

Runloop Network Policies API

POSTMAN

Runloop Objects API

POSTMAN

Runloop Scenario API

POSTMAN

Runloop Secrets API

POSTMAN

Runloop Agents API

OPEN

RunLoop API

OPEN

Runloop API Keys API

OPEN

Runloop Axons API

OPEN

Runloop Benchmark API

OPEN

Runloop Blueprint API

OPEN

Runloop Devbox API

OPEN

Runloop Executions API

OPEN

Runloop Gateway Configs API

OPEN

Runloop MCP Configs API

OPEN

Runloop Network Policies API

OPEN

Runloop Objects API

OPEN

Runloop Scenario API

OPEN

Runloop Secrets API

OPEN

Arazzo Workflows

Runloop Bootstrap a Devbox from an Object Artifact

Create and complete a storage object, generate its download URL, then boot a devbox and pull the artifact into it.

ARAZZO

Runloop Build Blueprint and Launch Devbox

Build a custom blueprint image, poll until the build completes, then launch a devbox from it and wait for running.

ARAZZO

Runloop Create Scenario and Run It

Define a repeatable AI coding evaluation scenario, start a run of it, poll until it is scored, then complete the run.

ARAZZO

Runloop Graceful Snapshot and Shutdown

Synchronously snapshot a running devbox's disk to preserve its state, then permanently shut the devbox down.

ARAZZO

Runloop Provision Devbox and Run a Command

Create a devbox, wait for it to reach running, then execute a shell command asynchronously and wait for completion.

ARAZZO

Runloop Publish an Object Artifact

Create a storage object, mark its upload complete to make it read-only, then generate a presigned download URL for it.

ARAZZO

Runloop Score a Running Scenario Run

Start a run of an existing scenario, wait for it to be running, trigger scoring, then complete the run.

ARAZZO

Runloop Snapshot and Restore a Devbox

Take an asynchronous disk snapshot of a running devbox, poll until it completes, then launch a new devbox from that snapshot.

ARAZZO

Runloop Suspend and Resume a Devbox

Suspend a running devbox to free compute, wait until it is suspended, then resume it and wait until it is running again.

ARAZZO

Runloop Write, Execute, and Read a File on a Devbox

Boot a devbox, write a file into it, run a command that transforms the file, then read the resulting contents back.

ARAZZO

Pricing Plans

Runloop Ai Plans Pricing

4 plans

PLANS

Rate Limits

Runloop Ai Rate Limits

0 limits

RATE LIMITS

FinOps

Runloop Ai Finops

FINOPS

Semantic Vocabularies

Runloop Context

52 classes · 19 properties

JSON-LD

API Governance Rules

Runloop API Rules

8 rules · 1 errors 5 warnings

SPECTRAL

JSON Structure

Runloop Devbox Structure

8 properties

JSON STRUCTURE

Example Payloads

Runloop Axon Subscribe Example

2 fields

EXAMPLE

Runloop Benchmark Run Example

2 fields

EXAMPLE

Runloop Devbox Create Example

2 fields

EXAMPLE

Runloop Devbox Exec Example

2 fields

EXAMPLE

Runloop Snapshot Create Example

2 fields

EXAMPLE

Resources

PostmanWorkspace

PostmanWorkspace

Documentation

APIReference

SpectralRules

ContactSales

Documentation

Documentation

Documentation

Documentation

PythonPackage

Sources

opencollection: 1.0.0
info:
  name: Runloop Secrets API
  version: '0.1'
request:
  auth:
    type: bearer
    token: '{{bearerToken}}'
items:
- info:
    name: secrets
    type: folder
  items:
  - info:
      name: List Secrets.
      type: http
    http:
      method: GET
      url: https://api.runloop.ai/v1/secrets
      params:
      - name: limit
        value: ''
        type: query
        description: The limit of items to return. Default is 20. Max is 5000.
    docs: List all Secrets for the authenticated account. Secret values are not included for security reasons.
  - info:
      name: Create a Secret.
      type: http
    http:
      method: POST
      url: https://api.runloop.ai/v1/secrets
      body:
        type: json
        data: '{}'
    docs: Create a new Secret with a globally unique name and value. The Secret will be encrypted at rest and made available
      as an environment variable in Devboxes.
  - info:
      name: Get a Secret.
      type: http
    http:
      method: GET
      url: https://api.runloop.ai/v1/secrets/:name
      params:
      - name: name
        value: ''
        type: path
        description: The name of the Secret to retrieve.
    docs: Retrieve a Secret by name. The secret value is not included for security.
  - info:
      name: Update a Secret.
      type: http
    http:
      method: POST
      url: https://api.runloop.ai/v1/secrets/:name
      params:
      - name: name
        value: ''
        type: path
        description: The name of the Secret to update.
      body:
        type: json
        data: '{}'
    docs: Update the value of an existing Secret by name. The new value will be encrypted at rest.
  - info:
      name: Delete a Secret.
      type: http
    http:
      method: POST
      url: https://api.runloop.ai/v1/secrets/:name/delete
      params:
      - name: name
        value: ''
        type: path
        description: The name of the Secret to delete.
      body:
        type: json
        data: '{}'
    docs: Delete an existing Secret by name. This action is irreversible and will remove the Secret from all Devboxes.
bundled: true