Runloop

Runloop Benchmark API

The Benchmark API from Runloop — 25 operation(s) for benchmark.

Documentation GitHub OpenAPI

Operations 28

POST /v1/benchmark_jobs [Beta] Create a BenchmarkJob #

GET /v1/benchmark_jobs [Beta] List BenchmarkJobs #

GET /v1/benchmark_jobs/{id} [Beta] Get a previously created BenchmarkJob #

GET /v1/benchmark_runs List BenchmarkRuns #

GET /v1/benchmark_runs/{id} Get a previously created BenchmarkRun #

POST /v1/benchmark_runs/{id}/cancel Cancel a currently running Benchmark run #

POST /v1/benchmark_runs/{id}/complete Complete a BenchmarkRun #

POST /v1/benchmark_runs/{id}/download_logs Download logs for a Benchmark run #

GET /v1/benchmark_runs/{id}/scenario_runs List started scenario runs for a benchmark run #

POST /v1/benchmarks Create a Benchmark #

GET /v1/benchmarks List Benchmarks #

GET /v1/benchmarks/list_public List Public Benchmarks #

GET /v1/benchmarks/metadata/keys List available benchmark metadata keys #

GET /v1/benchmarks/metadata/keys/{key}/values List values for a specific benchmark metadata key #

GET /v1/benchmarks/runs List BenchmarkRuns #

GET /v1/benchmarks/runs/{id} Get a previously created BenchmarkRun #

POST /v1/benchmarks/runs/{id}/cancel Cancel a currently running Benchmark run #

POST /v1/benchmarks/runs/{id}/complete Complete a BenchmarkRun #

POST /v1/benchmarks/runs/{id}/download_logs Download logs for a Benchmark run #

GET /v1/benchmarks/runs/{id}/scenario_runs List started scenario runs for a benchmark run #

POST /v1/benchmarks/start_run Start a new BenchmarkRun #

POST /v1/benchmarks/{id} Update a Benchmark #

GET /v1/benchmarks/{id} Get a Benchmark #

POST /v1/benchmarks/{id}/archive Archive a Benchmark #

GET /v1/benchmarks/{id}/definitions Get scenario definitions for a Benchmark #

GET /v1/benchmarks/{id}/runs Get runs for a provided Benchmark #

POST /v1/benchmarks/{id}/scenarios Modify scenarios for a Benchmark #

POST /v1/benchmarks/{id}/unarchive Unarchive a Benchmark #

Documentation

https://docs.runloop.ai/docs/devboxes/overview

https://docs.runloop.ai/docs/devboxes/lifecycle

https://docs.runloop.ai/docs/devboxes/execute-commands

https://docs.runloop.ai/docs/devboxes/files

https://docs.runloop.ai/docs/devboxes/named-shells

https://docs.runloop.ai/docs/devboxes/snapshots

https://docs.runloop.ai/docs/devboxes/start-stop

https://docs.runloop.ai/docs/devboxes/tunnels

https://docs.runloop.ai/docs/devboxes/blueprints/overview

https://docs.runloop.ai/docs/benchmarks/overview

https://docs.runloop.ai/docs/devboxes/agents/using-agents-api

https://docs.runloop.ai/docs/axons/overview

https://docs.runloop.ai/docs/axons/broker

https://docs.runloop.ai/docs/storage-objects/overview

https://docs.runloop.ai/docs/devboxes/configuration/account-secrets

https://docs.runloop.ai/docs/network-policies

https://docs.runloop.ai/docs/devboxes/agent-gateways

https://docs.runloop.ai/docs/tools/ai-tools

https://docs.runloop.ai/api-reference/apikeys/create-api-key

https://docs.runloop.ai/docs/devboxes/execution-logs

Specifications

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/openapi/runloop-ai-benchmark-api-openapi.yml

Schemas & Data

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-devbox-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-execution-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-snapshot-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-tunnel-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-launch-parameters-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-structure/runloop-devbox-structure.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-blueprint-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-benchmark-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-benchmark-run-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-scenario-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-agent-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-axon-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-object-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-secret-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-network-policy-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-gateway-config-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-mcp-config-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-api-key-schema.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-schema/runloop-restricted-key-schema.json

Other Resources

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/json-ld/runloop-context.jsonld

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/examples/runloop-devbox-create-example.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/examples/runloop-devbox-exec-example.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/examples/runloop-snapshot-create-example.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/examples/runloop-benchmark-run-example.json

https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/examples/runloop-axon-subscribe-example.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/runloop-ai:runloop-ai-benchmark-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: RunLoop Benchmark API
  version: '0.1'
  description: The RunLoop API spec that allows you to host lambda functions and Devboxes to enable scaled long running ai workflows.
  contact:
    name: Runloop AI Support
    url: https://runloop.ai
    email: support@runloop.ai
servers:
- url: https://api.runloop.ai
  description: Runloop API
  variables: {}
security:
- bearerAuth: []
tags:


# --- truncated at 32 KB (84 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/openapi/runloop-ai-benchmark-api-openapi.yml