POST
/benchmark
Creates a benchmark.
POST
/benchmark/{benchmarkId}/participants
Creates a participant in a benchmark.
GET
/benchmark/{benchmarkId}/participants
Queries all participants within a benchmark.
POST
/benchmark/{benchmarkId}/prompt
Adds a new prompt to a benchmark.
DELETE
/benchmark/{benchmarkId}
Deletes a benchmark.
GET
/benchmark/{benchmarkId}
Returns a single benchmark by its id.
PATCH
/benchmark/{benchmarkId}
Updates a benchmark using patch semantics.
DELETE
/benchmark/{benchmarkId}/participant/{participantId}
Deletes a participant on a benchmark.
POST
/benchmark/{benchmarkId}/fork
Creates a copy of a public benchmark and all of its related entities.
GET
/benchmark/{benchmarkId}/prompts
Returns the paged prompts of a benchmark.
GET
/benchmarks
Queries all benchmarks of the current user.
GET
/benchmark/combined-matrix/query
Queries the combined win matrix of multiple benchmarks.
GET
/benchmark/combined-standings/query
Queries the combined standings of multiple benchmarks.
GET
/benchmark/{benchmarkId}/leaderboards
Queries all leaderboards for the given benchmark.
GET
/benchmarks/managed
Queries the curated benchmarks available to every customer.
GET
/benchmark/{benchmarkId}/matrix/query
Queries the win matrix of a benchmark.
GET
/benchmarks/published
Queries the benchmarks surfaced in the public benchmark repository.
GET
/benchmark/{benchmarkId}/standings/query
Queries the standings of a benchmark.
GET
/benchmark/{benchmarkId}/tags
Queries all tags within a benchmark.
POST
/benchmark/{benchmarkId}/sample-generation
Starts an asynchronous sample generation run.
POST
/benchmark/{benchmarkId}/participants/{participantId}/submit
Submits a participant to a benchmark.
PUT
/benchmark/{benchmarkId}/name
Updates the name of a benchmark.