Codecov Evaluations API

The Evaluations API from Codecov — 2 operation(s) for evaluations.

Operations 2

GET /{service}/{owner_username}/repos/{repo_name}/evals/compare/ Evaluation compare #
GET /{service}/{owner_username}/repos/{repo_name}/evals/summary/ Evaluation summary #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/codecov:codecov-evaluations-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

codecov-evaluations-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Codecov Evaluations API
  version: 2.0.0
  description: Public Codecov API
servers:
- url: https://api.codecov.io/api/v2/
tags:
- name: Evaluations
paths:
  /{service}/{owner_username}/repos/{repo_name}/evals/compare/:
    get:
      operationId: repos_evals_compare_retrieve
      description: Returns a comparison of evaluations between two commits
      summary: Evaluation compare
      parameters:
      - in: query
        name: base_sha
        schema:
          type: string
        description: base commit SHA to compare from
      - in: query
        name: head_sha
        schema:
          type: string
        description: head commit SHA to compare to
      - in: path
        name: owner_username
        schema:
          type: string
        description: username from service provider
        required: true
      - in: path
        name: repo_name
        schema:
          type: string
        description: repository name
        required: true
      - in: path
        name: service
        schema:
          type: string
          enum:
          - bitbucket
          - bitbucket_server
          - github
          - github_enterprise
          - gitlab
          - gitlab_enterprise
        description: Git hosting service provider
        required: true
      tags:
      - Evaluations
      security:
      - tokenAuth: []
      responses:
        '200':
          description: No response body
  /{service}/{owner_username}/repos/{repo_name}/evals/summary/:
    get:
      operationId: repos_evals_summary_retrieve
      description: Returns a summary of evaluations for the specified repository and commit
      summary: Evaluation summary
      parameters:
      - in: query
        name: classname
        schema:
          type: string
        description: class name the test belongs to, or `describe` block in vitest, or run name in langfuse
      - in: query
        name: commit
        schema:
          type: string
        description: commit SHA for which to return evaluation summary
      - in: path
        name: owner_username
        schema:
          type: string
        description: username from service provider
        required: true
      - in: path
        name: repo_name
        schema:
          type: string
        description: repository name
        required: true
      - in: path
        name: service
        schema:
          type: string
          enum:
          - bitbucket
          - bitbucket_server
          - github
          - github_enterprise
          - gitlab
          - gitlab_enterprise
        description: Git hosting service provider
        required: true
      tags:
      - Evaluations
      security:
      - tokenAuth: []
      responses:
        '200':
          description: No response body
components:
  securitySchemes:
    tokenAuth:
      type: http
      scheme: bearer
x-provenance:
  method: searched
  source: https://docs.codecov.com/reference
  harvested: '2026-10-26'
  tool: harvest-readme-openapi.py
  note: Assembled verbatim from the OpenAPI definition ReadMe embeds in each operation page of the provider's developer portal; paths and components merged by API title, nothing authored.
  assembled_from:
  - https://docs.codecov.com/reference/repos_branches_list.md
  - https://docs.codecov.com/reference/repos_branches_retrieve.md
  - https://docs.codecov.com/reference/repos_commits_list.md
  - https://docs.codecov.com/reference/repos_commits_retrieve.md
  - https://docs.codecov.com/reference/repos_commits_uploads_list.md
  - https://docs.codecov.com/reference/repos_compare_components_retrieve.md
  - https://docs.codecov.com/reference/repos_compare_file_retrieve.md
  - https://docs.codecov.com/reference/repos_compare_flags_retrieve.md
  - https://docs.codecov.com/reference/repos_compare_impacted_files_retrieve.md
  - https://docs.codecov.com/reference/repos_compare_retrieve.md
  - https://docs.codecov.com/reference/repos_compare_segments_retrieve.md
  - https://docs.codecov.com/reference/repos_components_list.md
  - https://docs.codecov.com/reference/repos_config_retrieve.md
  - https://docs.codecov.com/reference/repos_coverage_list.md
  - https://docs.codecov.com/reference/repos_evals_compare_retrieve-1.md
  - https://docs.codecov.com/reference/repos_evals_summary_retrieve-1.md
  - https://docs.codecov.com/reference/repos_file_report_retrieve.md
  - https://docs.codecov.com/reference/repos_flags_coverage_list.md
  - https://docs.codecov.com/reference/repos_flags_list.md
  - https://docs.codecov.com/reference/repos_list.md
  - https://docs.codecov.com/reference/repos_pulls_list.md
  - https://docs.codecov.com/reference/repos_pulls_retrieve.md
  - https://docs.codecov.com/reference/repos_report_retrieve.md
  - https://docs.codecov.com/reference/repos_report_tree_retrieve.md
  - https://docs.codecov.com/reference/repos_retrieve.md
  - https://docs.codecov.com/reference/repos_test_analytics_list-1.md
  - https://docs.codecov.com/reference/repos_test_results_list.md
  - https://docs.codecov.com/reference/repos_test_results_retrieve.md
  - https://docs.codecov.com/reference/repos_totals_retrieve.md
  - https://docs.codecov.com/reference/root_list.md
  - https://docs.codecov.com/reference/root_retrieve.md
  - https://docs.codecov.com/reference/user_sessions_list.md
  - https://docs.codecov.com/reference/users_list.md
  - https://docs.codecov.com/reference/users_partial_update.md
  - https://docs.codecov.com/reference/users_retrieve.md
  merge:
    pages: 35
    deduped: 98
    conflicts_kept_first: 0