Scorecard website screenshot

Scorecard

Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics, and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs, Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node, and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by Kindred Ventures.

Scorecard publishes 7 APIs on the APIs.io network, including Metrics API, Projects API, Records API, and 4 more. Tagged areas include Company, Artificial Intelligence, Agents, Evaluation, and Testing.

Scorecard’s developer surface includes documentation, API reference, getting-started guide, engineering blog, pricing, signup flow, changelog, and 22 more developer resources.

🌐 Visit website 📡 Source on GitHub
50.2/100 developing ▬ flat Agent 41/100 agent native saas Full breakdown ↓
scored 2026-09-06 · rubric v0.19.0
1 APIs 1 MCP Servers
CompanyArtificial IntelligenceAgentsEvaluationTestingLLMObservabilitySimulationDeveloper ToolsMCP

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-09-06 · rubric v0.19.0
Composite quality — 50.2/100 · developing
Contract Quality 14.3 / 25
Developer Ergonomics 12.3 / 20
Access Clarity 12.1 / 20
Operational Transparency 3.4 / 13
Contract Governance 0.5 / 12
Discoverability 7.6 / 10
Agent readiness — 41/100 · agent native
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
Documented Reversibility 0 / 6
MCP Server 12 / 12
Machine-Readable Auth 10 / 10
Idempotency 9 / 9
Stable Error Semantics 8 / 8
Request/Response Examples 7 / 7
Rate-Limit Signaling 0 / 7
Typed Event Surface 0 / 6
Agent Skills 5 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Delegated User Identity 0 / 6
Protected Resource Metadata 0 / 5
Registration Without a Human 0 / 6
Agentic Commerce Well-Known Document 0 / 5
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/scorecard: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 7

Individual APIs this provider publishes, each with its own machine-readable definition.

Scorecard Metrics API

The Metrics API from Scorecard — 1 operation(s) for metrics.

Scorecard Projects API

The Projects API from Scorecard — 5 operation(s) for projects.

Scorecard Records API

The Records API from Scorecard — 5 operation(s) for records.

Scorecard Runs API

The Runs API from Scorecard — 2 operation(s) for runs.

Scorecard Systems API

The Systems API from Scorecard — 3 operation(s) for systems.

Scorecard Testcases API

The Testcases API from Scorecard — 2 operation(s) for testcases.

Scorecard Testsets API

The Testsets API from Scorecard — 2 operation(s) for testsets.

Scroll for all 7

Open Collections 8

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Scorecard Metrics API

OPEN COLLECTION

Scorecard Metrics Projects API

OPEN COLLECTION

Scorecard Metrics Records API

OPEN COLLECTION

Scorecard Metrics Runs API

OPEN COLLECTION

Scorecard Metrics Systems API

OPEN COLLECTION

Scorecard Metrics Testcases API

OPEN COLLECTION

Scorecard Metrics Testsets API

OPEN COLLECTION

Scroll for all 8

MCP Servers 1

Model Context Protocol servers that expose these APIs to AI agents.

Scorecard MCP Server

MCP SERVER

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Scorecard Authentication

http · 1 scheme

SECURITY

Scorecard Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Scorecard Trust Center

SOC 2

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Scorecard Agentic Access

35 operations · 20 acting

35 operations · 20 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

DeveloperPortal
DeveloperPortal
 GettingStarted
GettingStarted
 SignUp
SignUp

Documentation 2

Reference material describing how the API behaves

Documentation
Documentation
 APIReference
APIReference

Agent Surfaces 4

MCP servers, agent skills, and machine-readable catalogs

MCPServer
MCPServer
 LLMsTxt
LLMsTxt
 AgenticAccess
AgenticAccess
 AgentSkill
AgentSkill

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

Conventions
Conventions
 ErrorCatalog
ErrorCatalog
 Lifecycle
Lifecycle
 Conformance
Conformance
 DataModel
DataModel

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 Packages
Packages
 SDKs
SDKs

Access & Security 4

Authentication, authorization, and security posture

TrustCenter
TrustCenter
 DomainSecurity
DomainSecurity
 Compliance
Compliance
 Authentication
Authentication

Operate 2

Status, limits, changes, and where to get help

StatusPage
StatusPage
 ChangeLog
ChangeLog

Commercial 3

Pricing, plans, and the legal terms of use

Pricing
Pricing
 TermsOfService
TermsOfService
 PrivacyPolicy
PrivacyPolicy

Company 2

The organization behind the API

Website
Website
 Blog
Blog

Other 1

Properties that don't map to a standard resource type

Overlay
Overlay

Source (apis.yml)

apis.yml Raw ↑ 
aid: scorecard
name: Scorecard
description: Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams
  run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics,
  and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs,
  Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node,
  and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a
  GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by
  Kindred Ventures.
url: https://raw.githubusercontent.com/api-evangelist/scorecard/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- kindred-ventures
deliveryModel:
  model: saas
  open_source: false
  commercial: true
  callable_host: true
  label: Hosted service · you call their endpoint
  confidence: high
  source:
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source:
  - authentication
  - security
  generated: '2026-09-03'
  method: derived
image: https://cdn.prod.website-files.com/68012f5eeeda4ace0fca1c46/680be2472e0c42225eb5c6fb_bb737b32df1d17f3492808c99d78bb0b_scorecard-open-graph.jpg
specificationVersion: '0.23'
created: '2026-07-17'
modified: '2026-07-21'
tags:
- Company
- Artificial Intelligence
- Agents
- Evaluation
- Testing
- LLM
- Observability
- Simulation
- Developer Tools
- MCP
tags_raw:
- Company
- AI
- Agents
- Evaluation
- Testing
- LLM
- Observability
- Simulation
- Developer Tools
- MCP
apis:
- aid: scorecard:scorecard-metrics-api
  name: Scorecard Metrics API
  description: The Metrics API from Scorecard — 1 operation(s) for metrics.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Metrics
  properties:
  - type: OpenAPI
    url: openapi/scorecard-metrics-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-projects-api
  name: Scorecard Projects API
  description: The Projects API from Scorecard — 5 operation(s) for projects.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Project
  tags_raw:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/scorecard-projects-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-records-api
  name: Scorecard Records API
  description: The Records API from Scorecard — 5 operation(s) for records.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Records
  properties:
  - type: OpenAPI
    url: openapi/scorecard-records-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-runs-api
  name: Scorecard Runs API
  description: The Runs API from Scorecard — 2 operation(s) for runs.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Runs
  properties:
  - type: OpenAPI
    url: openapi/scorecard-runs-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-systems-api
  name: Scorecard Systems API
  description: The Systems API from Scorecard — 3 operation(s) for systems.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Systems
  properties:
  - type: OpenAPI
    url: openapi/scorecard-systems-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-testcases-api
  name: Scorecard Testcases API
  description: The Testcases API from Scorecard — 2 operation(s) for testcases.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Test Cases
  tags_raw:
  - Testcases
  properties:
  - type: OpenAPI
    url: openapi/scorecard-testcases-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-testsets-api
  name: Scorecard Testsets API
  description: The Testsets API from Scorecard — 2 operation(s) for testsets.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Testsets
  properties:
  - type: OpenAPI
    url: openapi/scorecard-testsets-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
x-enrichment:
  date: '2026-07-21'
  status: enriched
  artifacts_added: 18
  pass: local-v1
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: Overlay
  url: overlays/scorecard-openapi-overlay.yaml
- type: TrustCenter
  url: security/scorecard-trust-center.yml
- type: DomainSecurity
  url: security/scorecard-domain-security.yml
- type: Website
  url: https://www.scorecard.io/
- type: DeveloperPortal
  url: https://docs.scorecard.io/
- type: Documentation
  url: https://docs.scorecard.io/
- type: APIReference
  url: https://docs.scorecard.io/api-reference/overview
- type: GettingStarted
  url: https://docs.scorecard.io/intro/sdk-quickstart
- type: Blog
  url: https://www.scorecard.io/blog
- type: Pricing
  url: https://www.scorecard.io/pricing
- type: SignUp
  url: https://app.getscorecard.ai/
- type: TermsOfService
  url: https://www.scorecard.io/terms-of-service
- type: PrivacyPolicy
  url: https://www.scorecard.io/privacy-policy
- type: GitHubOrganization
  url: https://github.com/scorecard-ai
- type: StatusPage
  url: https://status.scorecard.io/
- type: ChangeLog
  url: https://docs.scorecard.io/changelog
- type: Compliance
  url: https://trust.scorecard.io/
- type: MCPServer
  url: mcp/scorecard-mcp.yml
- type: Packages
  url: packages/scorecard-packages.yml
- type: SDKs
  url: packages/scorecard-packages.yml
- type: LLMsTxt
  url: llms/scorecard-llms.txt
- type: Authentication
  url: authentication/scorecard-authentication.yml
- type: Conventions
  url: conventions/scorecard-conventions.yml
- type: ErrorCatalog
  url: errors/scorecard-problem-types.yml
- type: Lifecycle
  url: lifecycle/scorecard-lifecycle.yml
- type: Conformance
  url: conformance/scorecard-conformance.yml
- type: DataModel
  url: data-model/scorecard-data-model.yml
- type: AgenticAccess
  url: agentic-access/scorecard-agentic-access.yml
- type: AgentSkill
  url: skills/_index.yml

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this
  • find_providersBrowse and filter every provider in the catalog.
  • get_provider_artifactsEvery artifact this provider publishes, grouped by type.
  • get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
  • get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
  • get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
  • get_provider_ratingPRO — composite, band, trend and facet scores.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This provider 
curl "https://apis.io/api/v1/providers/scorecard"
All providers 
curl "https://apis.io/api/v1/providers?limit=25"
Every operation they expose 
curl "https://apis.io/api/v1/providers/scorecard/operations?limit=25"
How their score was established 
curl "https://apis.io/api/v1/providers/scorecard/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.