Scorecard

Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics, and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs, Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node, and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by Kindred Ventures.

Scorecard publishes 7 APIs on the APIs.io network, including Metrics API, Projects API, Records API, and 4 more. Tagged areas include Company, AI, Agents, Evaluation, and Testing.

Scorecard’s developer surface includes documentation, API reference, getting-started guide, engineering blog, pricing, signup flow, changelog, and 21 more developer resources.

🌐 Visit website 📡 Source on GitHub
55.3/100 developing ▬ flat Agent 65/100 agent native Full breakdown ↓
scored 2026-07-23 · rubric v0.5
AccessSelf serve
7 APIs 1 MCP Servers
CompanyAIAgentsEvaluationTestingLLMObservabilitySimulationDeveloper ToolsMCP

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-07-23 · rubric v0.5
Composite quality — 55.3/100 · developing
Contract Quality 14.5 / 25
Developer Ergonomics 13.9 / 20
Commercial Clarity 12.1 / 20
Operational Transparency 4.8 / 13
Governance 0.0 / 12
Discoverability 10.0 / 10
Agent readiness — 65/100 · agent native
Machine-Readable Contract 18 / 18
Agentic Access Contract 15 / 15
MCP Server 12 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 8 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 0 / 7
Typed Event Surface 0 / 6
Agent Skills 5 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/scorecard: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 7

Individual APIs this provider publishes, each with its own machine-readable definition.

Scorecard Metrics API

The Metrics API from Scorecard — 1 operation(s) for metrics.

Scorecard Projects API

The Projects API from Scorecard — 5 operation(s) for projects.

Scorecard Records API

The Records API from Scorecard — 5 operation(s) for records.

Scorecard Runs API

The Runs API from Scorecard — 2 operation(s) for runs.

Scorecard Systems API

The Systems API from Scorecard — 3 operation(s) for systems.

Scorecard Testcases API

The Testcases API from Scorecard — 2 operation(s) for testcases.

Scorecard Testsets API

The Testsets API from Scorecard — 2 operation(s) for testsets.

Scroll for all 7

MCP Servers 1

Model Context Protocol servers that expose these APIs to AI agents.

scorecard-mcp.yml

MCP SERVER

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Scorecard Authentication

http · 1 scheme

SECURITY

Scorecard Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Scorecard Trust Center

SOC 2

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Scorecard Agentic Access

35 operations · 20 acting

35 operations · 20 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

DeveloperPortal
DeveloperPortal
 GettingStarted
GettingStarted
 SignUp
SignUp

Documentation 2

Reference material describing how the API behaves

Documentation
Documentation
 APIReference
APIReference

Agent Surfaces 4

MCP servers, agent skills, and machine-readable catalogs

MCPServer
MCPServer
 LLMsTxt
LLMsTxt
 AgenticAccess
AgenticAccess
 AgentSkill
AgentSkill

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

Conventions
Conventions
 ErrorCatalog
ErrorCatalog
 Lifecycle
Lifecycle
 Conformance
Conformance
 DataModel
DataModel

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 Packages
Packages
 SDKs
SDKs

Access & Security 4

Authentication, authorization, and security posture

TrustCenter
TrustCenter
 DomainSecurity
DomainSecurity
 Compliance
Compliance
 Authentication
Authentication

Operate 2

Status, limits, changes, and where to get help

StatusPage
StatusPage
 ChangeLog
ChangeLog

Commercial 3

Pricing, plans, and the legal terms of use

Pricing
Pricing
 TermsOfService
TermsOfService
 PrivacyPolicy
PrivacyPolicy

Company 2

The organization behind the API

Website
Website
 Blog
Blog

Source (apis.yml)

apis.yml Raw ↑ 
aid: scorecard
name: Scorecard
description: Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams
  run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics,
  and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs,
  Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node,
  and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a
  GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by
  Kindred Ventures.
url: https://raw.githubusercontent.com/api-evangelist/scorecard/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- kindred-ventures
accessModel:
  pricing: unknown
  onboarding: self-serve
  trial: false
  try_now: false
  public: false
  label: Self-serve signup
  confidence: medium
  source:
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://cdn.prod.website-files.com/68012f5eeeda4ace0fca1c46/680be2472e0c42225eb5c6fb_bb737b32df1d17f3492808c99d78bb0b_scorecard-open-graph.jpg
specificationVersion: '0.20'
created: '2026-07-17'
modified: '2026-07-21'
tags:
- Company
- AI
- Agents
- Evaluation
- Testing
- LLM
- Observability
- Simulation
- Developer Tools
- MCP
apis:
- aid: scorecard:scorecard-metrics-api
  name: Scorecard Metrics API
  description: The Metrics API from Scorecard — 1 operation(s) for metrics.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Metrics
  properties:
  - type: OpenAPI
    url: openapi/scorecard-metrics-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-projects-api
  name: Scorecard Projects API
  description: The Projects API from Scorecard — 5 operation(s) for projects.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/scorecard-projects-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-records-api
  name: Scorecard Records API
  description: The Records API from Scorecard — 5 operation(s) for records.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Records
  properties:
  - type: OpenAPI
    url: openapi/scorecard-records-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-runs-api
  name: Scorecard Runs API
  description: The Runs API from Scorecard — 2 operation(s) for runs.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Runs
  properties:
  - type: OpenAPI
    url: openapi/scorecard-runs-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-systems-api
  name: Scorecard Systems API
  description: The Systems API from Scorecard — 3 operation(s) for systems.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Systems
  properties:
  - type: OpenAPI
    url: openapi/scorecard-systems-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-testcases-api
  name: Scorecard Testcases API
  description: The Testcases API from Scorecard — 2 operation(s) for testcases.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Testcases
  properties:
  - type: OpenAPI
    url: openapi/scorecard-testcases-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-testsets-api
  name: Scorecard Testsets API
  description: The Testsets API from Scorecard — 2 operation(s) for testsets.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Testsets
  properties:
  - type: OpenAPI
    url: openapi/scorecard-testsets-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
x-enrichment:
  date: '2026-07-21'
  status: enriched
  artifacts_added: 18
  pass: local-v1
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: TrustCenter
  url: security/scorecard-trust-center.yml
- type: DomainSecurity
  url: security/scorecard-domain-security.yml
- type: Website
  url: https://www.scorecard.io/
- type: DeveloperPortal
  url: https://docs.scorecard.io/
- type: Documentation
  url: https://docs.scorecard.io/
- type: APIReference
  url: https://docs.scorecard.io/api-reference/overview
- type: GettingStarted
  url: https://docs.scorecard.io/intro/sdk-quickstart
- type: Blog
  url: https://www.scorecard.io/blog
- type: Pricing
  url: https://www.scorecard.io/pricing
- type: SignUp
  url: https://app.getscorecard.ai/
- type: TermsOfService
  url: https://www.scorecard.io/terms-of-service
- type: PrivacyPolicy
  url: https://www.scorecard.io/privacy-policy
- type: GitHubOrganization
  url: https://github.com/scorecard-ai
- type: StatusPage
  url: https://status.scorecard.io/
- type: ChangeLog
  url: https://docs.scorecard.io/changelog
- type: Compliance
  url: https://trust.scorecard.io/
- type: MCPServer
  url: mcp/scorecard-mcp.yml
- type: Packages
  url: packages/scorecard-packages.yml
- type: SDKs
  url: packages/scorecard-packages.yml
- type: LLMsTxt
  url: llms/scorecard-llms.txt
- type: Authentication
  url: authentication/scorecard-authentication.yml
- type: Conventions
  url: conventions/scorecard-conventions.yml
- type: ErrorCatalog
  url: errors/scorecard-problem-types.yml
- type: Lifecycle
  url: lifecycle/scorecard-lifecycle.yml
- type: Conformance
  url: conformance/scorecard-conformance.yml
- type: DataModel
  url: data-model/scorecard-data-model.yml
- type: AgenticAccess
  url: agentic-access/scorecard-agentic-access.yml
- type: AgentSkill
  url: skills/_index.yml