Scorecard

Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics, and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs, Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node, and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by Kindred Ventures.

Scorecard publishes 7 API contracts indexed on the APIs.io network, including Metrics API, Projects API, Records API, and 4 more. Tagged areas include Company, Artificial Intelligence, Agents, Evaluation, and Testing.

The Scorecard catalog on APIs.io includes 1 Spectral governance ruleset.

Scorecard’s developer surface includes documentation, API reference, getting-started guide, engineering blog, pricing, signup flow, changelog, and 24 more developer resources.

🌐 Visit website 📡 Profile data on GitHub

62.7/100 strong ▬ flat Agent 50/100 agent ready Front door AI 5/6 prominent Heartbeat 90/100 alive saas Full breakdown ↓
scored 2026-11-06 · rubric v0.27.0 · Show this score on your site →

AccessFreemiumSelf serve⚡ Free to try

1 published contract 1 MCP Servers 2 Agent Skills

Company Artificial Intelligence Agents Evaluation Testing LLM Observability Simulation Developer Tools MCP

What this lets a business do 2

Business capabilities this provider's published APIs can perform, derived from its own contracts. Browse all capabilities →

Agent Infrastructure & Agentic Commerce

AE-100

MetricsRecordsRuns

GET /metrics/{metricId} GET /runs/{runId} POST /runs/{runId}/records GET /records/{recordId}/annotations

Software Product Engineering Management

BC-4200

Test CasesTest Sets

GET /testcases/{testcaseId} POST /testcases/bulk-delete GET /testsets/{testsetId} GET /testsets/{testsetId}/testcases

Kin Score

Kin Score How this is scored →
scored 2026-11-06 · rubric v0.27.0

Composite quality — 62.7/100 · strong

Contract Quality 9.6 / 19

Developer Ergonomics 9.2 / 15

Access Clarity 15.0 / 15

Operational Transparency 2.6 / 10

Contract Governance 1.6 / 9

Discoverability 5.6 / 8

Regulatory Posture 4.1 / 15

Create-or-Update Ergonomics 3.3 / 10

Agent readiness — 50/100 · agent ready

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 12 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 8 / 8

Request/Response Examples 7 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 0 / 6

Agent Skills 5 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 6 / 6

Protected Resource Metadata 5 / 5

Registration Without a Human 6 / 6

Agentic Commerce Well-Known Document 0 / 5

Pagination 5 / 5

Distinct Operations 3 / 3

MCP Tool Quality 6 / 6

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

The six quality facets above are damped to 75 points between them, because the conditional facet above carries the other 25. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 75% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Show this score on your site.

It updates itself when the score changes. Paste this where you link to your API docs:

<a href="https://apis.io/providers/scorecard/"><img src="https://apis.io/badge/scorecard/card.svg" alt="Scorecard on APIs.io — Kin Score by API Evangelist"></a>

Other styles, a README pill and a shields.io endpoint are on the badge page.

Raise your score.

Agent readiness — checks not met, largest first (exact, from this profile):

Idempotency +9 pts — OpenAPI mutating operations declare an idempotency key — a header, a request-body property, or a named de-duplication token whose own description says so (verified); else common[].type matches /idempoten/i (documented)
A2A Agent Card +8 pts — a2a/-a2a.yml manifest, graded on conformance.grade against A2A 1.0.0
Rate-Limit Signaling +7 pts — OpenAPI responses document X-RateLimit-* / RateLimit headers (verified), else a rate_limits artifact or RateLimits link (documented)
Typed Event Surface +6 pts — AsyncAPI document, OR webhooks/callbacks objects in the as-published OpenAPI, OR common[].type includes Webhooks
Documented Reversibility +6 pts — a reversal operation in the contract, graded up when a window is documented too
Agentic Commerce Well-Known Document +5 pts — a parsing /.well-known/ucp.json or acp.json declaring a version and at least one service, OR (0.27) a live x402 payment challenge from _data/x402-adoption.json — `self` when its endpoints are on the provider's own domain, `platform` when they are on a vendor's

3 more unmet checks in the Agent Readiness table above.

Kin Score — facets with the most composite points still available (weight × headroom):

Contract Quality scores 51.4 — up to +12.2 composite points
Contract Governance scores 18.2 — up to +9.8 composite points
Operational Transparency scores 26.3 — up to +9.6 composite points

Each check links to what satisfies it. Publish the artifact, or tell us where it already lives, and the score moves on the next scoring run.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from the provider profile at artifacts.apis.io/scorecard/apis.yml: open an issue on github.com/api-evangelist/scorecard to ask a question or point us at an artifact you publish. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Standards implemented 4

Standards this provider implements or carries. De facto ones are profiled and measured by the API Commons; formal ones come from the standards directory and are linked by the provider's own tags. The evidence column says how each claim was established — not that it was made.

Model Context Protocol (MCP)

measured — observed by APIs.io (verified)

OAuth 2.0 Protected Resource Metadata

measured — observed by APIs.io (verified)

Dynamic Client Registration

measured — observed by APIs.io (published)

OpenAPI

measured — observed by APIs.io (published)

APIs 7

Individual APIs this provider publishes, each with its own machine-readable definition.

Scorecard Metrics API

The Metrics API from Scorecard — 1 operation(s) for metrics.

Scorecard Projects API

The Projects API from Scorecard — 5 operation(s) for projects.

Scorecard Records API

The Records API from Scorecard — 5 operation(s) for records.

Scorecard Runs API

The Runs API from Scorecard — 2 operation(s) for runs.

Scorecard Systems API

The Systems API from Scorecard — 3 operation(s) for systems.

Scorecard Test Cases API

The Test Cases API from Scorecard — 2 operation(s) for test cases.

Scorecard Test Sets API

The Test Sets API from Scorecard — 2 operation(s) for test sets.

Scroll for all 7

Open Collections 7

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

Scorecard Metrics API

OPEN COLLECTION

Scorecard Metrics Projects API

OPEN COLLECTION

Scorecard Metrics Records API

OPEN COLLECTION

Scorecard Metrics Runs API

OPEN COLLECTION

Scorecard Metrics Systems API

OPEN COLLECTION

Scorecard Metrics Testcases API

OPEN COLLECTION

Scorecard Metrics Testsets API

OPEN COLLECTION

Scroll for all 7

MCP Servers 1

Model Context Protocol servers that expose these APIs to AI agents.

Scorecard MCP Server

Remote MCP server at mcp.scorecard.io over HTTP.

MCP SERVER

Agent Skills 2

Packaged agent skills for driving this provider's APIs from an AI assistant.

Build a Scorecard evaluation testset

AGENT SKILL

Run a Scorecard evaluation and record scores

AGENT SKILL

Scorecard API pricing

Prices published by Scorecard, read 2026-10-07 from www.scorecard.io/pricing.

Plan	Price
Starter	$0 Includes: Unlimited users, 100,000 scores
Growth	$299 Includes: Unlimited users; Includes 1M scores/mo; Test set management; Prompt playground access; Priority supp
Enterprise	Customized Pricing Includes: Everything in Growth, SAML SSO, SOC 2 compliance reporting, end-to-end data encryption, 24/7 VIP sup

Plan details, limits and sources →

Billed by: subscription · FinOps profile →

Pricing Plans 2

Published pricing tiers and plan structures.

Scorecard Plans Pricing

3 plans

PLANS

Scorecard Price Estimates

0 plans

PLANS

Service Levels 1

Uptime the provider promises or reports, as SLA4OAI. Read from its own pages; APIs.io runs no monitors.

Scorecard

SLA

FinOps 1

Cost, billing, and metering signals for API financial operations.

Scorecard Finops

FINOPS

Spectral Rules 1

Spectral governance rulesets for linting and validating these APIs.

Scorecard API Rules

61 rules · 50 errors 10 warnings 1 info

SPECTRAL

OpenAPI Overlays 1

Overlays applied on top of this provider's contracts. Each card says who wrote it: a document the provider publishes, or one API Evangelist derived or generated.

Scorecard Openapi Overlay

2 actions · update · scorecard-openapi-original.yml

DERIVED

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Scorecard Authentication

http · 1 scheme

SECURITY

Scorecard Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Scorecard Trust Center

SOC 2

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Scorecard Agentic Access

35 operations · 20 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

DeveloperPortal

DeveloperPortal

GettingStarted

GettingStarted

SignUp

SignUp

Documentation 2

Reference material describing how the API behaves

Documentation

Documentation

APIReference

APIReference

Agent Surfaces 4

MCP servers, agent skills, and machine-readable catalogs

MCPServer

LLMsTxt

AgenticAccess

AgentSkill

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

Conventions

ErrorCatalog

Lifecycle

Conformance

DataModel

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Packages

Packages

SDKs

SDKs

Access & Security 4

Authentication, authorization, and security posture

TrustCenter

DomainSecurity

Compliance

Authentication

Operate 2

Status, limits, changes, and where to get help

StatusPage

StatusPage

ChangeLog

ChangeLog

Commercial 4

Pricing, plans, and the legal terms of use

Plans

Pricing

TermsOfService

PrivacyPolicy

Company 2

The organization behind the API

Website

Website

Blog

Blog

Other 2

Properties that don't map to a standard resource type

CapabilityMap

CapabilityMap

Overlay

Overlay

Source (apis.yml)

aid: scorecard
name: Scorecard
description: Scorecard is a simulation and evaluation platform for building, testing, and deploying frontier AI agents. Teams
  run their agents through thousands of realistic scenarios, judge outputs with configurable AI, human, and heuristic metrics,
  and ship new capabilities with confidence. The platform organizes work into Projects, Testsets, Testcases, Metrics, Runs,
  Records, Scores, and Systems, and exposes a REST API (bearer API keys prefixed ak_) plus official Python, TypeScript/Node,
  and Go SDKs, a hosted MCP server, tracing integrations for LangChain, the Vercel AI SDK, and the Claude Agent SDK, and a
  GitHub Actions integration for evals in CI. Scorecard was founded to solve AI agent evaluation at scale and is backed by
  Kindred Ventures.
url: https://raw.githubusercontent.com/api-evangelist/scorecard/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- kindred-ventures
deliveryModel:
  model: saas
  open_source: false
  commercial: true
  callable_host: true
  label: Hosted service · you call their endpoint
  confidence: high
  source:
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  gated: none
  gated_source:
  - onboarding
  label: Freemium · Self-serve signup
  confidence: medium
  source:
  - plans
  - authentication
  - security
  generated: '2026-11-06'
  method: derived
image: https://cdn.prod.website-files.com/68012f5eeeda4ace0fca1c46/680be2472e0c42225eb5c6fb_bb737b32df1d17f3492808c99d78bb0b_scorecard-open-graph.jpg
specificationVersion: '0.23'
created: '2026-07-17'
modified: '2026-07-21'
x-docs-platform: mintlify
x-docs-platform-confidence: medium
x-docs-platform-checked: 2026-10-04
x-docs-hosting: vercel
tags:
- Company
- Artificial Intelligence
- Agents
- Evaluation
- Testing
- LLM
- Observability
- Simulation
- Developer Tools
- MCP
tags_raw:
- Company
- AI
- Agents
- Evaluation
- Testing
- LLM
- Observability
- Simulation
- Developer Tools
- MCP
apis:
- aid: scorecard:scorecard-metrics-api
  name: Scorecard Metrics API
  description: The Metrics API from Scorecard — 1 operation(s) for metrics.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Metrics
  properties:
  - type: OpenAPI
    url: openapi/scorecard-metrics-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-projects-api
  name: Scorecard Projects API
  description: The Projects API from Scorecard — 5 operation(s) for projects.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Project
  tags_raw:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/scorecard-projects-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-records-api
  name: Scorecard Records API
  description: The Records API from Scorecard — 5 operation(s) for records.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Records
  properties:
  - type: OpenAPI
    url: openapi/scorecard-records-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-runs-api
  name: Scorecard Runs API
  description: The Runs API from Scorecard — 2 operation(s) for runs.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Runs
  properties:
  - type: OpenAPI
    url: openapi/scorecard-runs-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-systems-api
  name: Scorecard Systems API
  description: The Systems API from Scorecard — 3 operation(s) for systems.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Systems
  properties:
  - type: OpenAPI
    url: openapi/scorecard-systems-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-test-cases-api
  name: Scorecard Test Cases API
  description: The Test Cases API from Scorecard — 2 operation(s) for test cases.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Test Cases
  properties:
  - type: OpenAPI
    url: openapi/scorecard-test-cases-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
- aid: scorecard:scorecard-test-sets-api
  name: Scorecard Test Sets API
  description: The Test Sets API from Scorecard — 2 operation(s) for test sets.
  humanURL: https://docs.scorecard.io/api-reference/overview
  baseURL: https://api2.scorecard.io/api/v2
  tags:
  - Testsets
  tags_raw:
  - Test Sets
  properties:
  - type: OpenAPI
    url: openapi/scorecard-test-sets-api-openapi.yml
  - type: Documentation
    url: https://docs.scorecard.io/api-reference/overview
x-enrichment:
  date: '2026-07-21'
  status: enriched
  artifacts_added: 18
  pass: local-v1
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: Plans
  url: plans/scorecard-plans-pricing.yml
- type: CapabilityMap
  url: capabilities/scorecard-capability-edges.yml
  name: Scorecard Business Capability Map
- type: Overlay
  url: overlays/scorecard-openapi-overlay.yaml
- type: TrustCenter
  url: security/scorecard-trust-center.yml
- type: DomainSecurity
  url: security/scorecard-domain-security.yml
- type: Website
  url: https://www.scorecard.io/
- type: DeveloperPortal
  url: https://docs.scorecard.io/
- type: Documentation
  url: https://docs.scorecard.io/
- type: APIReference
  url: https://docs.scorecard.io/api-reference/overview
- type: GettingStarted
  url: https://docs.scorecard.io/intro/sdk-quickstart
- type: Blog
  url: https://www.scorecard.io/blog
- type: Pricing
  url: https://www.scorecard.io/pricing
- type: SignUp
  url: https://app.getscorecard.ai/
- type: TermsOfService
  url: https://www.scorecard.io/terms-of-service
- type: PrivacyPolicy
  url: https://www.scorecard.io/privacy-policy
- type: GitHubOrganization
  url: https://github.com/scorecard-ai
- type: StatusPage
  url: https://status.scorecard.io/
- type: ChangeLog
  url: https://docs.scorecard.io/changelog
- type: Compliance
  url: https://trust.scorecard.io/
- type: MCPServer
  url: mcp/scorecard-mcp.yml
- type: Packages
  url: packages/scorecard-packages.yml
- type: SDKs
  url: packages/scorecard-packages.yml
- type: LLMsTxt
  url: llms/scorecard-llms.txt
- type: Authentication
  url: authentication/scorecard-authentication.yml
- type: Conventions
  url: conventions/scorecard-conventions.yml
- type: ErrorCatalog
  url: errors/scorecard-problem-types.yml
- type: Lifecycle
  url: lifecycle/scorecard-lifecycle.yml
- type: Conformance
  url: conformance/scorecard-conformance.yml
- type: DataModel
  url: data-model/scorecard-data-model.yml
- type: AgenticAccess
  url: agentic-access/scorecard-agentic-access.yml
- type: AgentSkill
  url: skills/_index.yml

Scorecard API — frequently asked questions

Does Scorecard have an API?

Yes. APIs.io lists 7 APIs from Scorecard, including Scorecard Metrics API, Scorecard Projects API and Scorecard Records API, and 4 more.

Is there an OpenAPI specification for the Scorecard API?

Yes. APIs.io indexes 7 OpenAPI specifications for Scorecard, each linked for download from this page.

How do I authenticate with the Scorecard API?

Scorecard documents its authentication (http · 1 scheme). The details are profiled on APIs.io as Scorecard Authentication.

How much does the Scorecard API cost?

Scorecard publishes its prices; its Starter plan is $0 as of 2026-10-07. APIs.io lists 3 pricing plans for Scorecard, with each plan's price, limits and inclusions under Pricing on this page.

Does Scorecard have an MCP server?

Yes. APIs.io lists 1 MCP server for Scorecard: Remote MCP server at mcp.scorecard.io over HTTP.

Is the Scorecard API ready for AI agents?

Scorecard has a Kin Score of 62.7 out of 100 (strong) and an Agent Readiness score of 49.8 (agent-ready), scored by API Evangelist on 2026-11-06.

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/scorecard"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/scorecard/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/scorecard/evidence"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.