Test Specifications website screenshot

Test Specifications

Documentation that defines the requirements, procedures, and expected outcomes for testing software systems and APIs. Test specifications establish the criteria that implementations must satisfy, bridging the gap between product requirements and executable test cases. They include test plans, test case definitions, acceptance criteria, and conformance requirements. Effective use of this practice reduces bugs in production, supports contract testing, and enables a culture of quality-driven development aligned with OpenAPI, AsyncAPI, and JSON Schema standards.

Test Specifications publishes 8 APIs on the APIs.io network. Tagged areas include Acceptance Testing, Contract Testing, Documentation, OpenAPI, and Quality Assurance.

The Test Specifications catalog on APIs.io includes 1 JSON-LD context and 1 Spectral governance ruleset.

31.8/100 thin ▬ flat Agent 3/100 human only Full breakdown ↓
scored 2026-08-05 · rubric v0.9.1
AccessFreemium
8 APIs
Acceptance TestingContract TestingDocumentationOpenAPIQuality AssuranceTesting

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-08-05 · rubric v0.9.1
Composite quality — 31.8/100 · thin
Contract Quality 3.2 / 25
Developer Ergonomics 0.0 / 20
Commercial Clarity 7.9 / 20
Operational Transparency 4.8 / 13
Governance 8.3 / 12
Discoverability 7.6 / 10
Agent readiness — 3/100 · human only
Machine-Readable Contract 0 / 18
Agentic Access Contract 0 / 10
MCP Server 0 / 12
Machine-Readable Auth 0 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/test-specifications: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 8

Individual APIs this provider publishes, each with its own machine-readable definition.

OpenAPI Initiative

The OpenAPI Specification (OAS) is the de-facto standard for describing RESTful APIs. OpenAPI documents serve as machine-readable test specifications that tools such as Dredd, S...

AsyncAPI Initiative

AsyncAPI is an open specification standard for event-driven and message-based APIs. AsyncAPI documents define the channels, messages, and schemas of asynchronous interfaces, pro...

JSON Schema

JSON Schema provides a vocabulary for annotating and validating JSON documents. Used extensively as the payload specification layer in test specifications, JSON Schema enables b...

Gherkin / Cucumber BDD

Gherkin is a plain-text language used to write behavior-driven test specifications in Given-When-Then format. Cucumber and Karate consume Gherkin feature files as executable tes...

Pact Contract Testing

Pact is a consumer-driven contract testing tool where consumers write test specifications (pacts) that define what responses they expect from provider APIs. Providers then verif...

Swagger Editor

Swagger Editor is an open-source web-based editor for designing OpenAPI specifications that double as test specifications. It provides real-time validation, mock server generati...

Optic API

Optic is a developer tool that uses API specifications as the source of truth for testing. It tracks specification changes, generates changelog diffs, and validates live traffic...

Spectral

Spectral is an open-source JSON/YAML linter and specification validator. It evaluates OpenAPI, AsyncAPI, and custom specification documents against rulesets, serving as a static...

Scroll for all 8

Pricing Plans 1

Published pricing tiers and plan structures.

Rate Limits 1

Documented rate limits and quota policies.

Test Specifications Rate Limits

5 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Test Specifications Context

13 classes · 8 properties

JSON-LD

Spectral Rules 1

Spectral governance rulesets for linting and validating these APIs.

Test Specifications API Rules

5 rules · 3 warnings 2 info

SPECTRAL

JSON Schema 1

Standalone JSON Schema definitions for this provider's data models.

Test Specification

11 properties

JSON SCHEMA

JSON Structure 1

JSON Structure definitions describing this provider's data shapes.

Test Specifications Structure

0 properties

JSON STRUCTURE

Examples 1

Example request and response payloads for these APIs.

Security Posture 1

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Test Specifications Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Resources

Documentation 1

Reference material describing how the API behaves

Design & Contract 3

Pagination, idempotency, versioning, errors, and events

Build 1

SDKs, sample code, and the tooling you integrate with

Access & Security 1

Authentication, authorization, and security posture

Source (apis.yml)

apis.yml Raw ↑
accessModel:
  pricing: freemium
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Freemium
  confidence: medium
  source:
  - plans
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/test-specifications.png
name: Test Specifications
description: Documentation that defines the requirements, procedures, and expected outcomes for testing software systems and
  APIs. Test specifications establish the criteria that implementations must satisfy, bridging the gap between product requirements
  and executable test cases. They include test plans, test case definitions, acceptance criteria, and conformance requirements.
  Effective use of this practice reduces bugs in production, supports contract testing, and enables a culture of quality-driven
  development aligned with OpenAPI, AsyncAPI, and JSON Schema standards.
url: https://en.wikipedia.org/wiki/Test_specification
tags:
- Acceptance Testing
- Contract Testing
- Documentation
- OpenAPI
- Quality Assurance
- Testing
created: '2025'
modified: '2026-05-03'
apis:
- name: OpenAPI Initiative
  description: The OpenAPI Specification (OAS) is the de-facto standard for describing RESTful APIs. OpenAPI documents serve
    as machine-readable test specifications that tools such as Dredd, Schemathesis, and Postman use to auto-generate and validate
    test suites against live API implementations.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://www.openapis.org/
  baseURL: https://spec.openapis.org/oas/v3.1.0
  tags:
  - REST
  - Specification
  - Standards
  properties:
  - type: Documentation
    url: https://spec.openapis.org/oas/v3.1.0
  - type: GitHubOrg
    url: https://github.com/OAI/OpenAPI-Specification
- name: AsyncAPI Initiative
  description: AsyncAPI is an open specification standard for event-driven and message-based APIs. AsyncAPI documents define
    the channels, messages, and schemas of asynchronous interfaces, providing a test specification baseline for contract and
    integration testing of Kafka, WebSocket, AMQP, and MQTT APIs.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://www.asyncapi.com/
  baseURL: https://www.asyncapi.com/
  tags:
  - AsyncAPI
  - Event-Driven
  - Specification
  properties:
  - type: Documentation
    url: https://www.asyncapi.com/docs
  - type: GitHubOrg
    url: https://github.com/asyncapi/spec
- name: JSON Schema
  description: JSON Schema provides a vocabulary for annotating and validating JSON documents. Used extensively as the payload
    specification layer in test specifications, JSON Schema enables both human-readable documentation and machine-executable
    validation of API request and response bodies.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://json-schema.org/
  baseURL: https://json-schema.org/
  tags:
  - JSON
  - Schema Validation
  - Specification
  properties:
  - type: Documentation
    url: https://json-schema.org/learn/getting-started-step-by-step
  - type: GitHubOrg
    url: https://github.com/json-schema-org/json-schema-spec
- name: Gherkin / Cucumber BDD
  description: Gherkin is a plain-text language used to write behavior-driven test specifications in Given-When-Then format.
    Cucumber and Karate consume Gherkin feature files as executable test specifications that bridge business requirements
    and automated test implementation for API testing.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://cucumber.io/docs/gherkin/
  baseURL: https://cucumber.io/
  tags:
  - BDD
  - Gherkin
  - Test Specification
  properties:
  - type: Documentation
    url: https://cucumber.io/docs/gherkin/reference/
  - type: GitHubOrg
    url: https://github.com/cucumber/cucumber
- name: Pact Contract Testing
  description: Pact is a consumer-driven contract testing tool where consumers write test specifications (pacts) that define
    what responses they expect from provider APIs. Providers then verify their implementation satisfies all consumer-authored
    specifications via the Pact Broker.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://pact.io/
  baseURL: https://pact.io/
  tags:
  - Consumer-Driven Contracts
  - Contract Testing
  - Specification
  properties:
  - type: Documentation
    url: https://docs.pact.io/
  - type: GitHubOrg
    url: https://github.com/pact-foundation/pact-specification
- name: Swagger Editor
  description: Swagger Editor is an open-source web-based editor for designing OpenAPI specifications that double as test
    specifications. It provides real-time validation, mock server generation, and exportable spec files that integrate with
    testing pipelines.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://editor.swagger.io/
  baseURL: https://editor.swagger.io/
  tags:
  - API Design
  - OpenAPI
  - Test Specification
  properties:
  - type: Documentation
    url: https://swagger.io/docs/specification/about/
  - type: GitHubOrg
    url: https://github.com/swagger-api/swagger-editor
- name: Optic API
  description: Optic is a developer tool that uses API specifications as the source of truth for testing. It tracks specification
    changes, generates changelog diffs, and validates live traffic against OpenAPI specs to detect contract drift between
    specifications and implementations.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://www.useoptic.com/
  baseURL: https://api.useoptic.com
  tags:
  - API Governance
  - Contract Testing
  - OpenAPI
  properties:
  - type: Documentation
    url: https://www.useoptic.com/docs
  - type: GitHubOrg
    url: https://github.com/opticdev/optic
- name: Spectral
  description: Spectral is an open-source JSON/YAML linter and specification validator. It evaluates OpenAPI, AsyncAPI, and
    custom specification documents against rulesets, serving as a static test specification compliance checker integrated
    into CI/CD pipelines via the Spectral CLI.
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://stoplight.io/open-source/spectral
  baseURL: https://stoplight.io/open-source/spectral
  tags:
  - API Governance
  - Linting
  - OpenAPI
  - Specification
  properties:
  - type: Documentation
    url: https://docs.stoplight.io/docs/spectral
  - type: GitHubOrg
    url: https://github.com/stoplightio/spectral
common:
- type: DomainSecurity
  url: security/test-specifications-domain-security.yml
- type: GitHubOrg
  url: https://github.com/api-evangelist/test-specifications
- type: JSONSchema
  url: https://raw.githubusercontent.com/api-evangelist/test-specifications/main/json-schema/test-specifications-schema.json
- type: JSONStructure
  url: https://raw.githubusercontent.com/api-evangelist/test-specifications/main/json-structure/test-specifications-structure.json
- type: JSONLDContext
  url: https://raw.githubusercontent.com/api-evangelist/test-specifications/main/json-ld/test-specifications-context.jsonld
- type: Vocabulary
  url: https://raw.githubusercontent.com/api-evangelist/test-specifications/main/vocabulary/test-specifications-vocabulary.yml