test.ai

test.ai (formerly Appdiff, Inc.) built an AI-powered test-automation platform that used computer vision and machine-learning element classification to make Selenium and Appium tests resilient to UI change. It published first-party Java, Python, Node.js and Ruby SDKs, a gRPC "Classifier" service that labelled UI elements from screenshots, an Appium classifier plugin, and OpenTestData — a free open database of automated test fixture data with its own REST API. The company raised over $30M and was sold; its founder has since moved on to other ventures. As of 2026-08-30 test.ai serves no website of its own: the domain has no HTTPS listener and every HTTP path redirects off-domain. The artifacts profiled here are the contracts and packages the company published while operating, all of which remain publicly retrievable from its own GitHub organization and from the npm, PyPI, RubyGems and Maven Central registries.

test.ai publishes 6 API contracts indexed on the APIs.io network, including Data API, Ping API, Search API, and 3 more. Tagged areas include Company, Testing, Test Automation, Quality Assurance, and Artificial Intelligence.

test.ai’s developer surface includes documentation, getting-started guide, and 13 more developer resources.

📡 Profile data on GitHub

0.0/100 minimal ▬ flat Agent 0/100 human only Full breakdown ↓
scored 2026-10-17 · rubric v0.24.0

1 published contract

Company Testing Test Automation Quality Assurance Artificial Intelligence Machine Learning Computer Vision Selenium Appium Developer Tools gRPC Defunct

What this lets a business do 1

Business capabilities this provider's published APIs can perform, derived from its own contracts. Browse all capabilities →

Software Product Engineering Management

BC-4200

DataTests

POST /data GET /data/{id} POST /tests

Kin Score

Kin Score How this is scored →
scored 2026-10-17 · rubric v0.24.0

Composite quality — 0.0/100 · minimal

Contract Quality 0.0 / 19

Developer Ergonomics 0.0 / 15

Access Clarity 0.0 / 15

Operational Transparency 0.0 / 10

Contract Governance 0.0 / 9

Discoverability 0.0 / 8

Regulatory Posture 2.3 / 15

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 0/100 · human only

Machine-Readable Contract 18 / 18

Agentic Access Contract 0 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 8 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

The six quality facets above are damped to 75 points between them, because the conditional facet above carries the other 25. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 75% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/test-ai: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Standards implemented 1

Standards this provider implements or carries. De facto ones are profiled and measured by the API Commons; formal ones come from the standards directory and are linked by the provider's own tags. The evidence column says how each claim was established — not that it was made.

gRPC

tagged — the provider's own APIs.json carries the standard as a tag; implementation not verified

APIs 6

Individual APIs this provider publishes, each with its own machine-readable definition.

test.ai Classifier

gRPC service that classifies UI element screenshots into semantic labels. A single RPC, ClassifyElements, takes a map of element id to PNG bytes plus a label hint, a confidence ...

test.ai Data API

The Data API from test.ai — 2 operation(s) for data.

test.ai Ping API

The Ping API from test.ai — 1 operation(s) for ping.

test.ai Search API

The Search API from test.ai — 1 operation(s) for search.

test.ai Tests API

The Tests API from test.ai — 2 operation(s) for tests.

test.ai Users API

The Users API from test.ai — 7 operation(s) for users.

Pricing Plans 1

Published pricing tiers and plan structures.

Test Ai Plans Pricing

0 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Test Ai Rate Limits

0 limits

RATE LIMITS

OpenAPI Overlays 1

Overlays applied on top of this provider's contracts. Each card says who wrote it: a document the provider publishes, or one API Evangelist derived or generated.

Test Ai Opentestdata Overlay

5 actions · servers · test-ai-opentestdata-openapi.yaml

GENERATED

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Test Ai Authentication

http · 1 scheme

SECURITY

Test Ai Domain Security

HSTS

SECURITY

Resources

Get Started 1

Portal, sign-up, and the first successful call

GettingStarted

GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

LLMsTxt

LLMsTxt

Design & Contract 3

Pagination, idempotency, versioning, errors, and events

Conformance

Conformance

Lifecycle

Lifecycle

Conventions

Conventions

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Packages

Packages

SDKs

SDKs

Access & Security 1

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Operate 1

Status, limits, changes, and where to get help

RateLimits

RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

License

License

Plans

Plans

Other 2

Properties that don't map to a standard resource type

CapabilityMap

CapabilityMap

Overlay

Overlay

Source (apis.yml)

aid: test-ai
name: test.ai
description: 'test.ai (formerly Appdiff, Inc.) built an AI-powered test-automation platform that used computer vision and
  machine-learning element classification to make Selenium and Appium tests resilient to UI change. It published first-party
  Java, Python, Node.js and Ruby SDKs, a gRPC "Classifier" service that labelled UI elements from screenshots, an Appium classifier
  plugin, and OpenTestData — a free open database of automated test fixture data with its own REST API. The company raised
  over $30M and was sold; its founder has since moved on to other ventures. As of 2026-08-30 test.ai serves no website of
  its own: the domain has no HTTPS listener and every HTTP path redirects off-domain. The artifacts profiled here are the
  contracts and packages the company published while operating, all of which remain publicly retrievable from its own GitHub
  organization and from the npm, PyPI, RubyGems and Maven Central registries.'
url: https://raw.githubusercontent.com/api-evangelist/test-ai/refs/heads/main/apis.yml
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source:
  - authentication
  - rate-limits
  - security
  generated: '2026-09-03'
  method: derived
image: https://avatars.githubusercontent.com/u/36999702?s=200&v=4
x-type: company
x-source: harvest:secondary-market
x-source-url: https://www.nasdaqprivatemarket.com/
x-tier: stub
x-tier-reason: harvest
specificationVersion: '0.20'
x-status: defunct
x-status-detail: Formerly Appdiff, Inc.; the product was wound down and test.ai no longer resolves. No Website registered
  on purpose.
created: '2026-08-30'
modified: '2026-08-30'
tags:
- Company
- Testing
- Test Automation
- Quality Assurance
- Artificial Intelligence
- Machine Learning
- Computer Vision
- Selenium
- Appium
- Developer Tools
- gRPC
- Defunct
tags_raw:
- Company
- Testing
- Test Automation
- Quality Assurance
- Artificial Intelligence
- Machine Learning
- Computer Vision
- Selenium
- Appium
- Developer Tools
- gRPC
- Defunct
- Machine-Learning
- Computer-Vision
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
apis:
- name: test.ai Classifier
  description: gRPC service that classifies UI element screenshots into semantic labels. A single RPC, ClassifyElements, takes
    a map of element id to PNG bytes plus a label hint, a confidence threshold and a weaker-match flag, and returns a per-element
    label with confidence scores. This is the engine behind the test.ai Appium classifier plugin and the Java, Python, Node.js
    and Ruby classifier clients. The server is run by the consumer, so there is no vendor-hosted base URL — the clients take
    host and port as constructor arguments.
  humanURL: https://github.com/testdotai/classifier-proto
  tags:
  - Machine Learning
  - Computer Vision
  - gRPC
  tags_raw:
  - Machine Learning
  - Computer Vision
  - gRPC
  - Machine-Learning
  - Computer-Vision
  properties:
  - type: Protobuf
    url: grpc/test-ai-classifier.proto
  - type: SourceCode
    url: https://github.com/testdotai/classifier-proto
- aid: test-ai:test-ai-data-api
  name: test.ai Data API
  description: The Data API from test.ai — 2 operation(s) for data.
  humanURL: https://github.com/testdotai/opentestdata-api
  baseURL: http://api.opentestdata.org
  tags:
  - Data
  properties:
  - type: OpenAPI
    url: openapi/test-ai-data-api-openapi.yml
  - type: Authentication
    url: authentication/test-ai-authentication.yml
  - type: ErrorCatalog
    url: errors/test-ai-problem-types.yml
  - type: DataModel
    url: data-model/test-ai-data-model.yml
  - type: SourceCode
    url: https://github.com/testdotai/opentestdata-api
- aid: test-ai:test-ai-ping-api
  name: test.ai Ping API
  description: The Ping API from test.ai — 1 operation(s) for ping.
  humanURL: https://github.com/testdotai/opentestdata-api
  baseURL: http://api.opentestdata.org
  tags:
  - Ping
  properties:
  - type: OpenAPI
    url: openapi/test-ai-ping-api-openapi.yml
  - type: Authentication
    url: authentication/test-ai-authentication.yml
  - type: ErrorCatalog
    url: errors/test-ai-problem-types.yml
  - type: DataModel
    url: data-model/test-ai-data-model.yml
  - type: SourceCode
    url: https://github.com/testdotai/opentestdata-api
- aid: test-ai:test-ai-search-api
  name: test.ai Search API
  description: The Search API from test.ai — 1 operation(s) for search.
  humanURL: https://github.com/testdotai/opentestdata-api
  baseURL: http://api.opentestdata.org
  tags:
  - Search
  properties:
  - type: OpenAPI
    url: openapi/test-ai-search-api-openapi.yml
  - type: Authentication
    url: authentication/test-ai-authentication.yml
  - type: ErrorCatalog
    url: errors/test-ai-problem-types.yml
  - type: DataModel
    url: data-model/test-ai-data-model.yml
  - type: SourceCode
    url: https://github.com/testdotai/opentestdata-api
- aid: test-ai:test-ai-tests-api
  name: test.ai Tests API
  description: The Tests API from test.ai — 2 operation(s) for tests.
  humanURL: https://github.com/testdotai/opentestdata-api
  baseURL: http://api.opentestdata.org
  tags:
  - Tests
  properties:
  - type: OpenAPI
    url: openapi/test-ai-tests-api-openapi.yml
  - type: Authentication
    url: authentication/test-ai-authentication.yml
  - type: ErrorCatalog
    url: errors/test-ai-problem-types.yml
  - type: DataModel
    url: data-model/test-ai-data-model.yml
  - type: SourceCode
    url: https://github.com/testdotai/opentestdata-api
- aid: test-ai:test-ai-users-api
  name: test.ai Users API
  description: The Users API from test.ai — 7 operation(s) for users.
  humanURL: https://github.com/testdotai/opentestdata-api
  baseURL: http://api.opentestdata.org
  tags:
  - User
  tags_raw:
  - Users
  properties:
  - type: OpenAPI
    url: openapi/test-ai-users-api-openapi.yml
  - type: Authentication
    url: authentication/test-ai-authentication.yml
  - type: ErrorCatalog
    url: errors/test-ai-problem-types.yml
  - type: DataModel
    url: data-model/test-ai-data-model.yml
  - type: SourceCode
    url: https://github.com/testdotai/opentestdata-api
common:
- type: CapabilityMap
  url: capabilities/test-ai-capability-edges.yml
  name: test.ai Business Capability Map
- type: Overlay
  url: overlays/test-ai-opentestdata-overlay.yaml
- type: License
  name: MIT
  url: https://github.com/testdotai/opentestdata-api/blob/master/LICENSE
- type: GitHubOrganization
  url: https://github.com/testdotai
- type: Documentation
  url: https://github.com/testdotai/testai-build-your-own-SDK-documentation
- type: GettingStarted
  url: https://github.com/testdotai/interactive_walkthrough
- type: Packages
  url: packages/test-ai-packages.yml
- type: SDKs
  url: packages/test-ai-packages.yml
- type: Conformance
  url: conformance/test-ai-conformance.yml
- type: Lifecycle
  url: lifecycle/test-ai-lifecycle.yml
- type: Conventions
  url: conventions/test-ai-conventions.yml
- type: DomainSecurity
  url: security/test-ai-domain-security.yml
- type: LLMsTxt
  url: llms/test-ai-llms.txt
- type: Plans
  url: plans/test-ai-plans-pricing.yml
- type: RateLimits
  url: rate-limits/test-ai-rate-limits.yml
x-enrichment:
  date: '2026-08-30'
  status: enriched
  artifacts_added: 22
  pass: local-v1

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/test-ai"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/test-ai/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/test-ai/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.