test.ai Classifier

gRPC service that classifies UI element screenshots into semantic labels. A single RPC, ClassifyElements, takes a map of element id to PNG bytes plus a label hint, a confidence threshold and a weaker-match flag, and returns a per-element label with confidence scores. This is the engine behind the test.ai Appium classifier plugin and the Java, Python, Node.js and Ruby classifier clients. The server is run by the consumer, so there is no vendor-hosted base URL — the clients take host and port as constructor arguments.

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/testai-classifier"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑
name: test.ai Classifier
description: gRPC service that classifies UI element screenshots into semantic labels. A single RPC, ClassifyElements,
  takes a map of element id to PNG bytes plus a label hint, a confidence threshold and a weaker-match
  flag, and returns a per-element label with confidence scores. This is the engine behind the test.ai
  Appium classifier plugin and the Java, Python, Node.js and Ruby classifier clients. The server is run
  by the consumer, so there is no vendor-hosted base URL — the clients take host and port as constructor
  arguments.
humanURL: https://github.com/testdotai/classifier-proto
tags:
- Machine-Learning
- Computer-Vision
- gRPC
tags_raw:
- Machine Learning
- Computer Vision
- gRPC
properties:
- type: Protobuf
  url: grpc/test-ai-classifier.proto
- type: SourceCode
  url: https://github.com/testdotai/classifier-proto