Figure Eight

Figure Eight (formerly CrowdFlower, and originally Dolores Labs) was a human-in-the-loop machine learning and artificial intelligence company founded in San Francisco in 2007 by Lukas Biewald and Chris Van Pelt. Its platform turned unlabeled text, image, audio, and video into high-quality AI training data by combining automation with a distributed contributor workforce. The company exposed a RESTful, key-authenticated JSON API for programmatically creating, configuring, launching, and monitoring annotation jobs and multi-step workflows, and for downloading aggregated judgments and reports. Figure Eight was acquired by Appen in March 2019 for up to $300M; by 2020 its assets were fully integrated into Appen and the API is now served as the Appen Platform API at api.appen.com. This profile captures that surviving API surface. figure-eight.com now redirects to appen.com.

Figure Eight publishes 13 APIs on the APIs.io network, including Account Info API, Job Create/Update API, Job Ontology API, and 10 more. Tagged areas include Company, Artificial Intelligence, Machine-Learning, Data Labeling, and Data Annotation.

The Figure Eight catalog on APIs.io includes 1 event-driven AsyncAPI specification.

Figure Eight’s developer surface includes API reference, documentation, authentication, and 13 more developer resources.

📡 Source on GitHub

29.7/100 thin ▬ flat Agent 24/100 agent aware Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0

1 APIs

Company Artificial Intelligence Machine-Learning Data Labeling Data Annotation Training Data Human-in-the-Loop Crowdsourcing Acquired

Kin Score

Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0

Composite quality — 29.7/100 · thin

Contract Quality 13.0 / 23

Developer Ergonomics 5.8 / 18

Access Clarity 0.0 / 18

Operational Transparency 1.2 / 12

Contract Governance 0.5 / 11

Discoverability 6.8 / 9

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 24/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 0 / 10

Documented Reversibility 6 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 8 / 8

Request/Response Examples 7 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 6 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/figure-eight: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 13

Individual APIs this provider publishes, each with its own machine-readable definition.

Figure Eight Account Info API

Manage account info.

Figure Eight Job Create/Update API

Create and update jobs.

Figure Eight Job Ontology API

Read and Update the Ontology for a job

Figure Eight Job Results API

Request rows, judgments, and reports.

Figure Eight Job Status API

Control job status.

Figure Eight Manage Job Data API

Load data to jobs and work with that data.

Figure Eight Manage Job Settings API

Manage various job settings.

Figure Eight Monitor Contributors API

Monitor contributor status and settings.

Figure Eight Workflow Data Upload/Download API

Upload data to run through a Workflow. Download reports.

Figure Eight Workflow Filter Rules API

Rules for routing data

Figure Eight Workflow Step Routes API

Manage Workflow Step Routes

Figure Eight Workflow Steps API

Manage Workflow Steps

Figure Eight Workflows API

Copy, launch, pause and resume workflows, check status and configuration values

Scroll for all 13

Open Collections 14

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Appen Platform Account Info API

OPEN COLLECTION

Appen Platform Account Info Job Create/Update API

OPEN COLLECTION

Appen Platform Account Info Job Ontology API

OPEN COLLECTION

Appen Platform Account Info Job Results API

OPEN COLLECTION

Appen Platform Account Info Job Status API

OPEN COLLECTION

Appen Platform Account Info Manage Job Data API

OPEN COLLECTION

Appen Platform Account Info Manage Job Settings API

OPEN COLLECTION

Appen Platform Account Info Monitor Contributors API

OPEN COLLECTION

Appen Platform Account Info Workflow Data Upload/Download API

OPEN COLLECTION

Appen Platform Account Info Workflow Filter Rules API

OPEN COLLECTION

Appen Platform Account Info Workflow Step Routes API

OPEN COLLECTION

Appen Platform Account Info Workflow Steps API

OPEN COLLECTION

Appen Platform Account Info Workflows API

OPEN COLLECTION

Scroll for all 14

Event Specifications 1

AsyncAPI definitions for this provider's event-driven and streaming APIs.

Figure Eight Webhooks

ASYNCAPI

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Figure Eight Authentication

apiKey · 1 scheme

SECURITY

Figure Eight Domain Security

TLSv1.3 · DMARC

SECURITY

Resources

Documentation 2

Reference material describing how the API behaves

APIReference

APIReference

Documentation

Documentation

Agent Surfaces 3

MCP servers, agent skills, and machine-readable catalogs

X-MCPServerCandidate

X-MCPServerCandidate

LLMsTxt

LLMsTxt

WellKnown

WellKnown

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

Conventions

ErrorCatalog

Lifecycle

Conformance

DataModel

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Packages

Packages

SDKs

SDKs

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Other 1

Properties that don't map to a standard resource type

Overlay

Overlay

Source (apis.yml)

aid: figure-eight
deliveryModel:
  model: unknown
  open_source: false
  commercial: false
  callable_host: true
  label: Delivery model not determined — needs a product licence on record
  confidence: low
  source:
  - openapi
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source:
  - authentication
  - security
  generated: '2026-09-03'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/figure-eight.png
name: Figure Eight
description: Figure Eight (formerly CrowdFlower, and originally Dolores Labs) was a human-in-the-loop machine learning and
  artificial intelligence company founded in San Francisco in 2007 by Lukas Biewald and Chris Van Pelt. Its platform turned
  unlabeled text, image, audio, and video into high-quality AI training data by combining automation with a distributed contributor
  workforce. The company exposed a RESTful, key-authenticated JSON API for programmatically creating, configuring, launching,
  and monitoring annotation jobs and multi-step workflows, and for downloading aggregated judgments and reports. Figure Eight
  was acquired by Appen in March 2019 for up to $300M; by 2020 its assets were fully integrated into Appen and the API is
  now served as the Appen Platform API at api.appen.com. This profile captures that surviving API surface. figure-eight.com
  now redirects to appen.com.
url: https://raw.githubusercontent.com/api-evangelist/figure-eight/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- trinity-ventures
x-tier: stub
x-tier-reason: portfolio-lead
x-status: acquired
x-acquired-by: appen
x-acquired-date: 2019-03
specificationVersion: '0.23'
created: '2026-07-17'
modified: '2026-07-19'
tags:
- Company
- Artificial Intelligence
- Machine-Learning
- Data Labeling
- Data Annotation
- Training Data
- Human-in-the-Loop
- Crowdsourcing
- Acquired
tags_raw:
- Company
- Ai
- Machine Learning
- Data Labeling
- Data Annotation
- Training Data
- Human-in-the-Loop
- Crowdsourcing
- Acquired
apis:
- aid: figure-eight:figure-eight-account-info-api
  name: Figure Eight Account Info API
  description: Manage account info.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Account Info
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-account-info-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-job-create-update-api
  name: Figure Eight Job Create/Update API
  description: Create and update jobs.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Job Create/Update
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-job-create-update-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-job-ontology-api
  name: Figure Eight Job Ontology API
  description: Read and Update the Ontology for a job
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Job Ontology
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-job-ontology-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-job-results-api
  name: Figure Eight Job Results API
  description: Request rows, judgments, and reports.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Job Results
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-job-results-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-job-status-api
  name: Figure Eight Job Status API
  description: Control job status.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Job Status
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-job-status-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-manage-job-data-api
  name: Figure Eight Manage Job Data API
  description: Load data to jobs and work with that data.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Manage Job Data
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-manage-job-data-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-manage-job-settings-api
  name: Figure Eight Manage Job Settings API
  description: Manage various job settings.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Manage Job Settings
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-manage-job-settings-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-monitor-contributors-api
  name: Figure Eight Monitor Contributors API
  description: Monitor contributor status and settings.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Monitor Contributors
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-monitor-contributors-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-workflow-data-upload-download-api
  name: Figure Eight Workflow Data Upload/Download API
  description: Upload data to run through a Workflow. Download reports.
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Workflow Data Upload/Download
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-workflow-data-upload-download-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-workflow-filter-rules-api
  name: Figure Eight Workflow Filter Rules API
  description: Rules for routing data
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Workflow Filter Rules
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-workflow-filter-rules-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-workflow-step-routes-api
  name: Figure Eight Workflow Step Routes API
  description: Manage Workflow Step Routes
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Workflow Step Routes
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-workflow-step-routes-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-workflow-steps-api
  name: Figure Eight Workflow Steps API
  description: Manage Workflow Steps
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Workflow Steps
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-workflow-steps-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
- aid: figure-eight:figure-eight-workflows-api
  name: Figure Eight Workflows API
  description: Copy, launch, pause and resume workflows, check status and configuration values
  humanURL: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
  baseURL: https://api.appen.com/v1
  tags:
  - Workflows
  properties:
  - type: OpenAPI
    url: openapi/figure-eight-workflows-api-openapi.yml
  - type: Webhooks
    url: asyncapi/figure-eight-webhooks.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: Overlay
  url: overlays/figure-eight-openapi-overlay.yaml
- type: DomainSecurity
  url: security/figure-eight-domain-security.yml
- type: APIReference
  url: https://app.swaggerhub.com/apis-docs/CrowdFlower/FigureEightAPI/1.0.0
- type: Documentation
  url: http://crowdflower.github.io/CML/
- type: GitHubOrganization
  url: https://github.com/CrowdFlower
- type: Packages
  url: packages/figure-eight-packages.yml
- type: SDKs
  url: packages/figure-eight-packages.yml
- type: Authentication
  url: authentication/figure-eight-authentication.yml
- type: Conventions
  url: conventions/figure-eight-conventions.yml
- type: ErrorCatalog
  url: errors/figure-eight-problem-types.yml
- type: Lifecycle
  url: lifecycle/figure-eight-lifecycle.yml
- type: Conformance
  url: conformance/figure-eight-conformance.yml
- type: DataModel
  url: data-model/figure-eight-data-model.yml
- type: X-MCPServerCandidate
  url: mcp/figure-eight-mcp.yml
  note: 'Renamed from MCPServer 2026-09-03 (roadmap#247): the manifest self-describes as status: candidate — a tool list derived
    from the published API contracts, not an existing server. The scorer already read the manifest and reported mcp_server
    correctly; the MCPServer type was crediting the artifact-type surfaces with a server that does not exist.'
- type: LLMsTxt
  url: llms/figure-eight-llms.txt
- type: WellKnown
  url: well-known/figure-eight-well-known.yml
x-enrichment:
  date: '2026-07-19'
  status: backfilled
  pass: local-v1
  note: backfilled from .gitignore signal + verified work evidence

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/figure-eight"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/figure-eight/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/figure-eight/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.