CrawlCheck Conduct API

The Conduct API from CrawlCheck — 2 operation(s) for conduct.

GitHub OpenAPI

Operations 2

1 of 2 operations are conformant: apis.io called them with no credentials and the responses matched this contract. Checked 2026-11-12. how this works · status file

GET /api/v1/conduct Agent conduct record: for every verifiable agent, what it did on crawlcheck.io… conformant #
GET /api/v1/conduct/{agent} The conduct record for one agent, e.g. GPTBot, signed on its own #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-conduct-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

crawlcheck-io-conduct-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Crawlcheck Io Conduct API
  version: '1'
  contact:
    name: CrawlCheck
    url: https://crawlcheck.io/policy
    email: hello@crawlcheck.io
  license:
    name: Terms
    url: https://crawlcheck.io/policy
  x-core-contract:
    promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
    operations:
    - method: GET
      path: /api/v1/resolve
      operationId: resolveDomainV1
    - method: POST
      path: /api/v1/resolve
      operationId: resolveBatchV1
    - method: POST
      path: /api/v1/preflight
      operationId: preflightV1
    - method: GET
      path: /api/v1/decisions/{sha256}
      operationId: decisionCheckV1
    - method: GET
      path: /api/v1/revocations
      operationId: revocations
    - method: GET
      path: /api/v1/visitor
      operationId: visitorResolveV1
    - method: POST
      path: /api/v1/visitor
      operationId: visitorResolveBatchV1
    - method: GET
      path: /api/v1/mcp/scan
      operationId: mcpScanUrl
    - method: POST
      path: /api/v1/mcp/lock/check
      operationId: mcpLockCheck
    list: https://crawlcheck.io/api/v1/core
  description: 'Operations tagged Conduct across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Conduct
paths:
  /api/v1/conduct:
    get:
      operationId: conductV1
      summary: 'Agent conduct record: for every verifiable agent, what it did on crawlcheck.io…'
      responses:
        '200':
          description: crawlcheck-conduct
          content:
            application/json:
              examples:
                worked:
                  value:
                    kind: crawlcheck-conduct
                    v: 1
                    generated_at: '2026-10-07T04:00:00.000Z'
                    population: verifiable agents observed on crawlcheck.io
                    thresholds:
                      min_verified_requests: 50
                      published_rate_limit: null
                      disallowed_rules:
                      - /r/
                      - /backup/
                      - /admin-old/
                    agents:
                    - agent: GPTBot
                      operator: OpenAI
                      purpose: training
                      user_triggered: false
                      conduct: no_violations_observed
                      window:
                        first_seen: '2026-08-13T02:11:09.000Z'
                        last_seen: '2026-10-07T03:58:41.000Z'
                      identity:
                        verified_requests: 4013
                        forged_claims: 120
                        forgery_share: 0.029
                      robots_txt:
                        verdict: respected
                        robots_txt_fetches: 61
                        disallowed_fetches: 0
                        disallowed_rules:
                        - /r/
                        - /backup/
                        - /admin-old/
                      rate:
                        verdict: measured
                        peak_requests_per_minute: 4
                        peak_at: 2026-10-07T03:41
                        published_limit: null
                        measured_since: '2026-10-07T03:40:12.000Z'
                      revalidation:
                        conditional_requests: 0
                        share_of_verified_since_measured: 0
                        measured_since: '2026-10-07T03:40:12.000Z'
                      site_checks_14d:
                        checked: 6
                        verified: 2
                        spoofed: 4
                    not_assessed:
                    - agent: Amazonbot
                      claimed_hits: 20458
                      why: the operator publishes no address ranges, so no request can be tied to it; nothing it did here can be told from an impersonator
                    sha256: …
                    signature: …
              schema:
                type:
                - object
                - 'null'
                properties:
                  kind:
                    type:
                    - string
                    - 'null'
                  v:
                    type:
                    - number
                    - 'null'
                  generated_at:
                    type:
                    - string
                    - 'null'
                  population:
                    type:
                    - string
                    - 'null'
                  thresholds:
                    type:
                    - object
                    - 'null'
                    properties:
                      min_verified_requests:
                        type:
                        - number
                        - 'null'
                      published_rate_limit: {}
                      disallowed_rules:
                        type:
                        - array
                        - 'null'
                        items:
                          type:
                          - string
                          - 'null'
                    additionalProperties: true
                  agents:
                    type:
                    - array
                    - 'null'
                    items:
                      type:
                      - object
                      - 'null'
                      properties:
                        agent:
                          type:
                          - string
                          - 'null'
                        operator:
                          type:
                          - string
                          - 'null'
                        purpose:
                          type:
                          - string
                          - 'null'
                        user_triggered:
                          type:
                          - boolean
                          - 'null'
                        conduct:
                          type:
                          - string
                          - 'null'
                        window:
                          type:
                          - object
                          - 'null'
                          properties:
                            first_seen:
                              type:
                              - string
                              - 'null'
                            last_seen:
                              type:
                              - string
                              - 'null'
                          additionalProperties: true
                        identity:
                          type:
                          - object
                          - 'null'
                          properties:
                            verified_requests:
                              type:
                              - number
                              - 'null'
                            forged_claims:
                              type:
                              - number
                              - 'null'
                            forgery_share:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                        robots_txt:
                          type:
                          - object
                          - 'null'
                          properties:
                            verdict:
                              type:
                              - string
                              - 'null'
                            robots_txt_fetches:
                              type:
                              - number
                              - 'null'
                            disallowed_fetches:
                              type:
                              - number
                              - 'null'
                            disallowed_rules:
                              type:
                              - array
                              - 'null'
                              items:
                                type:
                                - string
                                - 'null'
                          additionalProperties: true
                        rate:
                          type:
                          - object
                          - 'null'
                          properties:
                            verdict:
                              type:
                              - string
                              - 'null'
                            peak_requests_per_minute:
                              type:
                              - number
                              - 'null'
                            peak_at:
                              type:
                              - string
                              - 'null'
                            published_limit: {}
                            measured_since:
                              type:
                              - string
                              - 'null'
                          additionalProperties: true
                        revalidation:
                          type:
                          - object
                          - 'null'
                          properties:
                            conditional_requests:
                              type:
                              - number
                              - 'null'
                            share_of_verified_since_measured:
                              type:
                              - number
                              - 'null'
                            measured_since:
                              type:
                              - string
                              - 'null'
                          additionalProperties: true
                        site_checks_14d:
                          type:
                          - object
                          - 'null'
                          properties:
                            checked:
                              type:
                              - number
                              - 'null'
                            verified:
                              type:
                              - number
                              - 'null'
                            spoofed:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                      additionalProperties: true
                  not_assessed:
                    type:
                    - array
                    - 'null'
                    items:
                      type:
                      - object
                      - 'null'
                      properties:
                        agent:
                          type:
                          - string
                          - 'null'
                        claimed_hits:
                          type:
                          - number
                          - 'null'
                        why:
                          type:
                          - string
                          - 'null'
                      additionalProperties: true
                  sha256: {}
                  signature: {}
                additionalProperties: true
                x-schema-source: worked-example
      x-codeSamples:
      - lang: Shell
        label: curl
        source: curl -s 'https://crawlcheck.io/api/v1/conduct'
      security: []
      x-auth: public; no credential read
      tags:
      - Conduct
    servers:
    - url: https://crawlcheck.io
  /api/v1/conduct/{agent}:
    get:
      operationId: conductAgentV1
      summary: The conduct record for one agent, e.g. GPTBot, signed on its own
      parameters:
      - name: agent
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: crawlcheck-conduct with one agent
          content:
            application/json:
              examples:
                worked:
                  value:
                    kind: crawlcheck-conduct
                    v: 1
                    generated_at: '2026-10-07T04:00:00.000Z'
                    agents:
                    - agent: GPTBot
                      operator: OpenAI
                      conduct: no_violations_observed
                      identity:
                        verified_requests: 4013
                        forged_claims: 120
                        forgery_share: 0.029
                      robots_txt:
                        verdict: respected
                        disallowed_fetches: 0
                      rate:
                        verdict: measured
                        peak_requests_per_minute: 4
                    sha256: …
                    signature: …
              schema:
                type:
                - object
                - 'null'
                properties:
                  kind:
                    type:
                    - string
                    - 'null'
                  v:
                    type:
                    - number
                    - 'null'
                  generated_at:
                    type:
                    - string
                    - 'null'
                  agents:
                    type:
                    - array
                    - 'null'
                    items:
                      type:
                      - object
                      - 'null'
                      properties:
                        agent:
                          type:
                          - string
                          - 'null'
                        operator:
                          type:
                          - string
                          - 'null'
                        conduct:
                          type:
                          - string
                          - 'null'
                        identity:
                          type:
                          - object
                          - 'null'
                          properties:
                            verified_requests:
                              type:
                              - number
                              - 'null'
                            forged_claims:
                              type:
                              - number
                              - 'null'
                            forgery_share:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                        robots_txt:
                          type:
                          - object
                          - 'null'
                          properties:
                            verdict:
                              type:
                              - string
                              - 'null'
                            disallowed_fetches:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                        rate:
                          type:
                          - object
                          - 'null'
                          properties:
                            verdict:
                              type:
                              - string
                              - 'null'
                            peak_requests_per_minute:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                      additionalProperties: true
                  sha256: {}
                  signature: {}
                additionalProperties: true
                x-schema-source: worked-example
        '404':
          description: not observed, or not verifiable
      x-codeSamples:
      - lang: Shell
        label: curl
        source: curl -s 'https://crawlcheck.io/api/v1/conduct/GPTBot'
      security: []
      x-auth: public; no credential read
      tags:
      - Conduct
    servers:
    - url: https://crawlcheck.io
components:
  securitySchemes:
    licenceKey:
      type: apiKey
      in: header
      name: x-crawlcheck-key
      description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
    bearer:
      type: http
      scheme: bearer
      description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
  url: https://crawlcheck.io/docs/api
  description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml