CrawlCheck Agent Lens API

The Agent Lens API from CrawlCheck — 1 operation(s) for agent lens.

GitHub OpenAPI

Operations 1

GET /api/v1/agent-lens What each AI is served: the homepage fetched once by two browsers and by… #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-agent-lens-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

crawlcheck-io-agent-lens-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Crawlcheck Io Agent Lens API
  version: '1'
  contact:
    name: CrawlCheck
    url: https://crawlcheck.io/policy
    email: hello@crawlcheck.io
  license:
    name: Terms
    url: https://crawlcheck.io/policy
  x-core-contract:
    promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
    operations:
    - method: GET
      path: /api/v1/resolve
      operationId: resolveDomainV1
    - method: POST
      path: /api/v1/resolve
      operationId: resolveBatchV1
    - method: POST
      path: /api/v1/preflight
      operationId: preflightV1
    - method: GET
      path: /api/v1/decisions/{sha256}
      operationId: decisionCheckV1
    - method: GET
      path: /api/v1/revocations
      operationId: revocations
    - method: GET
      path: /api/v1/visitor
      operationId: visitorResolveV1
    - method: POST
      path: /api/v1/visitor
      operationId: visitorResolveBatchV1
    - method: GET
      path: /api/v1/mcp/scan
      operationId: mcpScanUrl
    - method: POST
      path: /api/v1/mcp/lock/check
      operationId: mcpLockCheck
    list: https://crawlcheck.io/api/v1/core
  description: 'Operations tagged Agent Lens across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Agent Lens
paths:
  /api/v1/agent-lens:
    get:
      operationId: agentLens
      summary: 'What each AI is served: the homepage fetched once by two browsers and by…'
      parameters:
      - name: domain
        in: query
        required: true
        schema:
          type: string
      responses:
        '200':
          description: crawlcheck-agent-lens
          content:
            application/json:
              examples:
                worked:
                  summary: Shape of the answer; values are not a measurement.
                  value:
                    kind: crawlcheck-agent-lens
                    v: 1
                    domain: example.com
                    url: https://example.com/
                    measured_at: '2026-10-29T15:00:00.000Z'
                    personas:
                    - id: chrome_desktop
                      claimed: Chrome (desktop)
                      label: Chrome (desktop)
                      kind: browser
                      status: 403
                      served: false
                      blocker: ''
                      result: refused HTTP 403
                      words: 0
                      prices: []
                      links:
                        internal: 0
                        external: 0
                      robots: null
                    - id: gptbot
                      claimed: GPTBot
                      label: Request claiming to be GPTBot
                      kind: agent
                      operator: OpenAI
                      status: 200
                      served: true
                      result: served
                      words: 812
                      prices:
                      - $150
                      links:
                        internal: 24
                        external: 3
                      robots:
                        allowed: true
                        named: false
                        why: 'falls under User-agent: *'
                    robots_only_tokens:
                    - token: Google-Extended
                      operator: Google
                      fetched: false
                      robots:
                        allowed: true
                        named: false
                    name_tag_test:
                      result: trusts_names
                      passed:
                      - GPTBot
                      reading: Both browsers were refused, twice, while a request that only claimed to be GPTBot was served, twice. …
                    summary:
                      browsers_served: 0
                      agents_served: 1
                      agents: 10
                      agents_refused: []
                      refused_though_robots_allows: []
                      served_under_half_the_browser_text: []
                      prices_not_in_agent_copy: []
                    from_kept_copy: false
                    sha256: …
                    signature: …
              schema:
                type:
                - object
                - 'null'
                properties:
                  kind:
                    type:
                    - string
                    - 'null'
                  v:
                    type:
                    - number
                    - 'null'
                  domain:
                    type:
                    - string
                    - 'null'
                  url:
                    type:
                    - string
                    - 'null'
                  measured_at:
                    type:
                    - string
                    - 'null'
                  personas:
                    type:
                    - array
                    - 'null'
                    items:
                      type:
                      - object
                      - 'null'
                      properties:
                        id:
                          type:
                          - string
                          - 'null'
                        claimed:
                          type:
                          - string
                          - 'null'
                        label:
                          type:
                          - string
                          - 'null'
                        kind:
                          type:
                          - string
                          - 'null'
                        status:
                          type:
                          - number
                          - 'null'
                        served:
                          type:
                          - boolean
                          - 'null'
                        blocker:
                          type:
                          - string
                          - 'null'
                        result:
                          type:
                          - string
                          - 'null'
                        words:
                          type:
                          - number
                          - 'null'
                        prices:
                          type:
                          - array
                          - 'null'
                          items:
                            type:
                            - string
                            - 'null'
                        links:
                          type:
                          - object
                          - 'null'
                          properties:
                            internal:
                              type:
                              - number
                              - 'null'
                            external:
                              type:
                              - number
                              - 'null'
                          additionalProperties: true
                        robots:
                          type:
                          - object
                          - 'null'
                          properties:
                            allowed:
                              type:
                              - boolean
                              - 'null'
                            named:
                              type:
                              - boolean
                              - 'null'
                            why:
                              type:
                              - string
                              - 'null'
                          additionalProperties: true
                        operator:
                          type:
                          - string
                          - 'null'
                      additionalProperties: true
                  robots_only_tokens:
                    type:
                    - array
                    - 'null'
                    items:
                      type:
                      - object
                      - 'null'
                      properties:
                        token:
                          type:
                          - string
                          - 'null'
                        operator:
                          type:
                          - string
                          - 'null'
                        fetched:
                          type:
                          - boolean
                          - 'null'
                        robots:
                          type:
                          - object
                          - 'null'
                          properties:
                            allowed:
                              type:
                              - boolean
                              - 'null'
                            named:
                              type:
                              - boolean
                              - 'null'
                          additionalProperties: true
                      additionalProperties: true
                  name_tag_test:
                    type:
                    - object
                    - 'null'
                    properties:
                      result:
                        type:
                        - string
                        - 'null'
                      passed:
                        type:
                        - array
                        - 'null'
                        items:
                          type:
                          - string
                          - 'null'
                      reading: {}
                    additionalProperties: true
                  summary:
                    type:
                    - object
                    - 'null'
                    properties:
                      browsers_served:
                        type:
                        - number
                        - 'null'
                      agents_served:
                        type:
                        - number
                        - 'null'
                      agents:
                        type:
                        - number
                        - 'null'
                      agents_refused:
                        type:
                        - array
                        - 'null'
                        items: {}
                      refused_though_robots_allows:
                        type:
                        - array
                        - 'null'
                        items: {}
                      served_under_half_the_browser_text:
                        type:
                        - array
                        - 'null'
                        items: {}
                      prices_not_in_agent_copy:
                        type:
                        - array
                        - 'null'
                        items: {}
                    additionalProperties: true
                  from_kept_copy:
                    type:
                    - boolean
                    - 'null'
                  sha256: {}
                  signature: {}
                additionalProperties: true
                x-schema-source: worked-example
        '400':
          description: not a public domain
        '429':
          description: new-reading limit
      x-codeSamples:
      - lang: Shell
        label: curl
        source: curl -s 'https://crawlcheck.io/api/v1/agent-lens?domain=example.com'
      security: []
      x-auth: public; no credential read
      tags:
      - Agent Lens
    servers:
    - url: https://crawlcheck.io
components:
  securitySchemes:
    licenceKey:
      type: apiKey
      in: header
      name: x-crawlcheck-key
      description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
    bearer:
      type: http
      scheme: bearer
      description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
  url: https://crawlcheck.io/docs/api
  description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml