crawlerdata-com

CrawlerData provides a Google Search (SERP) API that returns organic search results, AI-generated overviews with sources, news, images, local business listings, and shopping data. The service offers both desktop and mobile result formats, enabling developers to integrate real-time Google search data into applications such as price monitoring, SEO tools, market research, and e‑commerce platforms. With endpoints for Google Shopping, Images, News, Local, and Autocomplete, CrawlerData delivers structured JSON responses that simplify consumption of Google’s search ecosystem.

crawlerdata-com publishes 4 API contracts indexed on the APIs.io network, including Custom Search-compatible API, Jobs API, Open WebUI API, and 1 more. Tagged areas include Search, API, Google, SERP, and Data.

The crawlerdata-com catalog on APIs.io includes 1 JSON-LD context and 1 Spectral governance ruleset.

crawlerdata-com’s developer surface includes authentication, signup flow, API reference, documentation, engineering blog, pricing, and 18 more developer resources.

56.8/100 strong Agent 54/100 agent ready Full breakdown ↓
scored 2026-10-31 · rubric v0.25.0 · Show this score on your site →
1 published contract 1 MCP Servers 1 Agent Skills
SearchAPIGoogleSERPDataE-commerceSEO

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-10-31 · rubric v0.25.0
Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.
Create-or-Update Ergonomics could not be measured. We hold no machine-readable contract for this provider to read, so there is nothing to measure a write surface against. Excluded rather than scored zero: never-measured and measured-empty are different facts. Publishing an OpenAPI is what makes this facet — and several others — scorable at all.
The six quality facets above are damped to 85 points between them, because the conditional facet above carries the other 15. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 85% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.
Show this score on your site. Kin Score badge preview for crawlerdata-com It updates itself when the score changes. Paste this where you link to your API docs:
<a href="https://apis.io/providers/crawlerdata-com/"><img src="https://apis.io/badge/crawlerdata-com/card.svg" alt="crawlerdata-com on APIs.io — Kin Score by API Evangelist"></a>
Other styles, a README pill and a shields.io endpoint are on the badge page.
Raise your score.
Agent readiness — checks not met, largest first (exact, from this profile):
  • Idempotency +9 pts — OpenAPI mutating operations declare an idempotency key — a header, a request-body property, or a named de-duplication token whose own description says so (verified); else common[].type matches /idempoten/i (documented)
  • A2A Agent Card +8 pts — a2a/-a2a.yml manifest, graded on conformance.grade against A2A 1.0.0
  • Typed Event Surface +6 pts — AsyncAPI document, OR webhooks/callbacks objects in the as-published OpenAPI, OR common[].type includes Webhooks
  • Documented Reversibility +6 pts — a reversal operation in the contract, graded up when a window is documented too
  • Agentic Commerce Well-Known Document +5 pts — a parsing /.well-known/ucp.json or acp.json declaring a version and at least one service — `self` when its endpoints are on the provider's own domain, `platform` when they are on a vendor's
  • Dry-Run / Simulate Mode +4 pts — OpenAPI: destructive operations expose a dry_run / simulate / preview / validate_only parameter
1 more unmet check in the Agent Readiness table above.
Kin Score — facets with the most composite points still available (weight × headroom):
Each check links to what satisfies it. Publish the artifact, or tell us where it already lives, and the score moves on the next scoring run.
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from the provider profile at artifacts.apis.io/crawlerdata-com/apis.yml: open an issue on github.com/api-evangelist/crawlerdata-com to ask a question or point us at an artifact you publish. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 4

Individual APIs this provider publishes, each with its own machine-readable definition.

crawlerdata-com Custom Search-compatible API

Google Custom Search JSON API parameters and response format: switch by changing the base URL and key

crawlerdata-com Jobs API

Submit and fetch scraping jobs

crawlerdata-com Open WebUI API

Open WebUI "External" web search provider

crawlerdata-com Serp API Compatible API

SerpApi parameters and response format: switch by changing the base URL

MCP Servers 1

Model Context Protocol servers that expose these APIs to AI agents.

crawlerdata-com MCP Server

Remote MCP server at api.crawlerdata.com.

MCP SERVER

Agent Skills 1

Packaged agent skills for driving this provider's APIs from an AI assistant.

submit-job

AGENT SKILL

Pricing Plans 1

Published pricing tiers and plan structures.

Rate Limits 1

Documented rate limits and quota policies.

Crawlerdata Com Rate Limits

0 limits

RATE LIMITS

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Crawlerdata Com Context

12 classes · 14 properties

JSON-LD

Spectral Rules 1

Spectral governance rulesets for linting and validating these APIs.

crawlerdata-com API Rules

18 rules · 14 errors 1 warnings 3 info

SPECTRAL

JSON Schema 6

Standalone JSON Schema definitions for this provider's data models.

GoogleImagesRequest

5 properties

JSON SCHEMA

GoogleLocalRequest

5 properties

JSON SCHEMA

GoogleNewsRequest

5 properties

JSON SCHEMA

GoogleSearchRequest

5 properties

JSON SCHEMA

GoogleShoppingProductRequest

5 properties

JSON SCHEMA

GoogleShoppingSearchRequest

5 properties

JSON SCHEMA

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Crawlerdata Com Domain Security

TLSv1.3 · DMARC

SECURITY

Scopes 1

OAuth scopes governing access to this provider's APIs.

Crawlerdata Com Scopes

OAuth 2.0 · no documented scopes

0 scopes

SCOPES

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Crawlerdata Com Agentic Access

5 operations · 2 acting

5 operations · 2 acting

AGENTIC

Resources

Get Started 1

Portal, sign-up, and the first successful call

Documentation 2

Reference material describing how the API behaves

Agent Surfaces 5

MCP servers, agent skills, and machine-readable catalogs

Design & Contract 6

Pagination, idempotency, versioning, errors, and events

Build 1

SDKs, sample code, and the tooling you integrate with

Access & Security 2

Authentication, authorization, and security posture

Commercial 4

Pricing, plans, and the legal terms of use

Company 2

The organization behind the API

Other 1

Properties that don't map to a standard resource type

Source (apis.yml)

apis.yml Raw ↑
aid: crawlerdata-com
name: crawlerdata-com
description: CrawlerData provides a Google Search (SERP) API that returns organic search results, AI-generated overviews with
  sources, news, images, local business listings, and shopping data. The service offers both desktop and mobile result formats,
  enabling developers to integrate real-time Google search data into applications such as price monitoring, SEO tools, market
  research, and e‑commerce platforms. With endpoints for Google Shopping, Images, News, Local, and Autocomplete, CrawlerData
  delivers structured JSON responses that simplify consumption of Google’s search ecosystem.
image: https://crawlerdata.com/logo.png
url: https://artifacts.apis.io/crawlerdata-com/apis.yml
x-type: company
x-source: harvest:mcp-registry
x-tier: profiled
x-tier-reason: enrichment pass 2026-10-30 (modular-v1; was harvest)
specificationVersion: '0.20'
created: '2026-10-30'
modified: '2026-10-30'
tags:
- Search
- API
- Google
- SERP
- Data
- E-commerce
- SEO
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: AgenticAccess
  url: agentic-access/crawlerdata-com-agentic-access.yml
- type: Plans
  url: plans/crawlerdata-com-plans-pricing.yml
- type: Spectral
  url: rules/crawlerdata-com-rules.yml
- type: JSONLD
  url: json-ld/crawlerdata-com-context.jsonld
- type: Vocabulary
  url: vocabulary/crawlerdata-com-vocabulary.yml
- type: AgentSkill
  url: skills/_index.yml
- type: DataModel
  url: data-model/crawlerdata-com-data-model.yml
- type: Authentication
  url: authentication/crawlerdata-com-authentication.yml
- type: ErrorCatalog
  url: errors/crawlerdata-com-problem-types.yml
- type: Conformance
  url: conformance/crawlerdata-com-conformance.yml
- type: LLMsTxt
  url: llms/crawlerdata-com-llms.txt
- type: MCPServer
  url: mcp/crawlerdata-com-mcp.yml
- type: WellKnown
  url: well-known/crawlerdata-com-well-known.yml
- type: Hosts
  url: hosts/crawlerdata-com-hosts.yml
- type: SignUp
  url: https://app.crawlerdata.com/register
- type: APIReference
  url: https://crawlerdata.com/llms.txt
- type: GitHubOrganization
  url: https://github.com/CrawlerData
- type: DomainSecurity
  url: security/crawlerdata-com-domain-security.yml
- type: Website
  url: https://crawlerdata.com/
- type: Documentation
  url: https://crawlerdata.com/apis/google-search-api
- type: Blog
  url: https://crawlerdata.com/blog
- type: Pricing
  url: https://crawlerdata.com/pricing
- type: TermsOfService
  url: https://crawlerdata.com/legal/terms
- type: PrivacyPolicy
  url: https://crawlerdata.com/legal/privacy
apis:
- aid: crawlerdata-com:crawlerdata-com-custom-search-compatible-api
  name: crawlerdata-com Custom Search-compatible API
  description: 'Google Custom Search JSON API parameters and response format: switch by changing the base URL and key'
  humanURL: https://crawlerdata.com/apis/google-search-api
  baseURL: https://api.crawlerdata.com
  tags:
  - Custom Search-compatible
  properties:
  - type: OpenAPI
    url: openapi/crawlerdata-com-custom-search-compatible-api-openapi.yml
  - type: Documentation
    url: https://crawlerdata.com/apis/google-search-api
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-product-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-local-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-news-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-images-request-schema.json
- aid: crawlerdata-com:crawlerdata-com-jobs-api
  name: crawlerdata-com Jobs API
  description: Submit and fetch scraping jobs
  humanURL: https://crawlerdata.com/apis/google-search-api
  baseURL: https://api.crawlerdata.com
  tags:
  - Jobs
  properties:
  - type: OpenAPI
    url: openapi/crawlerdata-com-jobs-api-openapi.yml
  - type: Documentation
    url: https://crawlerdata.com/apis/google-search-api
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-product-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-local-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-news-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-images-request-schema.json
- aid: crawlerdata-com:crawlerdata-com-open-webui-api
  name: crawlerdata-com Open WebUI API
  description: Open WebUI "External" web search provider
  humanURL: https://crawlerdata.com/apis/google-search-api
  baseURL: https://api.crawlerdata.com
  tags:
  - Open WebUI
  properties:
  - type: OpenAPI
    url: openapi/crawlerdata-com-open-webui-api-openapi.yml
  - type: Documentation
    url: https://crawlerdata.com/apis/google-search-api
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-product-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-local-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-news-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-images-request-schema.json
- aid: crawlerdata-com:crawlerdata-com-serpapi-compatible-api
  name: crawlerdata-com Serp API Compatible API
  description: 'SerpApi parameters and response format: switch by changing the base URL'
  humanURL: https://crawlerdata.com/apis/google-search-api
  baseURL: https://api.crawlerdata.com
  tags:
  - SerpApi-compatible
  properties:
  - type: OpenAPI
    url: openapi/crawlerdata-com-serpapi-compatible-api-openapi.yml
  - type: Documentation
    url: https://crawlerdata.com/apis/google-search-api
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-search-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-shopping-product-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-local-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-news-request-schema.json
  - type: JSONSchema
    url: json-schema/crawlerdata-com-google-images-request-schema.json
x-coverage:
  state: gated
  reason: partner-login
  method: derived
  generated: '2026-10-30'
  generator: derive-coverage.py (pre-flight evidence)
  detail: the company serves an API surface but requires credentials before any description of it can be read
  evidence:
  - url: https://api.crawlerdata.com/openapi.json
    status: null
  - url: https://app.crawlerdata.com/api/mcp
    status: 401
  - url: https://api.crawlerdata.com/mcp
    status: 401
  - url: https://crawlerdata.com/
    status: 200
x-enrichment:
  date: '2026-10-30'
  status: enriched
  artifacts_added: 36
  pass: modular-v1
  engine: identity=oss,contract=oss,surfaces=oss,docs=oss,regulatory=oss

crawlerdata-com API — frequently asked questions

Does crawlerdata-com have an API?

Yes. APIs.io lists 4 APIs from crawlerdata-com, including crawlerdata-com Custom Search-compatible API, crawlerdata-com Jobs API and crawlerdata-com Open WebUI API, and 1 more.

Is there an OpenAPI specification for the crawlerdata-com API?

Yes. APIs.io indexes 4 OpenAPI specifications for crawlerdata-com, each linked for download from this page.

How do I authenticate with the crawlerdata-com API?

crawlerdata-com documents its authentication (1 scheme). The details are profiled on APIs.io as Crawlerdata Com Authentication.

How much does the crawlerdata-com API cost?

APIs.io lists 4 pricing plans for crawlerdata-com, with each plan's price, limits and inclusions under Pricing Plans on this page.

Does crawlerdata-com have an MCP server?

Yes. APIs.io lists 1 MCP server for crawlerdata-com: Remote MCP server at api.crawlerdata.com.

Is the crawlerdata-com API ready for AI agents?

crawlerdata-com has a Kin Score of 56.8 out of 100 (strong) and an Agent Readiness score of 54.1 (agent-ready), scored by API Evangelist on 2026-10-31.

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this
  • find_providersBrowse and filter every provider in the catalog.
  • get_provider_artifactsEvery artifact this provider publishes, grouped by type.
  • get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
  • get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
  • get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
  • get_provider_ratingPRO — composite, band, trend and facet scores.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This provider
curl "https://apis.io/api/v1/providers/crawlerdata-com"
All providers
curl "https://apis.io/api/v1/providers?limit=25"
Every operation they expose
curl "https://apis.io/api/v1/providers/crawlerdata-com/operations?limit=25"
How their score was established
curl "https://apis.io/api/v1/providers/crawlerdata-com/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.