CrawlGraph

CrawlGraph is a backlink-intelligence SaaS built on Common Crawl's open hyperlink graph (121.1M domains / 3.90B domain-level links), positioned as a low-cost alternative to Ahrefs, Moz, Semrush and Majestic. It offers referring-domain lookups with authority scoring, competitor gap analysis, warm outreach-target discovery, and cross-release change comparison. The product ships an unusually complete developer surface for a solo-operator SaaS: a public OpenAPI 3.1 contract, a self-serve free API tier (15 backlink calls a month, no card), a hosted remote MCP server whose tools publish both input and output schemas, an open-source local MCP package on npm, a published llms.txt, and open CC-BY study datasets. It is operated by Search Engine Wizards in Finland and priced as a one-time $99 lifetime licence rather than a subscription.

CrawlGraph publishes 2 APIs on the APIs.io network, including V1 API, and 1 more. Tagged areas include SEO, backlink-intelligence, MarTech, Competitive Intelligence, and Web Data.

CrawlGraph’s developer surface includes documentation, API reference, getting-started guide, engineering blog, authentication, code examples, pricing, and 29 more developer resources.

🌐 Visit website 📡 Source on GitHub

53.0/100 developing ▬ flat Agent 36/100 agent ready Front door AI 1/6 silent Full breakdown ↓
scored 2026-09-25 · rubric v0.23.0

AccessFreemiumSelf serveFree trial⚡ Free to try

2 APIs 1 MCP Servers

SEObacklink-intelligenceMarTech Competitive Intelligence Web DataCommon-CrawlLink BuildingDeveloper Tools MCP

Kin Score

Kin Score How this is scored →
scored 2026-09-25 · rubric v0.23.0

Composite quality — 53.0/100 · developing

Contract Quality 8.4 / 19

Developer Ergonomics 8.1 / 15

Access Clarity 9.7 / 15

Operational Transparency 5.1 / 10

Contract Governance 1.6 / 9

Discoverability 5.6 / 8

Regulatory Posture 4.6 / 15

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 36/100 · agent ready

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 12 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 8 / 8

Request/Response Examples 7 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 5 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

The six quality facets above are damped to 75 points between them, because the conditional facet above carries the other 25. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 75% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/crawlgraph: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 2

Individual APIs this provider publishes, each with its own machine-readable definition.

CrawlGraph MCP Server

Hosted remote Model Context Protocol server at https://crawlgraph.com/mcp over Streamable HTTP, plus an open-source local stdio fallback published to npm as crawlgraph-mcp (MIT)...

CrawlGraph V1 API

CrawlGraph public REST API v1 — backlink lookups, Common Crawl release discovery, async gap analysis, and cross-release change comparison.

Open Collections 1

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

CrawlGraph

OPEN COLLECTION

MCP Servers 1

Model Context Protocol servers that expose these APIs to AI agents.

CrawlGraph MCP Server

MCP SERVER

Pricing Plans 1

Published pricing tiers and plan structures.

Crawlgraph Plans Pricing

3 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Crawlgraph Rate Limits

4 limits

RATE LIMITS

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Crawlgraph Authentication

http · 1 scheme

SECURITY

Crawlgraph Domain Security

TLSv1.3 · HSTS

SECURITY

Crawlgraph Vulnerability Disclosure

security.txt · contact published

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Crawlgraph Agentic Access

6 operations · 3 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

DeveloperPortal

DeveloperPortal

GettingStarted

GettingStarted

Login

Documentation 3

Reference material describing how the API behaves

Documentation

Documentation

APIReference

APIReference

OpenAPI

OpenAPI

Agent Surfaces 5

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

MCPServer

AgentSkill

LLMsTxt

WellKnown

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

Conventions

ErrorCatalog

DataModel

Lifecycle

Conformance

Build 5

SDKs, sample code, and the tooling you integrate with

SourceCode

ToolCrosswalk

Packages

Examples

GitHubOrganization

GitHubOrganization

Access & Security 5

Authentication, authorization, and security posture

SecurityTxt

SecurityTxt

Security

Security

VulnerabilityDisclosure

VulnerabilityDisclosure

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 2

Status, limits, changes, and where to get help

RateLimits

RateLimits

Deprecation

Deprecation

Commercial 5

Pricing, plans, and the legal terms of use

License

TermsOfService

PrivacyPolicy

Plans

Pricing

Company 2

The organization behind the API

Website

Website

Blog

Blog

Other 1

Properties that don't map to a standard resource type

Overlay

Overlay

Source (apis.yml)

deliveryModel:
  model: unknown
  open_source: unknown
  commercial: true
  callable_host: true
  label: Delivery model not determined — needs a product licence on record
  confidence: low
  source:
  - openapi
  - pricing
  - repository-unlicensed
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: true
  try_now: true
  public: true
  label: Free tier · Self-serve signup · $99 lifetime
  confidence: high
  source:
  - plans
  - authentication
  - rate-limits
  generated: '2026-08-13'
  method: searched
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/crawlgraph.png
name: CrawlGraph
description: 'CrawlGraph is a backlink-intelligence SaaS built on Common Crawl''s open hyperlink graph (121.1M domains / 3.90B
  domain-level links), positioned as a low-cost alternative to Ahrefs, Moz, Semrush and Majestic. It offers referring-domain
  lookups with authority scoring, competitor gap analysis, warm outreach-target discovery, and cross-release change comparison.
  The product ships an unusually complete developer surface for a solo-operator SaaS: a public OpenAPI 3.1 contract, a self-serve
  free API tier (15 backlink calls a month, no card), a hosted remote MCP server whose tools publish both input and output
  schemas, an open-source local MCP package on npm, a published llms.txt, and open CC-BY study datasets. It is operated by
  Search Engine Wizards in Finland and priced as a one-time $99 lifetime licence rather than a subscription.'
url: https://raw.githubusercontent.com/api-evangelist/crawlgraph/refs/heads/main/apis.yml
created: '2026-07-03'
modified: '2026-09-02'
specificationVersion: '0.23'
tags:
- SEO
- backlink-intelligence
- MarTech
- Competitive Intelligence
- Web Data
- Common-Crawl
- Link Building
- Developer Tools
- MCP
tags_raw:
- SEO
- backlink-intelligence
- martech
- competitive-intelligence
- web-data
- Common-Crawl
- link-building
- developer-tools
- API
- MCP
apis:
- name: CrawlGraph MCP Server
  description: 'Hosted remote Model Context Protocol server at https://crawlgraph.com/mcp over Streamable HTTP, plus an open-source
    local stdio fallback published to npm as crawlgraph-mcp (MIT). Four tools — backlinks, gap_analysis, gap_outreach_targets,
    releases — each publishing a JSON Schema inputSchema AND outputSchema with behavioural annotations. tools/list answers
    anonymously; tool invocation uses the same cg_live_ bearer key and the same monthly quotas as the REST API. The gap_outreach_targets
    tool is MCP-value-added: it orchestrates the async gap job, tiers results by competitor overlap, filters platform/CDN
    noise, and authority-scores the top targets.'
  humanURL: https://crawlgraph.com/docs/api
  baseURL: https://crawlgraph.com/mcp
  tags:
  - MCP
  - Agents
  - SEO
  - backlink-intelligence
  - Developer Tools
  tags_raw:
  - MCP
  - agents
  - SEO
  - backlink-intelligence
  - developer-tools
  properties:
  - type: MCPServer
    url: mcp/crawlgraph-mcp.yml
  - type: ToolCrosswalk
    url: mcp/crawlgraph-tool-crosswalk.yml
  - type: Documentation
    url: https://crawlgraph.com/docs/api
  - type: SourceCode
    url: https://github.com/pucilpet/crawlgraph-mcp
- aid: crawlgraph:crawlgraph-v1-api
  name: CrawlGraph V1 API
  description: CrawlGraph public REST API v1 — backlink lookups, Common Crawl release discovery, async gap analysis, and cross-release
    change comparison.
  humanURL: https://crawlgraph.com/docs/api
  baseURL: https://crawlgraph.com/api/v1/
  tags:
  - v1
  properties:
  - type: OpenAPI
    url: openapi/crawlgraph-v1-api-openapi.yml
  - type: Documentation
    url: https://crawlgraph.com/docs/api
  - type: APIReference
    url: https://crawlgraph.com/docs/api
  - type: Authentication
    url: authentication/crawlgraph-authentication.yml
  - type: Conventions
    url: conventions/crawlgraph-conventions.yml
  - type: ErrorCatalog
    url: errors/crawlgraph-problem-types.yml
  - type: DataModel
    url: data-model/crawlgraph-data-model.yml
  - type: RateLimits
    url: rate-limits/crawlgraph-rate-limits.yml
  - type: Examples
    url: examples/crawlgraph-v1-examples.yml
  - type: LLMsTxt
    url: https://crawlgraph.com/llms.txt
maintainers:
- FN: Petteri Pucilowski (pucilpet)
  email: petteri@searchenginewizards.fi
  url: https://github.com/pucilpet
  organization: Search Engine Wizards
generated:
  by: apis.io/add
  model: claude-opus-4-8
  confidence: 85
  at: '2026-07-03T11:50:54.356Z'
common:
- type: Website
  url: https://www.crawlgraph.com/
- type: AgenticAccess
  url: agentic-access/crawlgraph-agentic-access.yml
- type: License
  name: MIT
  url: https://github.com/pucilpet/crawlgraph-mcp/blob/master/LICENSE
- type: DeveloperPortal
  url: https://crawlgraph.com/docs/api
- type: Documentation
  url: https://crawlgraph.com/docs/api
- type: APIReference
  url: https://crawlgraph.com/docs/api
- type: GettingStarted
  url: https://crawlgraph.com/docs/api
- type: Blog
  url: https://crawlgraph.com/blog
- type: SourceCode
  url: https://github.com/pucilpet/crawlgraph-mcp
- type: Login
  url: https://crawlgraph.com/login
- type: TermsOfService
  url: https://crawlgraph.com/terms
- type: PrivacyPolicy
  url: https://crawlgraph.com/privacy
- type: OpenAPI
  url: openapi/crawlgraph-v1-api-openapi.yml
- type: MCPServer
  url: mcp/crawlgraph-mcp.yml
- type: ToolCrosswalk
  url: mcp/crawlgraph-tool-crosswalk.yml
- type: AgentSkill
  url: skills/_index.yml
- type: LLMsTxt
  url: llms/crawlgraph-llms.txt
- type: WellKnown
  url: well-known/crawlgraph-well-known.yml
- type: SecurityTxt
  url: well-known/crawlgraph-security.txt
- type: Security
  url: security/crawlgraph-vulnerability-disclosure.yml
- type: VulnerabilityDisclosure
  url: security/crawlgraph-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/crawlgraph-domain-security.yml
- type: Authentication
  url: authentication/crawlgraph-authentication.yml
- type: Conventions
  url: conventions/crawlgraph-conventions.yml
- type: ErrorCatalog
  url: errors/crawlgraph-problem-types.yml
- type: DataModel
  url: data-model/crawlgraph-data-model.yml
- type: RateLimits
  url: rate-limits/crawlgraph-rate-limits.yml
- type: Plans
  url: plans/crawlgraph-plans-pricing.yml
- type: Lifecycle
  url: lifecycle/crawlgraph-lifecycle.yml
- type: Conformance
  url: conformance/crawlgraph-conformance.yml
- type: Packages
  url: packages/crawlgraph-packages.yml
- type: Overlay
  url: overlays/crawlgraph-v1-overlay.yaml
- type: Examples
  url: examples/crawlgraph-v1-examples.yml
- type: Pricing
  url: https://crawlgraph.com/#pricing
- type: GitHubOrganization
  url: https://github.com/pucilpet
- type: Deprecation
  url: lifecycle/crawlgraph-lifecycle.yml
x-enrichment:
  date: '2026-09-02'
  status: enriched
  artifacts_added: 3
  artifacts_updated: 16
  pass: local-v1
  previous:
  - date: '2026-08-13'
    status: enriched
    artifacts_added: 25
x-coverage:
  state: covered

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/crawlgraph"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/crawlgraph/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/crawlgraph/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.