Screaming Frog

Screaming Frog SEO Spider

The Screaming Frog SEO Spider is a desktop website crawler for Windows, macOS, and Ubuntu that performs comprehensive technical SEO audits. It crawls websites to find broken links, analyze page titles and meta data, discover duplicate content, generate XML sitemaps, and integrate with third-party APIs including Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs, Majestic, Moz, and AI services (OpenAI, Gemini, Ollama, Anthropic). The Spider acts as an API consumer, pulling external metrics and data into crawl reports.

Documentation GitHub

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/seo-spider"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

aid: screaming-frog:seo-spider
name: Screaming Frog SEO Spider
description: The Screaming Frog SEO Spider is a desktop website crawler for Windows, macOS, and Ubuntu
  that performs comprehensive technical SEO audits. It crawls websites to find broken links, analyze page
  titles and meta data, discover duplicate content, generate XML sitemaps, and integrate with third-party
  APIs including Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs, Majestic, Moz, and
  AI services (OpenAI, Gemini, Ollama, Anthropic). The Spider acts as an API consumer, pulling external
  metrics and data into crawl reports.
humanURL: https://www.screamingfrog.co.uk/seo-spider/
tags:
- SEO
- Crawler
- Technical Audit
- Analytics Integration
properties:
- type: Documentation
  url: https://www.screamingfrog.co.uk/seo-spider/user-guide/
- type: Pricing
  url: https://www.screamingfrog.co.uk/seo-spider/pricing/
- type: ReleaseHistory
  url: https://www.screamingfrog.co.uk/seo-spider/release-history/
- type: JSONSchema
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-schema/screaming-frog-crawl-result-schema.json
- type: JSONStructure
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-structure/screaming-frog-crawl-result-structure.json
- type: JSONLDContext
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-ld/screaming-frog-context.jsonld
- type: Vocabulary
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/vocabulary/screaming-frog-vocabulary.yml
- type: Examples
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/examples/screaming-frog-crawl-result-example.json
- type: MCPServer
  url: mcp/screaming-frog-mcp.yml
- type: CLI
  url: cli/screaming-frog-cli.yml
- type: AgentSkill
  url: skills/_index.yml
- type: DataModel
  url: data-model/screaming-frog-data-model.yml
- type: APIReference
  url: https://www.screamingfrog.co.uk/guides/mcp-server/
- type: GettingStarted
  url: https://www.screamingfrog.co.uk/seo-spider/tutorials/quick-start-guide/
- type: Support
  url: https://www.screamingfrog.co.uk/seo-spider/support/