name: Algolia Crawler API
description: Manages Algolia's hosted web crawler that extracts content from websites and pushes it into
indices on a schedule.
humanURL: https://www.algolia.com/doc/tools/crawler/getting-started/overview/
baseURL: https://crawler.algolia.com
tags:
- Crawler
- Ingestion
- REST
properties:
- type: Documentation
url: https://www.algolia.com/doc/tools/crawler/getting-started/overview/