# Crawlee

**Canonical:** https://apis.io/providers/crawlee/  
**Website:** https://crawlee.dev/  
**APIs profiled:** 2

Crawlee is an open-source web scraping and crawling library maintained by Apify, providing a unified set of crawler classes, request queues, datasets, and key-value stores for building reliable scrapers. It is available for both JavaScript/TypeScript (Node.js) and Python, offering HTTP, Cheerio, JSDOM, LinkeDOM, Puppeteer, Playwright, and Stagehand crawler implementations along with proxy and session management utilities for production-grade scraping.

## Kin Score — 15.4 / 100 (emerging)

Scored 2026-08-20 under rubric 0.12.0. Trend: flat (+0.0 from 15.4).

| Facet | Score |
|---|---|
| Discoverability | 59.3 |
| Contract Quality | 0.0 |
| Governance | 0.0 |
| Contract Governance | 0.0 |
| Operational Transparency | 26.3 |
| Developer Ergonomics | 14.3 |
| Commercial Clarity | 15.8 |
| Access Clarity | 15.8 |

## Agent readiness — 3.0 (human-only)

| Dimension | Value |
|---|---|
| Spec Presence | no |
| Agentic Access | no |
| Reversibility Documented | no |
| MCP Server | no |
| Auth Clarity | no |
| Idempotency | no |
| Error Semantics | no |
| OpenAPI Examples | no |
| Rate Limit Signal | documented |
| Event Surface Described | no |
| Agent Skills | no |
| Well Known Catalog | no |
| Consent Identity | no |
| Agent Card | no |
| Dry Run Mode | no |

## Access

Freemium — onboarding: unknown, pricing: freemium, trial: no (confidence: medium).

## APIs (2)

- **Crawlee JavaScript SDK** — The Crawlee JavaScript SDK is a Node.js/TypeScript library for building reliable web scrapers and crawlers. It provides a family of crawler classes - BasicCrawler, HttpCrawler, ...
- **Crawlee Python SDK** — The Crawlee Python SDK is a Python library for building reliable web scrapers and crawlers. It offers BasicCrawler, HttpCrawler, BeautifulSoupCrawler, ParselCrawler, PlaywrightC...

## Security (1)

- **Crawlee Domain Security** — TLSv1.3 · HSTS · DNSSEC

## Plans (1)

- **Crawlee Plans Pricing**

## Tags

Apache 2.0, Apify, Browser Automation, Crawlers, Harvesting, JavaScript, Node.js, Open-Source, Playwright, Puppeteer, Python, Scraping, Web

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/providers/crawlee/). Scores are computed from the provider's own public artifacts under a published rubric.