Home › Directory › Scraping Libraries › Scrapy
Scrapy
Mature Python framework for writing fast, scalable crawlers and extracting structured data.
| Category | Scraping Libraries |
|---|---|
| Authentication | No auth |
| Pricing | Free |
| Website | https://scrapy.org/ |
| Docs | https://docs.scrapy.org |
| Last checked | 2026-10-14 |
| As JSON | /api/v1/directory/scrapy.json |
Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with Scrapy. Suggest a correction.
More in Scraping Libraries
Apache Nutch
Nutch is a highly extensible, highly scalable, matured, production-ready Web crawler which enables fine grained configuration and accomodates a wide variety of data acquisition tasks.
Crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Colly
Elegant Scraper and Crawler Framework for Golang.
Goutte
Goutte, a simple PHP Web Scraper.