Home › Directory › Content Extraction › Crawl4AI
Crawl4AI
Open-source crawler that outputs markdown tuned for LLM pipelines, runnable locally or in Docker.
| Category | Content Extraction |
|---|---|
| Authentication | No auth |
| Pricing | Free |
| Website | https://github.com/unclecode/crawl4ai |
| Docs | https://docs.crawl4ai.com |
| Last checked | 2026-10-14 |
| As JSON | /api/v1/directory/crawl4ai.json |
Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with Crawl4AI. Suggest a correction.
More in Content Extraction
Jina Reader
Prefix a URL and get an LLM-friendly text version of the page back; a keyless tier exists with rate limits.
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
turndown
🛏 An HTML to Markdown converter written in JavaScript
Newspaper3k
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs: