Home › Directory › Content Extraction
Content Extraction
Libraries for extracting article text from web pages.
JSON: /api/v1/directory.json (filter on category=content-extraction)
trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
FreeNo authturndown
🛏 An HTML to Markdown converter written in JavaScript
FreeNo authNewspaper3k
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
FreeNo authReadability.js
A standalone version of the readability lib.
FreeNo authCommon Crawl News
CC-NEWS crawl of news articles.
FreeNo authNewspaper4k
Python library for article extraction and curation.
FreeNo auth