Python package and CLI for crawling websites and extracting main text, metadata and comments from raw HTML.
7K460PythonApache-2.0Updated 14 days ago
#corpus-builder
Curated GitHub repositories related to corpus-builder, with AI summaries and key stats.
Python package and CLI for crawling websites and extracting main text, metadata and comments from raw HTML.