Open-source web data platform that turns any website into a structured API via scraping, crawling, search, monitoring and AI extraction.
17.9K1.5KTypeScriptAGPL-3.0Updated 9 hours ago
#data-extraction
Curated GitHub repositories related to data-extraction, with AI summaries and key stats.
Open-source web data platform that turns any website into a structured API via scraping, crawling, search, monitoring and AI extraction.
Open-source Python web crawler that turns any website into clean, LLM-ready Markdown for RAG, AI agents and data pipelines.