Python CLI, library, MCP server and Astro integration that scores a website 0-100 on how well AI answer engines can crawl, understand and cite it.
1.1K125PythonMITUpdated 9 hours ago
#web-crawling
Open-source projects tagged “web-crawling”
Curated GitHub repositories related to web-crawling, with AI summaries and key stats.