Open-source Python web crawler that turns any website into clean, LLM-ready Markdown for RAG, AI agents and data pipelines.
#rag
Open-source projects tagged “rag”
Curated GitHub repositories related to rag, with AI summaries and key stats.
Sort:Most stars
An open-source Chinese book on AI Agent design, built around Agent = LLM + context + tools, with runnable companion experiments per chapter.
Local, open-source PDF and document parser in Rust with text extraction, bounding boxes, Markdown/JSON output, and optional OCR.
Incremental data pipeline framework in Python with a Rust core that keeps vector indexes and knowledge graphs for AI agents continuously in sync with changing sources.
Visual RAG toolkit that renders web pages and PDFs as screenshots and retrieves over the images, keeping tables and charts intact.
A self-hosted Rust knowledge base that builds a bitemporal knowledge graph from documents, so facts carry when they held and when the system learned them.
Parses multi-language codebases into a knowledge graph and lets you query, search, and edit the code in plain English via an AI agent.
A CLI that compiles raw documents into an interlinked, LLM-maintained wiki knowledge base, using vectorless reasoning-based retrieval for long documents.
A Python library and runnable Jupyter textbook implementing 35 agentic AI architectures, from Reflexion and ReAct to MemGPT and BrowserAgent, on LangGraph.
A modular Agentic RAG tutorial and project built on LangGraph, with hierarchical indexing, conversation memory, and query clarification.
Self-hosted inference server that serves embedding, reranking, extraction, OCR, guardrail, and LLM models from one cluster in your own cloud.
A command-line toolkit that parses documents into markdown and runs local semantic keyword search and AI-powered Q&A over text files.
An educational JavaScript tutorial that builds retrieval-augmented generation step by step with local LLMs and no cloud APIs.
A learning repo of 30 runnable Jupyter notebooks that walk through agent memory techniques for LLM agents, from conversation buffers to Mem0, Letta, Zep and Graphiti.
Converts PDFs, Office files, scans, screenshots and diagrams into Markdown by sending pages to your own OpenAI-compatible vision model.
A Claude Code plugin that stores Claude's session memory, decisions and fixes in a single portable .mv2 file inside your project.