Private AI knowledge bases and RAG: 26 open-source projects (2026)

All-in-one AI app for chatting with your documents and running AI agents, with local-first setup, multi-user support and many LLM providers.

A no-code RAG server that indexes a folder of documents into one of 8 vector databases and keeps answers in sync as files change.

A self-hosted, privacy-focused alternative to Google's NotebookLM for chatting with your sources and generating podcasts, with support for many AI providers.

Self-hostable AI second brain that answers questions from the web and your own documents, with custom agents and scheduled automations.

Open-source LLM knowledge platform from Tencent that turns documents into a RAG Q&A system, a reasoning agent, and an auto-maintained wiki.

Self-hosted AI chat and knowledge platform that indexes data from 50+ connected apps and works with most LLM providers.

Self-hosted platform for building AI agents and assistants that answer questions from your own documents, with citations and any model.

Air-gapped, open-source desktop app: a NotebookLM-style AI agent that researches, transforms and edits your local documents.

A local knowledge base Q&A system that lets you ask questions over your own files, including PDF, Word, Excel, Markdown and images, with offline deployment.

A local vector index and RAG toolkit that cuts storage by about 97% by recomputing embeddings on demand, so you can search personal data on your laptop.

A self-hosted Rust knowledge base that builds a bitemporal knowledge graph from documents, with RAG search, ontology-driven reasoning and MCP access for agents.

A Docker-based starter stack for building GenAI apps with LangChain, Neo4j, and Ollama, including support bot, PDF Q&A, and API demos.

A modular Agentic RAG tutorial and project built with LangGraph, featuring hierarchical indexing, conversation memory, and query clarification.

Self-hosted platform that connects Slack, Drive, Jira, GitHub and other business systems into a permission-aware knowledge base for search and AI agents.

A native macOS app for chatting with a local LLM that answers using your files, folders and websites, with no extra software needed.

Self-hosted, Rust-based agentic AI platform for organisations to run models, private data and internal tools on-premise or in air-gapped setups.

A local retrieval-augmented generation app that answers questions over your PDFs, Word and text files with citations to file and page, running on Ollama.

Self-hosted RAG stack for deploying a private ChatGPT-style assistant over your own PDFs and documents with open-source LLMs and Qdrant.

An offline AI assistant with a built-in survival and first-aid library that runs locally and cites the source passage for each answer.

Self-hosted enterprise knowledge hub that compiles company docs into a wiki and serves it to Claude and other LLMs via an MCP server with department-scoped access.

A free, open-source desktop app that writes and analyses from your own files with AI, and checks each sentence and figure against its sources.

Offline RAG app that ingests local files, GitHub repos and websites and answers questions with local Ollama models, keeping data on your network.

Open-source AIaaS platform for building RAG, agent, and visual-logic AI projects and exposing them through a REST API with a built-in web UI.

A Svelte and FastAPI chat app that lets you ask questions about a GitHub repository or uploaded source folder, using online or local LLMs.

Open-source GraphRAG and agent framework that answers multi-hop questions over a knowledge graph with citations, running locally via Ollama or in the cloud.

Self-hosted legal research platform that lets law firms query their own documents with RAG, check citations and review contracts.