Self-host rag
v0.14.0Vector and graph RAG chat app powered by txtai and Streamlit
docker run -d --gpus=all -it -p 8501:8501 neuml/rag- Stars
- 466
- Port
- 8501 (Streamlit web UI)
neuml/ragWhat is rag?
RAG with txtai is a Retrieval Augmented Generation web app built with Streamlit and backed by the txtai framework, aimed at getting answers out of your own documents with an LLM. It supports two RAG modes: classic vector RAG, where a vector search hydrates the prompt with the top matching sections, and Graph RAG, where context comes from graph query expansion (gq: prefix), concept path traversals (for example linux -> macos -> microsoft windows), or a combination of both; every Graph RAG answer also renders the underlying graph. Queries beginning with # load a file path, URL, or raw text straight into the Embeddings index, and the DATA variable can index a local directory at startup. Behaviour is tuned through environment variables (LLM, EMBEDDINGS, CONTEXT, MAXLENGTH, TEXTBACKEND, PERSIST and others), viewable in the UI by typing :settings. Self-hosting uses the published neuml/rag container image on port 8501, with GPU access passed through in the examples, or a Python virtual environment installed from requirements.txt and launched via the streamlit command. The LLM can be a Hugging Face model, a local Ollama server or an OpenAI model with an API key; no user login or authentication layer is documented.
Should you self-host rag?
rag scores 49/100 on selfhost.directory (how scoring works) and ranks #7 of 7 in RAG. It has 466 GitHub stars.
It shipped 3 stable releases in the past year. The latest, v0.14.0, came out on 5 June 2026. New versions land roughly every 3 months.
Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Python.
Its closest alternative on selfhost.directory is WeKnora (83/100, 35 745 stars). It scores higher overall, so compare the two before you pick. See rag vs WeKnora side by side.
Features
- Document upload and URL ingestion
- GPU Acceleration
- Graph RAG
- Graph visualization of answers
- Persist index updates
- Swappable LLM backend
- Vector RAG
rag README
More in RAG
SeekStormOpen-source Rust search engine with BM25 lexical and vector search fused in one hybrid query, multi-tenant REST server, web UI and MCP support. Self-hosted, free forever.
supermemorySelf-hosted AI memory and context server: Supermemory Local extracts facts, builds user profiles, and blends RAG with memory search through one API on port 6767.
surfsenseSelf-hosted, open-source NotebookLM alternative: an air-gapped desktop AI agent that researches, edits and transforms your documents with any local or hosted model.
TaskingAIAn open-source, self-hosted BaaS stack for building LLM agents: unified model APIs, RAG, built-in tools and an admin console, deployed with Docker Compose.
UtopiaSelf-hosted, open-source enterprise world model: a Rust binary plus Postgres/pgvector holding a bitemporal knowledge graph, with agentic RAG chat and an MCP server.
VaneSelf-hosted, open-source AI answering engine: searches via bundled SearxNG and answers with cited sources, using local Ollama models or OpenAI, Claude and Gemini.
vortexSelf-hosted RAG application for document chat with multiple LLM providers. Combines vector and keyword search, re-ranks results, and shows source citations.
WeKnoraTencent's open-source knowledge framework for teams: self-hosted RAG Q&A with citations, agents with sandboxed skills, and auto-generated wikis on swappable LLMs.
YuxiYuxi is an open-source, self-hosted knowledge agent platform combining Agentic RAG, Neo4j knowledge graphs, LangGraph multi-agent runs, MCP/Skills and sandboxes.
AGmindAGMind is a self-hosted, open-source installer deploying a private RAG stack on NVIDIA DGX Spark in ~30 minutes via an interactive wizard.
bishengAn Apache-2.0, self-hosted LLM devops platform for enterprise AI: GenAI workflows, RAG knowledge bases, agents, model management, evaluation, SFT and OCR.
CasibaseOpen-source personal AI assistant with RAG knowledge bases, MCP tool use and autonomous agent loops; one self-hosted binary with 30+ model providers, SSO and audit logs.


0 comments