selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

GitHub
rag logo

Self-host rag

v0.14.0

Vector and graph RAG chat app powered by txtai and Streamlit

ReleaseOpen SourceApache-2.0
docker run -d --gpus=all -it -p 8501:8501 neuml/rag
Updated4 months ago
LanguagePython
Setup difficultyModerate
Stars
466
Port
8501 (Streamlit web UI)
Docker
neuml/rag
Upload dialog for adding a file path or URL to the indexAdding custom notes or raw text directly into the index

What is rag?

RAG with txtai is a Retrieval Augmented Generation web app built with Streamlit and backed by the txtai framework, aimed at getting answers out of your own documents with an LLM. It supports two RAG modes: classic vector RAG, where a vector search hydrates the prompt with the top matching sections, and Graph RAG, where context comes from graph query expansion (gq: prefix), concept path traversals (for example linux -> macos -> microsoft windows), or a combination of both; every Graph RAG answer also renders the underlying graph. Queries beginning with # load a file path, URL, or raw text straight into the Embeddings index, and the DATA variable can index a local directory at startup. Behaviour is tuned through environment variables (LLM, EMBEDDINGS, CONTEXT, MAXLENGTH, TEXTBACKEND, PERSIST and others), viewable in the UI by typing :settings. Self-hosting uses the published neuml/rag container image on port 8501, with GPU access passed through in the examples, or a Python virtual environment installed from requirements.txt and launched via the streamlit command. The LLM can be a Hugging Face model, a local Ollama server or an OpenAI model with an API key; no user login or authentication layer is documented.

Should you self-host rag?

rag scores 49/100 on selfhost.directory (how scoring works) and ranks #7 of 7 in RAG. It has 466 GitHub stars.

It shipped 3 stable releases in the past year. The latest, v0.14.0, came out on 5 June 2026. New versions land roughly every 3 months.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Python.

Its closest alternative on selfhost.directory is WeKnora (83/100, 35 745 stars). It scores higher overall, so compare the two before you pick. See rag vs WeKnora side by side.

Features

  • Document upload and URL ingestion
  • GPU Acceleration
  • Graph RAG
  • Graph visualization of answers
  • Persist index updates
  • Swappable LLM backend
  • Vector RAG

rag README

How to install rag

Install rag with Docker

docker run -d --gpus=all -it -p 8501:8501 neuml/rag

Recommended way to run the application; many configuration examples set env vars on this command.

How to configure rag

  • CONTEXT10RAG context size

    RAG context size

  • DATAOptional directory to index data from

    Optional directory to index data from

  • EMBEDDINGSEmbeddings database path

    Embeddings database path

  • EXAMPLESList of example queries separated by `;`

    List of example queries separated by `;`

  • LLMPath to the LLM model

    Path to the LLM model

  • MAXLENGTHMaximum generation length

    Maximum generation length

    values: 2048 for topics, 4096 for RAG

  • OLLAMA_API_BASEBase URL of an Ollama API when the LLM is set to an ollama/ model

    Base URL of an Ollama API when the LLM is set to an ollama/ model

  • OPENAI_API_KEYAPI key for OpenAI models set via LLM

    API key for OpenAI models set via LLM

  • PERSISTOptional directory to save index updates to

    Optional directory to save index updates to

  • SAFEOPENTrueEnable Textractor safeopen mode

    Enable Textractor safeopen mode

  • STRIPTHINKFalseStrip thinking text from responses

    Strip thinking text from responses

  • TEXTBACKENDavailableText extraction backend

    Text extraction backend

    values: e.g. docling

  • TITLEMain title of the application

    Main title of the application

  • TOPICSBATCHOptional batch size for LLM topic queries

    Optional batch size for LLM topic queries

rag releases & version history

More in RAG

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…