# Lumabri

> Lumabri is a self-hosted, open-source system for running LLMs across LAN computers by distributing layers with donor approval, offering terminal and web chat.

- **Category:** Local AI
- **Licence:** Apache-2.0
- **Latest version:** v0.8.0
- **Open source:** oss
- **Languages:** C, Python
- **Platforms:** Build from Source
- **Tags:** Peer To Peer, Local Ai, LLM, Csharp, Self Hosted, Terminal ui, Llm inference, Distributed inference, Web Chat, Cluster Computing, Colibri, Model Sharding, Mixture Of Experts

## Description

Lumabri enables running large AI models that exceed a single machine's memory by distributing the workload across multiple computers on a local network. It relies on Colibri as the inference engine and assigns contiguous layer ranges to donor machines, each loading only its designated layers into memory. A household tracker coordinates the cluster, and every model preparation step requires explicit consent from each participating donor. The software provides a terminal-based interface for configuration and chat, along with a bundled web chat served through a local authenticated API. Approved model allocations remain resident in donor memory across sessions within set memory limits. Capabilities include calibration runs to gauge performance, elastic replica policies for managed API models, and HTTPS reverse-proxy support for remote access. The codebase is written in C and compiles from source alongside a compatible Colibri checkout. It has been tested on Linux, macOS (Intel and Apple Silicon), and Windows via WSL with a firewall helper. No Docker images or pre-built binaries are distributed.

## Links

- [Homepage](https://github.com/justvugg/lumabri)
- [GitHub Repository](https://github.com/JustVugg/lumabri)
- [Household Service Documentation](https://github.com/JustVugg/lumabri/blob/main/docs/HOUSEHOLD_SERVICE.md)
- [Resident API Documentation](https://github.com/JustVugg/lumabri/blob/main/docs/RESIDENT_API.md)
- [HTTPS Ingress Setup](https://github.com/JustVugg/lumabri/blob/main/docs/HTTPS_INGRESS.md)
- [Elastic Replicas Documentation](https://github.com/JustVugg/lumabri/blob/main/docs/ELASTIC_REPLICAS.md)
- [DeepSeek V4.1 Adapter](https://github.com/JustVugg/lumabri/blob/main/docs/DEEPSEEK_V41.md)
- [Repository Layout](https://github.com/JustVugg/lumabri/blob/main/docs/REPOSITORY.md)

---
Source: https://selfhost.directory/project/lumabri