llmfit
Local AI
v1.1.18
llmfit tells you which open-source large language models your machine can realistically run.todayMITDockerEasy
Projects tagged #Llama Cpp
~/index>
--sort
34 projects· by score
Projects
koboldcpp
LLM Inference
v1.123.1KoboldCpp is an AI text-generation server you run yourself, packaged as one standalone file and inspired by KoboldAI while building on llama.cpp.12d agoAGPL-3.0DockerDemoEasy
Text Generation WebUI
AI Chat
v4.9TextGen is an open-source program by oobabooga that puts large language models on your own computer: a Gradio-based interface (or a bundled Electron window) …5mo agoAGPL-3.0No DockerEasy
llama-swap
AI Workflows
v268A lightweight Go binary that manages multiple AI inference servers and switches between them based on incoming API requests.todayMITDockerModerate
DreamServer
Local AI
v3.0.0ODS (Osmantic Deployment System) is a local AI server stack running on your own hardware without cloud dependencies.1mo agoApache-2.0No DockerModerate
llama-gpt
AI Chat
1.0.1LlamaGPT is Umbrel's packaged local chatbot: a web chat front-end plus a llama-cpp-python model server, so a Llama 2 or Code Llama weights file answers promp…3y agoMITDockerModerate
ATLAS
AI Agents
v3.1.7ATLAS is a local-first AI coding agent from the open lab Inferstep; its name expands to Adaptive Test-time Learning plus Autonomous Specialization.2d agoAGPL-3.0DockerModerate
Mirobody
Healthcare
1.5.9Mirobody gathers lab reports, wearable exports, journal notes and genetic files into one coded record, using bundled LOINC, ICPC-3 and UCUM vocabularies so t…todayApache-2.0DockerDemoModerate
airunner
Image Generation
v6.1.8AI Runner is an offline, GPL-3.0 licensed AI engine from Capsize that pairs two experiences: a configurable chat companion with a named persona, chosen voice…2d agoGPL-3.0DockerAdvanced
LLMKube
AI
llmkube-0.10.13LLMKube is a Kubernetes operator for teams running LLM inference on their own mixed hardware — NVIDIA datacenter GPUs, AMD and Intel GPUs, and Apple Silicon …todayApache-2.0DockerAdvanced
Oriveo Community Edition
AI Chat
v1.1.0Oriveo Community Edition is a bring-your-own-key AI chat application for iPhone, Android, and browsers, with a Mac version in progress.5d agoAGPL-3.0No DockerModerate
jevos
Local AI
jevos-v5jevos is a small decision model plus a single server binary that gives probabilistic answers to yes/no questions, multiple-choice routing and scored ratings,…10d agoMITNo DockerEasy
Adrian
Security
python-sdk-v1.2.1Adrian is an open-source runtime security engine for AI agents.7d agoApache-2.0No DockerAdvanced
ggrun
LLM Inference
v3.2.12ggrun (from "gguf run") is a launcher for running local large language models on your own hardware.todayMITNo DockerModerate
CarWatch
Home Automation
v0.7.0CarWatch is a self-hosted automotive agent that runs on a Raspberry Pi 5 installed in your car.19d agoAGPL-3.0No DockerAdvanced
AI-Git-Bot
Code Review
1.29.0AI-Git-Bot is a self-hosted automation layer that connects to your Git hosting platform and AI provider to handle engineering chores.todayMITDockerModerate
olla
AI
v0.0.29Olla is a lightweight proxy and load balancer built for LLM infrastructure.todayApache-2.0DockerModerate
Turbo-LLM
LLM Inference
v1.14.5TurboLLM is a self-hosted local LLM platform that runs any inference engine — llama.cpp, community forks, vLLM, MLX, KoboldCpp, llamafile, and more — auto-tu…todayFSL-1.1-ALv2No DockerModerate
Lexicon
Notes & Editors
v0.10.3Lexicon is a local-first desktop writing assistant that merges a distraction-free rich-text editor with built-in proofreading and AI-powered rewriting.todayMITNo DockerEasy
hal0
AI Chat
v1.7.1hal0 is a self-hosted AI inference platform designed for AMD Strix Halo hardware but with fallbacks for other AMD GPUs, NVIDIA GPUs, and CPU-only machines.todayApache-2.0No DockerModerate
llamactl
LLM Inference
v0.22.1llamactl is a self-hosted control plane that lets you run and manage local LLM inference servers.todayMITNo DockerModerate
Reame
LLM Inference
v2.0.0Reame is an LLM inference server designed for CPU-only environments, especially free-tier ARM cloud instances.16d agoMITNo DockerDemoAdvanced
disp8ch
AI Agents
v1.5.0disp8ch is a local-first AI workspace that gives your chat a company to run.1mo agoMITNo DockerModerate
Knowledge Graph Extractor is a self-hosted application that converts unstructured text — pasted content, fetched URLs, or zip archives of documents — into an…knowledge-graph-extractor
Knowledge Management
4mo agoMITNo DockerAdvanced
YALS
LLM Inference
2026.03.28.1601-3610610YALS (Yet Another Llama.cpp Server) is a hobby project that provides an OpenAI-compatible REST API for running GGUF-format large language models locally via …7mo agoAGPL-3.0No DockerModerate
libre-chat
AI Chat
0.0.6Libre Chat is a free and open-source chatbot web service that lets you run large language models locally on your own hardware.1y agoMITDockerModerate
llmaker is a command-line tool for deploying and managing complete LLM stacks locally.llmaker
AI
3mo agoNo DockerModerate
code-index
Developer Tools
server/v0.15.0cix (CodeIndeX) is a self-hosted semantic code search platform designed for developers and teams who want to search their codebases by meaning rather than ex…7d agoMITDockerModerate
PrivateDocBot is a self-hosted chatbot for querying PDF documents locally.PrivateDocBot
AI Chat
1y agoApache-2.0No DockerAdvanced
