Ollama
LLM Inference
The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.
Self-hosted AI software runs models, assistants, and inference engines on hardware you own or control, rather than on a vendor's servers. More about AI
Picking a model to run on your own GPU? See which open-weight LLMs fit your hardware →
LLM Inference
AI
LLM Inference
AI
Web Scraping
Text to Speech
AI
LLM Inference
AI
AI
Image Generation
AI
AI
Developer Tools
AI
Cryptocurrency
Database Management
Web Scraping
Developer Tools
Monitoring & observability
Local AI
Search Engines
LLM Inference
AI
Code Review
AI
Video Surveillance
Search Engines
Ollama runs LLMs locally on macOS, Windows, and Linux and exposes a REST API with official SDKs. llama.cpp is a C/C++ inference engine that runs quantized models on CPU and GPU with minimal dependencies. vLLM focuses on throughput, using PagedAttention for LLM inference. Open-WebUI connects to Ollama and OpenAI-compatible APIs and adds RAG, plugins, and enterprise auth on your hardware.
378 self-hosted AI projects are listed here, ranked by popularity, maintenance and documentation.
| Project | License | Language | Stars | Docker | Setup | Latest release | Score |
|---|---|---|---|---|---|---|---|
| Ollama | MIT | Go | 187 202 | Yes | Easy | v0.40.16 | 94 |
| openclaw | MIT | Typescript | 394 569 | Yes | Moderate | v2026.11.4 | 93 |
| llama.cpp | MIT | C++ | 135 258 | Yes | Moderate | v1.0.0 | 93 |
| ComfyUI | GPL-3.0 | Python | 147 141 | — | Moderate | v0.45.0 | 92 |
| OmniVoice-Studio | AGPL-3.0 | Python | 111 668 | Yes | Moderate | v0.5.8 | 91 |
| firecrawl | AGPL-3.0 | Typescript | 202 228 | Yes | Advanced | v2.11.0 | 91 |
| Open-WebUI | BSD-3-Clause | Svelte | 158 812 | Yes | Moderate | v0.13.3 | 90 |
| vLLM | Apache-2.0 | Python | 97 025 | Yes | Moderate | v0.33.0rc3 | 90 |
| RAGFlow | Apache-2.0 | Go | 94 239 | Yes | Advanced | v1.0.0 | 89 |
| OmniRoute | MIT | Typescript | 87 951 | Yes | Easy | v3.8.53 | 89 |
| paperclip | MIT | Typescript | 114 258 | Yes | Moderate | v2026.1106.0 | 88 |
| AstrBot | AGPL-3.0 | Python | 47 033 | Yes | Moderate | v4.30.0-alpha.1 | 88 |