# llama.cpp vs Rallly

> Two self-hosted projects, compared on the numbers selfhost.directory tracks live: score, popularity, release cadence and setup effort.

| | llama.cpp | Rallly |
|---|---|---|
| Score | 93/100 ✓ | 70/100 |
| Rank in category | #2 of 25 in LLM Inference | #1 of 8 in Scheduling & Booking |
| GitHub stars | 132 728 ✓ | 5 332 |
| Stars, last 30 days | +3 273 ✓ | +63 |
| Stable releases, 12 months | 1468 ✓ | 29 |
| Latest release | b11982 · 29 Oct 2026 ✓ | v4.16.3 · 26 Oct 2026 |
| Setup | Moderate | Easy ✓ |
| Official Docker image | Yes | Yes |
| License | MIT | AGPL-3.0 |
| Main language | C++ | Typescript |

## Which one should you pick?

llama.cpp scores 93/100 against 70/100 for Rallly, so it is the safer default.

llama.cpp ships more often: 1468 stable releases in the past year, against 29 for Rallly.

If you want the quickest setup, Rallly is easier to run; llama.cpp needs more configuration.

llama.cpp is growing faster right now (+3 273 stars in 30 days).

## Details

- [llama.cpp](https://selfhost.directory/project/llamacpp) (markdown: https://selfhost.directory/project/llamacpp.md)
- [Rallly](https://selfhost.directory/project/rallly) (markdown: https://selfhost.directory/project/rallly.md)

---
Source: https://selfhost.directory/compare/llamacpp-vs-rallly