llama.cppvsopen-compute
Two self-hosted projects, compared on the numbers selfhost.directory tracks live: score, popularity, release cadence and setup effort.
| llama.cpp | open-compute | |
|---|---|---|
| Score | 93/100 | 55/100 |
| Rank in category | #2 of 25 in LLM Inference | #3 of 7 in Serverless |
| GitHub stars | 132 621 | 2 365 |
| Stars, last 30 days | +3 264 | — |
| Stable releases, 12 months | 1455 | 9 |
| Latest release | b11963 · 28 Oct 2026 | v0.3.0 · 10 Oct 2026 |
| Setup | Moderate | Moderate |
| Official Docker image | Yes | No |
| License | MIT | Apache-2.0 |
| Main language | C++ | Rust |
Which one should you pick?
llama.cpp scores 93/100 against 55/100 for open-compute, so it is the safer default.
llama.cpp ships more often: 1455 stable releases in the past year, against 9 for open-compute.
llama.cpp is growing faster right now (+3 264 stars in 30 days).
llama.cpp details →open-compute details →