LLMKubevsShimmy
Two self-hosted Ollama alternatives, compared on the numbers selfhost.directory tracks live: score, popularity, release cadence and setup effort.
| LLMKube | Shimmy | |
|---|---|---|
| Score | 54/100 | 54/100 |
| Rank in category | #35 of 125 in AI | #16 of 25 in LLM Inference |
| GitHub stars | 246 | 5 997 |
| Stars, last 30 days | — | +94 |
| Stable releases, 12 months | 59 | 19 |
| Latest release | v0.10.13 · 28 Oct 2026 | v2.6.5 · 19 Oct 2026 |
| Setup | Advanced | Moderate |
| Official Docker image | Yes | No |
| License | Apache-2.0 | Apache-2.0 |
| Main language | Go | Rust |
Which one should you pick?
LLMKube and Shimmy score the same (54/100), so the choice comes down to the details below.
LLMKube ships more often: 59 stable releases in the past year, against 19 for Shimmy.
If you want the quickest setup, Shimmy is easier to run; LLMKube needs more configuration.
Shimmy is growing faster right now (+94 stars in 30 days).
LLMKube details →Shimmy details → All Ollama alternatives →
Swap a project
Keep LLMKube, compare it with
Keep Shimmy, compare it with