RalllyvsvLLM
Two self-hosted projects, compared on the numbers selfhost.directory tracks live: score, popularity, release cadence and setup effort.
| Rallly | vLLM | |
|---|---|---|
| Score | 70/100 | 91/100 |
| Rank in category | #1 of 8 in Scheduling & Booking | #3 of 25 in LLM Inference |
| GitHub stars | 5 331 | 95 819 |
| Stars, last 30 days | +62 | +3 175 |
| Stable releases, 12 months | 29 | 14 |
| Latest release | v4.16.3 · 26 Oct 2026 | v0.32.0 · 17 Oct 2026 |
| Setup | Easy | Moderate |
| Official Docker image | Yes | Yes |
| License | AGPL-3.0 | Apache-2.0 |
| Main language | Typescript | Python |
Which one should you pick?
vLLM scores 91/100 against 70/100 for Rallly, so it is the safer default.
Rallly ships more often: 29 stable releases in the past year, against 14 for vLLM.
If you want the quickest setup, Rallly is easier to run; vLLM needs more configuration.
vLLM is growing faster right now (+3 175 stars in 30 days).
Rallly details →vLLM details →
Swap a project
Keep Rallly, compare it with
Keep vLLM, compare it with