lumi-4b
Side-by-side specs, memory needs, licence, runtimes and benchmarks. Add up to 4 models.
--vram
--gpus
--quant
--add
On your GPU
- lumi-4b
| Property | |
|---|---|
| Overview | |
| Task | Chat |
| Parameters | 4B |
| Active parameters | dense |
| Context length | 256K |
| Input → output | |
| Released | 27 Oct 2026 |
| Licence | Unknown licence |
| Gated download | no |
| Memory and speed | |
| Fits your hardwarepick a GPU above | ≈4.2 GB |
| VRAM at Q4 | ≈4.2 GB |
| VRAM at Q8 | ≈5.9 GB |
| VRAM at FP16 | ≈9.6 GB |
| Est. generation speedpick a GPU above | — |
| Popularity | |
| Downloads / 30 days | 3.4K |
| Likes | 68 |
| Runs with | |
| llama.cpp | |
| SGLang | |
| vLLM | |
| Ollama tag | — |
| Architecture | |
| Architecture | NemotronHForCausalLM |
| Layers | 42 |
| Attention / KV heads | 40 / 8 |
| Vocabulary | 131 072 |
| Weights dtype | bfloat16 |
| GGUF available | yes |
Keep comparing
Memory figures are estimates for an 8K context at the chosen quantisation (Q4_K_M for LLMs by default). Speeds are rough, memory-bound estimates. Self-reported benchmark scores come from the model authors.