Inkling-2-Mini
Side-by-side specs, memory needs, licence, runtimes and benchmarks. Add up to 4 models.
--vram
--gpus
--quant
--add
On your GPU
- Inkling-2-Mini
| Property | |
|---|---|
| Overview | |
| Task | Vision |
| Parameters | 26.4B |
| Active parameters | 3.5B |
| Context length | 1M |
| Input → output | |
| Released | 17 Nov 2026 |
| Licence | Apache 2.0 |
| Gated download | no |
| Memory and speed | |
| Fits your hardwarepick a GPU above | ≈17 GB |
| VRAM at Q4 | ≈17 GB |
| VRAM at Q8 | ≈29 GB |
| VRAM at FP16 | ≈53 GB |
| Est. generation speedpick a GPU above | — |
| Popularity | |
| Downloads / 30 days | 7.9K |
| Likes | 3.1K |
| Runs with | |
| Jan | |
| KoboldCpp | |
| llama.cpp | |
| LM Studio | |
| LocalAI | |
| MLX | |
| Ollama | |
| Transformers | |
| Ollama tag | inkling-2-mini |
| Architecture | |
| Architecture | Inkling2LoopForConditionalGeneration |
| Layers | 24 |
| Attention / KV heads | 24 / 8 |
| Vocabulary | 201 024 |
| Weights dtype | bfloat16 |
| GGUF available | yes |
Keep comparing
Memory figures are estimates for an 8K context at the chosen quantisation (Q4_K_M for LLMs by default). Speeds are rough, memory-bound estimates. Self-reported benchmark scores come from the model authors.