MLExpert
Side-by-side specs, memory needs, licence, runtimes and benchmarks. Add up to 4 models.
--vram
--gpus
--quant
--add
On your GPU
- MLExpert
| Property | |
|---|---|
| Overview | |
| Task | Chat |
| Parameters | 34.7B |
| Active parameters | 3.5B |
| Context length | 256K |
| Input → output | |
| Released | 1 Oct 2026 |
| Licence | Apache 2.0 |
| Gated download | no |
| Memory and speed | |
| Fits your hardwarepick a GPU above | ≈22 GB |
| VRAM at Q4 | ≈22 GB |
| VRAM at Q8 | ≈37 GB |
| VRAM at FP16 | ≈69 GB |
| Est. generation speedpick a GPU above | — |
| Popularity | |
| Downloads / 30 days | 3.4K |
| Likes | 17 |
| Runs with | |
| Jan | |
| KoboldCpp | |
| llama.cpp | |
| LM Studio | |
| LocalAI | |
| Ollama | |
| SGLang | |
| Transformers | |
| vLLM | |
| Ollama tag | — |
| Architecture | |
| Architecture | Qwen3_5MoeForConditionalGeneration |
| Layers | 40 |
| Attention / KV heads | 16 / 2 |
| Vocabulary | 248 320 |
| Weights dtype | bfloat16 |
| GGUF available | yes |
Keep comparing
Memory figures are estimates for an 8K context at the chosen quantisation (Q4_K_M for LLMs by default). Speeds are rough, memory-bound estimates. Self-reported benchmark scores come from the model authors.