# ZwZ2-27B

> ZwZ2-27B is the Qwen3.6-27B-based model in Zooming-without-Zooming-v2 (ZwZ2). It learns to connect visual evidence across regions through comparison, aggregation, matching, and multi-step reasoning. Training uses full images; inference requires no zooming tools.

- **Organisation:** inclusionAI
- **Category:** Vision-Language Models
- **Parameters:** 27.4B
- **Context length:** 262,144 tokens
- **Licence:** Unknown licence (Check licence)
- **Released:** 2026-10-16
- **Hugging Face:** 1.5K downloads (30 days), 15 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 11.29 |
| Q3_K_M | 15.57 |
| Q4_K_M | 18.72 |
| Q5_K_M | 21.53 |
| Q6_K | 24.54 |
| Q8_0 | 30.92 |
| F16 | 56 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)

## About

ZwZ2-27B is the Qwen3.6-27B-based model in Zooming-without-Zooming-v2 (ZwZ2). It learns to connect visual evidence across regions through comparison, aggregation, matching, and multi-step reasoning. Training uses full images; inference requires no zooming tools.

On 25 benchmarks across six domains, it improves over its base model on every benchmark, increasing overall accuracy from 55.52 to 60.51 (+4.99 points). Gains extend from fine-grained perception to spatial reasoning, long-context understanding, multimodal agents, and general visual reasoning.

EvidenceConnect builds verified multi-region questions from SA-1B images:

• Group 3–7 related regions and generate questions using privileged zoomed views.
• Check answers through cross-model agreement and drop-one region tests.
• Convert verified questions to four-option tasks and train with GRPO, without an additional supervised fine-tuning stage.

All three model sizes use approximately 20K training examples. The policy sees full images with colored region outlines; privileged crop layouts are used only for data construction. See ZwZ2-RL-VQA for the data schema and synthesis process.

Editable vector PDF. The figure shows eight representative benchmarks; the complete results follow.

## Alternatives

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.67 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding…
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.5-27B](https://selfhost.directory/models/qwen/qwen3.5-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.
- [google/diffusiongemma-26B-A4B-it](https://selfhost.directory/models/google/diffusiongemma-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.68 GB at Q4): DiffusionGemma is a generative model built by Google DeepMind. Based on the 26B A4B Mixture-of-Experts (MoE) Gemma 4 architecture, DiffusionGemma generates tokens using discrete diffusion. This open-weights model is multimodal, handling text, image, and video inputs to generate text output.

More: https://selfhost.directory/models/inclusionai/zwz2-27b/alternatives

## Runs well on

- [Tesla P40](https://selfhost.directory/models/inclusionai/zwz2-27b/on/tesla-p40): Q5_K_M, est. 9.8 tok/s
- [Radeon RX 7900 XTX](https://selfhost.directory/models/inclusionai/zwz2-27b/on/rx-7900-xtx): Q5_K_M, est. 27 tok/s
- [Instinct MI50 32GB](https://selfhost.directory/models/inclusionai/zwz2-27b/on/instinct-mi50): Q6_K, est. 25 tok/s
- [GeForce RTX 5090](https://selfhost.directory/models/inclusionai/zwz2-27b/on/rtx-5090): Q6_K, est. 44 tok/s
- [Apple M4 Pro (48 GB)](https://selfhost.directory/models/inclusionai/zwz2-27b/on/apple-m4-pro-48gb): Q8_0, est. 5.2 tok/s
- [RTX A6000](https://selfhost.directory/models/inclusionai/zwz2-27b/on/rtx-a6000): Q8_0, est. 15 tok/s

## Similar size

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B)
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B)
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B)
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B)
- [google/gemma-3-27b-it](https://selfhost.directory/models/google/gemma-3-27b-it) (27.4B)
- [meta-models/Muse-Glimmer-30B](https://selfhost.directory/models/meta-models/muse-glimmer-30b) (29.8B)

## FAQ

**How much VRAM does ZwZ2-27B need?**
About 19 GB at Q4_K_M with an 8K context. Q8_0 needs about 31 GB and full precision about 56 GB. Longer contexts need more memory for the KV cache.

**Can ZwZ2-27B run on the Tesla P40?**
Yes. It fits at Q5_K_M (about 21 GB), at an estimated 9.8 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.

**Can I use ZwZ2-27B commercially?**
Unclear. It is released under Unknown licence. No licence stated: assume all rights reserved. Check the licence on the model card before using it in a product.

**What is the context length of ZwZ2-27B?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run ZwZ2-27B with llama.cpp?**
Run llama-server -hf inclusionAI/ZwZ2-27B-GGUF:Q4_K_M. It downloads the GGUF and starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/inclusionAI/ZwZ2-27B
- github: https://github.com/inclusionAI/Zooming-without-Zooming
- paper: https://arxiv.org/abs/2602.11858

---
Source: https://selfhost.directory/models/inclusionai/zwz2-27b