# Nex-N2.6

> Nex-N2.6 is a multimodal agentic model from Nex-AGI, built on GLM-5.3-Flash. It is designed for computer use, coding, and long-horizon tasks involving tools. This repository contains the FP8-quantized weights of Nex-N2.6, with approximately 321B parameters.

- **Organisation:** nex-agi
- **Category:** Vision-Language Models
- **Parameters:** 321B total, 18.3B active (MoE)
- **Context length:** 1,048,576 tokens
- **Licence:** Apache 2.0 (Commercial use OK)
- **Released:** 2026-11-10
- **Hugging Face:** 1.6K downloads (30 days), 137 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 126.3 |
| Q3_K_M | 176.57 |
| Q4_K_M | 213.49 |
| Q5_K_M | 246.49 |
| Q6_K | 281.84 |
| Q8_0 | 356.86 |
| F16 | 651.44 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [MLX](https://github.com/ml-explore/mlx-lm) (community)
- [Ollama](https://selfhost.directory/project/ollama) (community)

## About

Nex-N2.6 is a multimodal agentic model from Nex-AGI, built on GLM-5.3-Flash. It is designed for computer use, coding, and long-horizon tasks involving tools. This repository contains the FP8-quantized weights of Nex-N2.6, with approximately 321B parameters.

Following Nex-N2.5-Pro, this release focuses on reducing repetitive reasoning and improving adherence to the tools available in the current environment.

• 🔥 Less repetitive reasoning: Reasoning repetition fell from 16.0% to 1.6% compared with Nex-N2.5-Pro in our internal checkpoint-replay evaluation—a 90% relative reduction.
• 🛠️ Improved tool-list adherence: Nex-N2.6 achieved 100% tool-list adherence among responses making tool calls in our internal evaluation.
• 🖥️ Stronger computer use: Nex-N2.6 scored 83.0 on OSWorld, up from 82.2 for Nex-N2.5-Pro and 78.0 for the base model, GLM-5.3-Flash.

The following results are reported by the Nex-AGI team for this release. Scores depend on the evaluation harness and settings. These are model-level results, not a separate evaluation of this FP8 export.

## Alternatives

- [zai-org/GLM-5.3-Flash](https://selfhost.directory/models/zai-org/glm-5.3-flash) (321B (18.3B active), MIT, ≈213.49 GB at Q4): 👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.3-Flash blog and GLM-5 Technical report . 📍 Use GLM-5.3-Flash API services on Z.ai API Platform.
- [thinkingmachines/Inkling-Small](https://selfhost.directory/models/thinkingmachines/inkling-small) (266B (1.7B active), Apache 2.0, ≈159.48 GB at Q4): Inkling-Small is a general-purpose multimodal model that accepts text, image and audio inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages.
- [zai-org/GLM-5.3-Flash-BF16](https://selfhost.directory/models/zai-org/glm-5.3-flash-bf16) (321B (18.3B active), MIT, ≈213.49 GB at Q4): 👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.3-Flash blog and GLM-5 Technical report . 📍 Use GLM-5.3-Flash API services on Z.ai API Platform.
- [deepseek-ai/DeepSeek-V4-Flash-Vision-Exp](https://selfhost.directory/models/deepseek-ai/deepseek-v4-flash-vision-exp) (305B (15.2B active), MIT, ≈181.78 GB at Q4): We are excited to introduce DeepSeek-V4-Flash-Vision-Exp, our first experimental multimodal model in the DeepSeek-V4 family. It builds on the DeepSeek-V4-Flash architecture by incorporating visual modules and undergoing continued training to unlock visual understanding capabilities.
- [Qwen/Qwen3.5-397B-A17B](https://selfhost.directory/models/qwen/qwen3.5-397b-a17b) (403B (17B active), Apache 2.0, ≈240.59 GB at Q4): Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.
- [thinkingmachines/Inkling-2-Small](https://selfhost.directory/models/thinkingmachines/inkling-2-small) (383B, Apache 2.0, ≈229.1 GB at Q4): Inkling 2 Small is a general-purpose multimodal model that accepts text and image inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages.

More: https://selfhost.directory/models/nex-agi/nex-n2.6/alternatives

## Runs well on

- [Apple M3 Ultra (512 GB)](https://selfhost.directory/models/nex-agi/nex-n2.6/on/apple-m3-ultra-512gb): Q8_0, est. 23 tok/s

## Similar size

- [zai-org/GLM-5.3-Flash](https://selfhost.directory/models/zai-org/glm-5.3-flash) (321B)
- [thinkingmachines/Inkling-2-Small](https://selfhost.directory/models/thinkingmachines/inkling-2-small) (383B)
- [Qwen/Qwen3-VL-235B-A22B-Instruct](https://selfhost.directory/models/qwen/qwen3-vl-235b-a22b-instruct) (236B)
- [Qwen/Qwen3.5-397B-A17B](https://selfhost.directory/models/qwen/qwen3.5-397b-a17b) (403B)
- [thinkingmachines/Inkling-Small](https://selfhost.directory/models/thinkingmachines/inkling-small) (266B)
- [deepseek-ai/DeepSeek-V4-Flash-Vision-Exp](https://selfhost.directory/models/deepseek-ai/deepseek-v4-flash-vision-exp) (305B)

## FAQ

**How much VRAM does Nex-N2.6 need?**
About 213 GB at Q4_K_M with an 8K context. Q8_0 needs about 357 GB and full precision about 651 GB. Longer contexts need more memory for the KV cache.

**Can Nex-N2.6 run on the Apple M3 Ultra (512 GB)?**
Yes. It fits at Q8_0 (about 357 GB), at an estimated 23 tokens/s.

**Can I use Nex-N2.6 commercially?**
Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.

**What is the context length of Nex-N2.6?**
1,048,576 tokens (1M). The full window needs far more memory than an 8K context.

**How do I run Nex-N2.6 with Ollama or llama.cpp?**
With Ollama: ollama run hf.co/bartowski/Nex-N2.6-GGUF:Q4_K_M. With llama.cpp: llama-server -hf bartowski/Nex-N2.6-GGUF:Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/nex-agi/Nex-N2.6
- github: https://github.com/sii-nex/Nex-N2.6

---
Source: https://selfhost.directory/models/nex-agi/nex-n2.6