# Arete-27B

> We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. We call this new model Arete-27B.

- **Organisation:** NousResearch
- **Category:** Chat & Text Generation
- **Parameters:** 27.4B
- **Context length:** 262,144 tokens
- **Licence:** Apache 2.0 (Commercial use OK)
- **Released:** 2026-11-06
- **Hugging Face:** 7.5K downloads (30 days), 614 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 11.29 |
| Q3_K_M | 15.57 |
| Q4_K_M | 18.72 |
| Q5_K_M | 21.53 |
| Q6_K | 24.54 |
| Q8_0 | 30.92 |
| F16 | 56 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [vLLM](https://selfhost.directory/project/vllm)
- [ExLlamaV2](https://github.com/turboderp-org/exllamav2) (community)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [Ollama](https://selfhost.directory/project/ollama) (community)

## About

We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. We call this new model Arete-27B.

Open source models give labs the raw tools to mold intelligence to varied preferences. The values a model ships with should not be the only values its users get to choose from. We observed firsthand refusals, deflections, and CCP-framed answers on politically sensitive topics in Qwen3.8-27B, and post-trained to alter those biases.

On our evaluation, Arete-27B raised its fact score from 2.32 to 2.98 out of 5 and cut answers containing propaganda from 22% to 0.9%. The improvement held in all seven value categories, without a meaningful regression on the general-capability and agentic benchmarks we ran.

That is not to claim that we remedied all behaviors associated with the extant viewpoint, but that we have addressed a potential root cause. We believe it's important that labs and researchers continue to create models that align with their values and worldviews, and we are thankful that companies like Alibaba provide the raw materials to do so.

Blog post · Evaluation

We used supervised fine-tuning only. No RL, no preference optimization, and no architectural modification.

We focused on seven value categories:

• Freedom of expression
• State ideology
• State versus free market
• Education
• Data privacy and surveillance
• Democracy
• Environmental Policy

## Alternatives

- [nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://selfhost.directory/models/nvidia/nvidia-nemotron-3.5-lightning-30b-a3b-bf16) (31.6B (3B active), openmdw-1.1, ≈19.63 GB at Q4): NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.
- [farbodtavakkoli/OTel-2.0-LLM-31B-IT](https://selfhost.directory/models/farbodtavakkoli/otel-2.0-llm-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Versioning notice: This card describes the current OTel 2.0 OSFT checkpoint. The model weights may be updated over time. For reproducible evaluation or production deployment, pin a specific model revision, checkpoint hash, or release tag rather than relying on the floating latest version.
- [ornith-ai/Ornith-1.0-35B](https://selfhost.directory/models/ornith-ai/ornith-1.0-35b) (35B (3.8B active), MIT, ≈21.87 GB at Q4): Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
- [zai-org/GLM-4.7-Flash](https://selfhost.directory/models/zai-org/glm-4.7-flash) (31.2B (4.6B active), MIT, ≈26.35 GB at Q4): 👋 Join our Discord community. 📖 Check out the GLM-4.7 technical blog , technical report(GLM-4.5) . 📍 Use GLM-4.7-Flash API services on Z.ai API Platform. 👉 One click to GLM-4.7 .
- [poolside/Laguna-XS-2.1](https://selfhost.directory/models/poolside/laguna-xs-2.1) (33.4B (2.2B active), Custom licence, ≈21.58 GB at Q4): Laguna XS 2.1 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local machine.
- [nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](https://selfhost.directory/models/nvidia/nvidia-nemotron-3-nano-30b-a3b-bf16) (31.6B (3B active), nvidia-nemotron-open-model-license, ≈19.63 GB at Q4): Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.

More: https://selfhost.directory/models/nousresearch/arete-27b/alternatives

## Runs well on

- [Tesla P40](https://selfhost.directory/models/nousresearch/arete-27b/on/tesla-p40): Q5_K_M, est. 9.8 tok/s
- [Radeon RX 7900 XTX](https://selfhost.directory/models/nousresearch/arete-27b/on/rx-7900-xtx): Q5_K_M, est. 27 tok/s
- [Instinct MI50 32GB](https://selfhost.directory/models/nousresearch/arete-27b/on/instinct-mi50): Q6_K, est. 25 tok/s
- [GeForce RTX 5090](https://selfhost.directory/models/nousresearch/arete-27b/on/rtx-5090): Q6_K, est. 44 tok/s
- [Apple M4 Pro (48 GB)](https://selfhost.directory/models/nousresearch/arete-27b/on/apple-m4-pro-48gb): Q8_0, est. 5.2 tok/s
- [RTX A6000](https://selfhost.directory/models/nousresearch/arete-27b/on/rtx-a6000): Q8_0, est. 15 tok/s

## Similar size

- [openai/gpt-oss-20b](https://selfhost.directory/models/openai/gpt-oss-20b) (20.9B)
- [zai-org/GLM-4.7-Flash](https://selfhost.directory/models/zai-org/glm-4.7-flash) (31.2B)
- [Qwen/Qwen3-32B](https://selfhost.directory/models/qwen/qwen3-32b) (32.8B)
- [Qwen/Qwen3-30B-A3B](https://selfhost.directory/models/qwen/qwen3-30b-a3b) (30.5B)
- [LiquidAI/LFM2.5-24B-A2B](https://selfhost.directory/models/liquidai/lfm2.5-24b-a2b) (24B)
- [Qwen/Qwen2.5-32B-Instruct](https://selfhost.directory/models/qwen/qwen2.5-32b-instruct) (32.8B)

## FAQ

**How much VRAM does Arete-27B need?**
About 19 GB at Q4_K_M with an 8K context. Q8_0 needs about 31 GB and full precision about 56 GB. Longer contexts need more memory for the KV cache.

**Can Arete-27B run on the Tesla P40?**
Yes. It fits at Q5_K_M (about 23 GB), at an estimated 9.8 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.

**Can I use Arete-27B commercially?**
Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.

**What is the context length of Arete-27B?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run Arete-27B with Ollama or llama.cpp?**
With Ollama: ollama run hf.co/bartowski/NousResearch_Arete-27B-GGUF:Q4_K_M. With llama.cpp: llama-server -hf bartowski/NousResearch_Arete-27B-GGUF:Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/NousResearch/Arete-27B
- homepage: https://nousresearch.com/arete

---
Source: https://selfhost.directory/models/nousresearch/arete-27b