# Axion-1.0-35B

> This repository provides a reproduction checkpoint of Axion 1.0-35B, following the recipe described in Axion 1.0: Open Agent Foundation Models, Simplified. The model is designed for scientific reasoning, information seeking, and tool-augmented problem solving.

- **Organisation:** Axion1-0
- **Category:** Chat & Text Generation
- **Parameters:** 35.1B total, 3.9B active (MoE)
- **Context length:** 262,144 tokens
- **Licence:** Apache 2.0 (Commercial use OK)
- **Released:** 2026-10-16
- **Hugging Face:** 1.8K downloads (30 days), 76 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 12.41 |
| Q3_K_M | 17.9 |
| Q4_K_M | 21.94 |
| Q5_K_M | 25.54 |
| Q6_K | 29.41 |
| Q8_0 | 37.6 |
| F16 | 69.79 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [Ollama](https://selfhost.directory/project/ollama) (community)

## About

This repository provides a reproduction checkpoint of Axion 1.0-35B, following the recipe described in Axion 1.0: Open Agent Foundation Models, Simplified. The model is designed for scientific reasoning, information seeking, and tool-augmented problem solving.

The training recipe combines approximately 18K SFT examples with three stages:

• Learn to reason: supervised fine-tuning on challenging, self-contained scientific problems constructed with model-aware feedback.
• Learn to investigate: supervised fine-tuning on verifiable tasks requiring external information and tool use.
• Learn through interaction: reinforcement learning over agent trajectories to refine reasoning and interaction with tools.

The table compares paper-reported results with the results of the reproduction checkpoint released in this repository. All scores are percentages; higher is better.

HLE denotes the full Humanity's Last Exam benchmark; BMB uses the human-difficult BioMysteryBench subset. FS denotes FrontierScience. A dash indicates an unreported result. Bold highlights the reproduction checkpoint released in this repository.

## Alternatives

- [ornith-ai/Ornith-1.0-35B](https://selfhost.directory/models/ornith-ai/ornith-1.0-35b) (35B (3.8B active), MIT, ≈21.87 GB at Q4): Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
- [nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://selfhost.directory/models/nvidia/nvidia-nemotron-3.5-lightning-30b-a3b-bf16) (31.6B (3B active), openmdw-1.1, ≈19.63 GB at Q4): NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.
- [farbodtavakkoli/OTel-2.0-LLM-31B-IT](https://selfhost.directory/models/farbodtavakkoli/otel-2.0-llm-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Versioning notice: This card describes the current OTel 2.0 OSFT checkpoint. The model weights may be updated over time. For reproducible evaluation or production deployment, pin a specific model revision, checkpoint hash, or release tag rather than relying on the floating latest version.
- [ornith-ai/Ornith-1.5-35B-A3B](https://selfhost.directory/models/ornith-ai/ornith-1.5-35b-a3b) (36B (3B active), MIT, ≈22.44 GB at Q4): Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
- [poolside/Laguna-XS-2.1](https://selfhost.directory/models/poolside/laguna-xs-2.1) (33.4B (2.2B active), Custom licence, ≈21.58 GB at Q4): Laguna XS 2.1 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local machine.
- [poolside/Laguna-XS.2](https://selfhost.directory/models/poolside/laguna-xs.2) (33.4B (2.2B active), Apache 2.0, ≈21.58 GB at Q4): Laguna XS.2 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local machine. It uses Sliding Window Attention with per-head gating in 30 out of 40 layers for fast inference and low KV cache requirements.

More: https://selfhost.directory/models/axion1-0/axion-1.0-35b/alternatives

## Runs well on

- [Tesla P40](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/tesla-p40): Q4_K_M, est. 81 tok/s
- [Radeon RX 7900 XTX](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/rx-7900-xtx): Q4_K_M, est. 223 tok/s
- [Instinct MI50 32GB](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/instinct-mi50): Q6_K, est. 175 tok/s
- [GeForce RTX 5090](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/rtx-5090): Q6_K, est. 307 tok/s
- [Apple M4 Pro (48 GB)](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/apple-m4-pro-48gb): Q6_K, est. 47 tok/s
- [RTX A6000](https://selfhost.directory/models/axion1-0/axion-1.0-35b/on/rtx-a6000): Q8_0, est. 102 tok/s

## Similar size

- [zai-org/GLM-4.7-Flash](https://selfhost.directory/models/zai-org/glm-4.7-flash) (31.2B)
- [ornith-ai/Ornith-1.5-35B-A3B](https://selfhost.directory/models/ornith-ai/ornith-1.5-35b-a3b) (36B)
- [RecursiveSI/flint](https://selfhost.directory/models/recursivesi/flint) (39.8B)
- [Qwen/Qwen3-32B](https://selfhost.directory/models/qwen/qwen3-32b) (32.8B)
- [Qwen/Qwen3-30B-A3B](https://selfhost.directory/models/qwen/qwen3-30b-a3b) (30.5B)
- [Qwen/Qwen2.5-32B-Instruct](https://selfhost.directory/models/qwen/qwen2.5-32b-instruct) (32.8B)

## FAQ

**How much VRAM does Axion-1.0-35B need?**
About 22 GB at Q4_K_M with an 8K context. Q8_0 needs about 38 GB and full precision about 70 GB. Longer contexts need more memory for the KV cache.

**Can Axion-1.0-35B run on the Tesla P40?**
Yes. It fits at Q4_K_M (about 22 GB), at an estimated 81 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.

**Can I use Axion-1.0-35B commercially?**
Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.

**What is the context length of Axion-1.0-35B?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run Axion-1.0-35B with Ollama or llama.cpp?**
With Ollama: ollama run hf.co/mradermacher/Axion-1.0-35B-GGUF:Q4_K_M. With llama.cpp: llama-server -hf mradermacher/Axion-1.0-35B-GGUF:Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/Axion1-0/Axion-1.0-35B
- homepage: https://axion1-0.github.io/
- github: https://github.com/bytedance/axion1_0
- paper: https://arxiv.org/abs/2611.03233

---
Source: https://selfhost.directory/models/axion1-0/axion-1.0-35b