# HuatuoGPT-3-27B

> HuatuoGPT-3-27B is a medical LLM built on Qwen3.8-27B with One-stage Policy Optimization (OnePO). OnePO adapts language models to medicine in a single reinforcement-learning stage, without preceding domain-specific supervised fine-tuning.

- **Organisation:** FreedomIntelligence
- **Category:** Vision-Language Models, Reasoning Models
- **Parameters:** 27B
- **Context length:** 262,144 tokens
- **Licence:** Apache 2.0 (Commercial use OK)
- **Released:** 2026-09-24
- **Hugging Face:** 2.4K downloads (30 days), 11 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 11.18 |
| Q3_K_M | 15.4 |
| Q4_K_M | 18.51 |
| Q5_K_M | 21.28 |
| Q6_K | 24.25 |
| Q8_0 | 30.55 |
| F16 | 55.31 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [Ollama](https://selfhost.directory/project/ollama) (community)

## About

HuatuoGPT-3-27B is a medical LLM built on Qwen3.8-27B with One-stage Policy Optimization (OnePO). OnePO adapts language models to medicine in a single reinforcement-learning stage, without preceding domain-specific supervised fine-tuning. Teacher responses provide temporary guidance and are retired as the model improves.

We release the training code, medical RL dataset, and 8B rubric grader.

HuatuoGPT-3 requires thinking mode. Keep enable_thinking=True during inference. The model generates reasoning before providing its final answer after .

## Alternatives

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.67 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding…
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.5-27B](https://selfhost.directory/models/qwen/qwen3.5-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.
- [google/diffusiongemma-26B-A4B-it](https://selfhost.directory/models/google/diffusiongemma-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.68 GB at Q4): DiffusionGemma is a generative model built by Google DeepMind. Based on the 26B A4B Mixture-of-Experts (MoE) Gemma 4 architecture, DiffusionGemma generates tokens using discrete diffusion. This open-weights model is multimodal, handling text, image, and video inputs to generate text output.

More: https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/alternatives

## Runs well on

- [Tesla P40](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/tesla-p40): Q5_K_M, est. 9.9 tok/s
- [Radeon RX 7900 XTX](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/rx-7900-xtx): Q5_K_M, est. 27 tok/s
- [Instinct MI50 32GB](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/instinct-mi50): Q6_K, est. 25 tok/s
- [GeForce RTX 5090](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/rtx-5090): Q6_K, est. 44 tok/s
- [Apple M4 Pro (48 GB)](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/apple-m4-pro-48gb): Q8_0, est. 5.2 tok/s
- [RTX A6000](https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b/on/rtx-a6000): Q8_0, est. 15 tok/s

## Similar size

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B)
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B)
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B)
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B)
- [google/gemma-3-27b-it](https://selfhost.directory/models/google/gemma-3-27b-it) (27.4B)
- [meta-models/Muse-Glimmer-30B](https://selfhost.directory/models/meta-models/muse-glimmer-30b) (29.8B)

## FAQ

**How much VRAM does HuatuoGPT-3-27B need?**
About 19 GB at Q4_K_M with an 8K context. Q8_0 needs about 31 GB and full precision about 55 GB. Longer contexts need more memory for the KV cache.

**Can HuatuoGPT-3-27B run on the Tesla P40?**
Yes. It fits at Q5_K_M (about 21 GB), at an estimated 9.9 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.

**Can I use HuatuoGPT-3-27B commercially?**
Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.

**What is the context length of HuatuoGPT-3-27B?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run HuatuoGPT-3-27B with Ollama or llama.cpp?**
With Ollama: ollama run hf.co/mradermacher/HuatuoGPT-3-27B-i1-GGUF:Q4_K_M. With llama.cpp: llama-server -hf mradermacher/HuatuoGPT-3-27B-i1-GGUF:Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/FreedomIntelligence/HuatuoGPT-3-27B
- github: https://github.com/FreedomIntelligence/HuatuoGPT-3

---
Source: https://selfhost.directory/models/freedomintelligence/huatuogpt-3-27b