NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.
Qwen3.8-27B-Longbook27-v2
summerAIO·Instruct·released 22 Oct 2026
hf download summerAIO/Qwen3.8-27B-Longbook27-v2Qwen3.8-27B-Longbook27-v2 is a fine-tuned 27B model for understanding and generating long-form text such as books, papers, and lengthy reports. Version 2 improves on v1 in behavior and output quality.
How much VRAM does Qwen3.8-27B-Longbook27-v2 need?
At Q4_K_M Qwen3.8-27B-Longbook27-v2 needs about 19 GB with an 8K context (19 GB at Q4, 55 GB at full precision). Pick your GPU to see what fits and how fast it runs.
Needs: ≈19 GB · Q4_K_M · 8K context — Pick a GPU to check the fit.
Advanced: context 8K · KV cache 16-bit
Smallest GPU for each quant and context (KV cache 16-bit)
| Quantisation | 8K | 16K | 32K | 64K | 128K | 256K |
|---|---|---|---|---|---|---|
| Q3_K_M | ||||||
| Q4_K_M | ||||||
| Q5_K_M | ||||||
| Q6_K | ||||||
| Q8_0 | ||||||
| FP16 |
≤16 GB card24–32 GB48–96 GBmore
| Quantisation | Total |
|---|---|
| Q2_KHeavy lossSmallest, noticeably worse quality | ≈11 GB |
| Q3_K_MNoticeable lossSmall, some quality loss | ≈15 GB |
| Q4_K_MrecommendedSmall lossRecommended default for local use | ≈19 GB |
| Q5_K_MNear-losslessNear-lossless for most tasks | ≈21 GB |
| Q6_KNear-losslessPractically lossless | ≈24 GB |
| Q8_0LosslessLossless in practice, twice the size of Q4 | ≈31 GB |
| FP16 / BF16LosslessFull precision, as released | ≈55 GB |
Estimates for 8K tokens of context: weights + KV cache + runtime overhead. Speed assumes memory-bound decoding at your GPU’s bandwidth. Pick a GPU above and the fit column checks every row against it.
How to pick a quant
Take the biggest quant that fits with room left for context. Q4_K_M is the usual sweet spot. Below Q4 quality drops fast, above Q6 you mostly pay memory for nothing. Big models (70B+, large MoE) tolerate low quants better than small ones.
- LosslessF16, Q8_0
- Near-losslessQ6_K, Q5_K_M
- Small lossQ5_K_S, Q4_K_M, IQ4_NL, IQ4_XS, Q4_K_S
- Noticeable lossQ4_0, Q3_K_L, Q3_K_M, IQ3_M
- Heavy lossIQ3_XXS, Q3_K_S, IQ2_M, Q2_K
Typical quality loss, not measured per model. Tiers come from KL divergence against FP16 on Llama 3 8B: llama.cpp perplexity README: LLaMA 3 8B scoreboard (KLD and ΔPPL vs FP16, Wikitext-2); llama.cpp quantize tool: ΔPPL per quant type @ Llama-3-8B
How much context fits?
At 8K context, Q4_K_M needs ≈19 GB(15 GB weights + 2.0 GB KV cache + 1.3 GB overhead). Pick a GPU above to see how much context fits.
Weights + overheadKV cache
Can the Tesla P40 run Qwen3.8-27B-Longbook27-v2? →
Speed vs quality per quant
Smaller quants run faster and fit in less memory, but lose quality.
Fits in VRAMTight fitCPU offload✕ won't runQuality is typical KL divergence vs FP16, not measured for this model.
Real-world speed of Qwen3.8-27B-Longbook27-v2
Tokens per second measured by people running it at home. A GPU shows a median once 3 reports agree on the same setup. Reports far from our estimate wait for a review. Measure yours with llama-bench →
No medians yet. Be one of the first 3 to report a setup.
All reports
Run Qwen3.8-27B-Longbook27-v2 locally
These commands load the original weights from Hugging Face.
from transformers import pipeline
pipe = pipeline("text-generation", model="summerAIO/Qwen3.8-27B-Longbook27-v2", dtype="auto", device_map="auto")
messages = [{"role": "user", "content": "Explain self-hosting in one paragraph."}]
out = pipe(messages, max_new_tokens=512)
print(out[0]["generated_text"][-1]["content"])About Qwen3.8-27B-Longbook27-v2
Qwen3.8-27B-Longbook27-v2 is a fine-tuned 27B model for understanding and generating long-form text such as books, papers, and lengthy reports. Version 2 improves on v1 in behavior and output quality. The model uses a custom architecture (qwen3_5_gdn24) with Gated DeltaNet linear-attention layers, shipped as remote code in this repository. ⚠️ trust_remote_code=True is required. Loading without it will fail or prompt for confirmation. Built for book-scale inputs Gated DeltaNet linear-attention layers Refined over v1
Full model card on Hugging Face →Alternatives to Qwen3.8-27B-Longbook27-v2
All alternatives →Versioning notice: This card describes the current OTel 2.0 OSFT checkpoint. The model weights may be updated over time. For reproducible evaluation or production deployment, pin a specific model revision, checkpoint hash, or release tag rather than relying on the floating latest version.
Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
Laguna XS 2.1 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local machine.
👋 Join our Discord community. 📖 Check out the GLM-4.7 technical blog , technical report(GLM-4.5) . 📍 Use GLM-4.7-Flash API services on Z.ai API Platform. 👉 One click to GLM-4.7 .
Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.
Qwen3.8-27B-Longbook27-v2 FAQ
- How much VRAM does Qwen3.8-27B-Longbook27-v2 need?
- About 19 GB at Q4_K_M with an 8K context. Q8_0 needs about 31 GB and full precision about 55 GB. Longer contexts need more memory for the KV cache.
- Can Qwen3.8-27B-Longbook27-v2 run on the Tesla P40?
- Yes. It fits at Q5_K_M (about 21 GB), at an estimated 9.9 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.
- Can I use Qwen3.8-27B-Longbook27-v2 commercially?
- Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.
- What is the context length of Qwen3.8-27B-Longbook27-v2?
- 262,144 tokens (256K). The full window needs far more memory than an 8K context.
- How do I run Qwen3.8-27B-Longbook27-v2 locally?
- It runs with Transformers. Each has copy-paste examples in its docs.
Rate this model
Data from Hugging Face, the model card and public leaderboards. Memory and speed figures are estimates; real numbers depend on the runtime, context length and drivers. Always check the licence yourself before commercial use.
0 comments