Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…
Alternatives to Qwen3.8-4B-Distill
120 open-weight models that do the same job as Qwen3.8-4B-Distill (4.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.
Phi-4-mini-instruct is a lightweight open model built upon synthetic data and filtered publicly available websites - with a focus on high-quality, reasoning dense data. The model belongs to the Phi-4 model family and supports 128K token context length.
3.8B128K ctx MIT301.6K 889Feb 2025- Same category
- Similar size (3.8B vs 4.7B)
- Commercial use OK
Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
9.7B256K ctx MIT570.4K 420Aug 2026- Same category
- Larger (9.7B vs 4.7B)
- Commercial use OK
- Newer release
Nanbeige4.1-3B is built upon Nanbeige4-3B-Base and represents an enhanced iteration of our previous reasoning model, Nanbeige4-3B-Thinking-2511, achieved through further post-training optimization with supervised fine-tuning (SFT) and reinforcement learning (RL).
3.9B256K ctx Apache 2.010.3K 1.2KFeb 2026- Same category
- Similar size (3.9B vs 4.7B)
- Commercial use OK
AFM-4.5B is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.
4.6B64K ctx Apache 2.07.1K 103Jul 2025- Same category
- Similar size (4.6B vs 4.7B)
- Commercial use OK
Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.
3.3BCC BY-NC 4.028.8K 209Feb 2026- Same category
- Similar size (3.3B vs 4.7B)
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:
7.6B32K ctx Apache 2.06.5M 2.5KSept 2024- Same category
- Similar size (7.6B vs 4.7B)
- Commercial use OK
- Widely used
Model Summary: Granite-4.1-3B-LLMON-preview is a 3B parameter instruct model fine-tuned from Granite-4.1-3B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.
3.7B128K ctx Apache 2.02.2K 18Oct 2026- Same category
- Similar size (3.7B vs 4.7B)
- Commercial use OK
- Newer release
NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.
8B64K ctx openmdw-1.129.7K 73Oct 2026- Same category
- Similar size (8B vs 4.7B)
- Commercial use OK
- Newer release
We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.
7.3B64K ctx Apache 2.0128.7K 160Nov 2025- Same category
- Similar size (7.3B vs 4.7B)
- Commercial use OK
Model Summary: Granite Switch 4.1 3B Preview is a modular LLM built on IBM Granite 4.1 3B with embedded adapters from the Granite Libraries collection.
4.1B128K ctx Apache 2.01.8K 37May 2026- Same category
- Similar size (4.1B vs 4.7B)
- Commercial use OK
Nanbeige4.2-3B-Base is a new base model in the Nanbeige4 series, trained from scratch with improvements to both model architecture and training data.
4.2B128K ctx Apache 2.0889 64Jul 2026- Same category
- Similar size (4.2B vs 4.7B)
- Commercial use OK
SmolLM3 is a 3B parameter language model designed to push the boundaries of small models. It supports dual mode reasoning, 6 languages and long context. SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale.
3.1B64K ctx Apache 2.0229.1K 1.1KJul 2025- Same category
- Similar size (3.1B vs 4.7B)
- Commercial use OK
LFM2.5-2.6B is part of LFM2.5, a family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with a 128K context window and agentic post-training.
2.7B128K ctx lfm1.039.9K 863Jul 2026- Same category
- Similar size (2.7B vs 4.7B)
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:
3.1B32K ctx Qwen Research License2M 641Sept 2024- Same category
- Similar size (3.1B vs 4.7B)
- Widely used
Model Summary: Granite‑4.1‑3B‑Base is a decoder‑only language model with long‑context capabilities, designed to support a broad range of general text‑to‑text generation tasks, as well as fill‑in‑the‑Middle (FIM) code completion.
3.4B128K ctx Apache 2.010.6K 26Apr 2026- Same category
- Similar size (3.4B vs 4.7B)
- Commercial use OK
Phi-3.5-mini is a lightweight, state-of-the-art open model built upon datasets used for Phi-3 - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data. The model belongs to the Phi-3 model family and supports 128K token context length.
3.8B128K ctx MIT340.3K 1.3KAug 2024- Same category
- Similar size (3.8B vs 4.7B)
- Commercial use OK
Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.
8.8B128K ctx Apache 2.059.9K 125Aug 2026- Same category
- Similar size (8.8B vs 4.7B)
- Commercial use OK
Raon-1 nano is a dense language model with 1.5B effective parameters (3.1B total, including a 1.5B per-layer embedding table), developed by KRAFTON AI. It is designed to follow instructions, maintain conversational context, and call the right tools in both Korean and English.
3.5B256K ctx Apache 2.01.3K 95Oct 2026- Same category
- Similar size (3.5B vs 4.7B)
- Commercial use OK
- Newer release
Phi-tiny-MoE is a lightweight Mixture of Experts (MoE) model with 3.8B total parameters and 1.1B activated parameters. It is compressed and distilled from the base model shared by Phi-3.5-MoE and GRIN-MoE using the SlimMoE approach, then post-trained via supervised fine-tuning and direct preference…
3.8BA1.3B4K ctx MIT30.3K 52Jun 2025- Same category
- Similar size (3.8B vs 4.7B)
- Commercial use OK
We introduce Olmo 3, a new family of 7B and 32B models. This suite includes Base, Instruct, and Think variants. The Base models were trained using a staged training approach.
7.3B64K ctx Apache 2.0106.3K 93Sept 2025- Same category
- Similar size (7.3B vs 4.7B)
- Commercial use OK
Jan-v3-4B-base-instruct is a 4B-parameter model obtained via post-training distillation from a larger teacher, transferring capabilities while preserving general-purpose performance on standard benchmarks.
4.4B256K ctx Apache 2.01.1K 62Jan 2026- Same category
- Similar size (4.4B vs 4.7B)
- Commercial use OK
The Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out).
3.2B128K ctx Llama 3.2 Community License834.2K 3KSept 2024- Same category
- Similar size (3.2B vs 4.7B)
Llama-3.1-Nemotron-Nano-4B-v1.1 is a large language model (LLM) which is a derivative of nvidia/Llama-3.1-Minitron-4B-Width-Base, which is created from Llama 3.1 8B using our LLM compression technique and offers improvements in model accuracy and efficiency.
4.5B128K ctx NVIDIA Open Model License6.6K 122May 2025- Same category
- Similar size (4.5B vs 4.7B)
- Commercial use OK
We elaborate on the entire construction pipeline of AgentCPM-Explore on GitHub.
4B256K ctx Apache 2.02.4K 418Jan 2026- Same category
- Similar size (4B vs 4.7B)
- Commercial use OK