Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…
Alternatives to Qwen3.8-4B-Distill
120 open-weight models that do the same job as Qwen3.8-4B-Distill (4.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.
Large Action Models (LAMs) are advanced language models designed to enhance decision-making by translating user intentions into executable actions.
8B128K ctx CC BY-NC 4.0125.1K 66Mar 2025- Same category
- Similar size (8B vs 4.7B)
G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.
3B128K ctx Apache 2.01.2K 62Jul 2026- Same category
- Similar size (3B vs 4.7B)
- Commercial use OK
This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:
7.6B128K ctx Apache 2.072.8K 163Apr 2025- Same category
- Similar size (7.6B vs 4.7B)
- Commercial use OK
Granite Guardian 4.1 8B introduces improved Bring Your Own Criteria (BYOC) support, enabling users to define arbitrary judging criteria beyond the pre-baked safety and hallucination detectors.
8.4B128K ctx Apache 2.09.2K 52Apr 2026- Same category
- Similar size (8.4B vs 4.7B)
- Commercial use OK
ContextPilot-E4B is the Gemma4-E4B checkpoint of ContextPilot, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools.
7.9B128K ctx Custom licence2K 9Aug 2026- Same category
- Similar size (7.9B vs 4.7B)
- Newer release
ZGCM-1 is a 7.39B-parameter dense language model trained from scratch, built for mathematical reasoning and tool-assisted search. It combines deliberate internal thinking with active information gathering, supporting 256K-token context and both thinking and direct-response modes in a single model.
7.4B256K ctx MIT957 51Sept 2026- Same category
- Similar size (7.4B vs 4.7B)
- Commercial use OK
- Newer release
Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.
3.3BCC BY-NC 4.01.4K 32Feb 2026- Same category
- Similar size (3.3B vs 4.7B)
Model Summary: Granite-4.0-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.
3.4B128K ctx Apache 2.03.2K 41Sept 2025- Same category
- Similar size (3.4B vs 4.7B)
- Commercial use OK
Model Summary: Granite-3.3-8B-Instruct is a 8-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.
8.2B128K ctx Apache 2.0101K 161Apr 2025- Same category
- Similar size (8.2B vs 4.7B)
- Commercial use OK
This repository provides Japanese language models trained by SB Intuitions.
3.4B8K ctx MIT16K 39Feb 2025- Same category
- Similar size (3.4B vs 4.7B)
- Commercial use OK
ALoDLM is a family of diffusion language models developed at Amazon, available as ALoDLM-1.7B and ALoDLM-8B and initialized from the corresponding Qwen3 backbones.
8.2B40K ctx CC BY-NC 4.01.6K 64Oct 2026- Same category
- Similar size (8.2B vs 4.7B)
- Newer release
📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.
3.2B128K ctx Apache 2.05.2K 148Sept 2025- Same category
- Similar size (3.2B vs 4.7B)
- Commercial use OK
Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of Jan-Nano, this enhanced version features a native 128k context window that enables deeper, more comprehensive research capabilities without the performance…
4B128K ctx Apache 2.01.1K 224Jun 2025- Same category
- Similar size (4B vs 4.7B)
- Commercial use OK
The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.
7.2B32K ctx Apache 2.01.2M 3.3KDec 2023- Same category
- Similar size (7.2B vs 4.7B)
- Commercial use OK
OLMoE-1B-7B-0125-Instruct January 2025 is post-trained variant of the OLMoE-1B-7B January 2025 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset and further DPO training on this dataset, and finally RLVR training using this data.
6.9BA1.3B4K ctx Apache 2.033.1K 68Jan 2025- Same category
- Similar size (6.9B vs 4.7B)
- Commercial use OK
We introduce LLaDA, a diffusion model with an unprecedented 8B scale, trained entirely from scratch, rivaling LLaMA3 8B in performance.
8B4K ctx MIT103.3K 365Feb 2025- Same category
- Similar size (8B vs 4.7B)
- Commercial use OK
MathForm-8B is an autoformalization model that translates natural-language mathematical statements into Lean 4. It is released with the paper MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement.
8.2B40K ctx Apache 2.02K 9Aug 2026- Same category
- Similar size (8.2B vs 4.7B)
- Commercial use OK
Qwen2.5-1M is the long-context version of the Qwen2.5 series models, supporting a context length of up to 1M tokens. Compared to the Qwen2.5 128K version, Qwen2.5-1M demonstrates significantly improved performance in handling long-context tasks while maintaining its capability in short tasks.
7.6B1M ctx Apache 2.079.4K 390Jan 2025- Same category
- Similar size (7.6B vs 4.7B)
- Commercial use OK
We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run.
7.4B32K ctx Apache 2.03K 17Feb 2026- Same category
- Similar size (7.4B vs 4.7B)
- Commercial use OK
PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.
3.4BA958M4K ctx Apache 2.055.2K 23Aug 2024- Same category
- Similar size (3.4B vs 4.7B)
- Commercial use OK
Jan-v1 is the first release in the Jan Family, designed for agentic reasoning and problem-solving within the Jan App. Based on our Lucy model, Jan-v1 achieves improved performance through model scaling.
4B256K ctx Apache 2.0727 353Aug 2025- Same category
- Similar size (4B vs 4.7B)
- Commercial use OK
Nemotron-Labs-Diffusion is a tri-mode language model that supports both AR decoding and diffusion-based parallel decoding by simply switching the attention pattern of the same model during inference.
8.5B4K ctx nvidia-nemotron-open-model-license13K 12Jan 2026- Same category
- Similar size (8.5B vs 4.7B)
- Commercial use OK
BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.
8B32K ctx Apache 2.03K 107May 2026- Same category
- Similar size (8B vs 4.7B)
- Commercial use OK
MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.
4B32K ctx Apache 2.010.2K 422Sept 2024- Same category
- Similar size (4B vs 4.7B)
- Commercial use OK