Model Summary: Granite-4.1-3B-LLMON-preview is a 3B parameter instruct model fine-tuned from Granite-4.1-3B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.
Alternatives to granite-4.1-3b-llmon-preview
120 open-weight models that do the same job as granite-4.1-3b-llmon-preview (3.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.
BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.
3B32K ctx Apache 2.03K 10May 2026- Same category
- Similar size (3B vs 3.7B)
- Commercial use OK
We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.
2.5B128K ctx Apache 2.06.6K 31Aug 2026- Same category
- Similar size (2.5B vs 3.7B)
- Commercial use OK
Jamba2 3B is an ultra-compact open source model designed to bring enterprise-grade reliability to on-device deployments. At just 3B parameters, it runs efficiently on consumer devices—iPhones, Androids, Macs, and PCs—while maintaining the grounding and instruction-following capabilities required…
3B256K ctx Apache 2.06.6K 53Jan 2026- Same category
- Similar size (3B vs 3.7B)
- Commercial use OK
Nanbeige4.2-3B-Base is a new base model in the Nanbeige4 series, trained from scratch with improvements to both model architecture and training data.
4.2B128K ctx Apache 2.0889 64Jul 2026- Same category
- Similar size (4.2B vs 3.7B)
- Commercial use OK
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:
3.1B32K ctx Qwen Research License218.8K 227Sept 2024- Same category
- Similar size (3.1B vs 3.7B)
Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment.
4B4K ctx NVIDIA Open Model License99.7K 192Sept 2024- Same category
- Similar size (4B vs 3.7B)
- Commercial use OK
We elaborate on the entire construction pipeline of AgentCPM-Explore on GitHub.
4B256K ctx Apache 2.02.4K 418Jan 2026- Same category
- Similar size (4B vs 3.7B)
- Commercial use OK
LFM3-1.7B is a text model for local agents and specialized applications, based on our new tri-hybrid architecture.
1.7B256K ctx lfm1.0103.7K 1.8KOct 2026- Same category
- Smaller (1.7B vs 3.7B)
- Newer release
T5Gemma is a family of lightweight yet powerful encoder-decoder research models from Google. These models are created by adapting pretrained decoder-only models into a encoder-decoder.
5.6B8K ctx Gemma Terms of Use223.4K 10Jun 2025- Same category
- Similar size (5.6B vs 3.7B)
We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.
2.5B128K ctx Apache 2.04.8K 23Sept 2026- Same category
- Similar size (2.5B vs 3.7B)
- Commercial use OK
Cohere Labs Tiny Aya L2-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model optimized to think in the same language as the user prompt before writing the final answer.
3.4BCC BY-NC 4.0330 16Sept 2026- Same category
- Similar size (3.4B vs 3.7B)
G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.
3B128K ctx Apache 2.01.2K 62Jul 2026- Same category
- Similar size (3B vs 3.7B)
- Commercial use OK
Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.
3.3BCC BY-NC 4.01.4K 32Feb 2026- Same category
- Similar size (3.3B vs 3.7B)
Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
9B256K ctx MIT822.7K 571Jun 2026- Same category
- Larger (9B vs 3.7B)
- Commercial use OK
Model Summary: Granite-4.0-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.
3.4B128K ctx Apache 2.03.2K 41Sept 2025- Same category
- Similar size (3.4B vs 3.7B)
- Commercial use OK
This is Huginn, version 01/25, a latent recurrent-depth model with 3.5B parameters, trained for 800B tokens on AMD MI250X machines. This is a proof-of-concept model, but surprisingly capable in reasoning and code given its training budget and size.
3.9BApache 2.020.7K 321Jan 2025- Same category
- Similar size (3.9B vs 3.7B)
- Commercial use OK
This repository provides Japanese language models trained by SB Intuitions.
3.4B8K ctx MIT16K 39Feb 2025- Same category
- Similar size (3.4B vs 3.7B)
- Commercial use OK
📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.
3.2B128K ctx Apache 2.05.1K 148Sept 2025- Same category
- Similar size (3.2B vs 3.7B)
- Commercial use OK
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
8.2B40K ctx Apache 2.06.1M 2.2KApr 2025- Same category
- Larger (8.2B vs 3.7B)
- Commercial use OK
- Widely used
PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.
3.4BA958M4K ctx Apache 2.055.4K 23Aug 2024- Same category
- Similar size (3.4B vs 3.7B)
- Commercial use OK
Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
9.7B256K ctx MIT570.4K 420Aug 2026- Same category
- Larger (9.7B vs 3.7B)
- Commercial use OK
Ouro-2.6B is a 2.6 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.
2.7B64K ctx Apache 2.010.3K 99Oct 2025- Same category
- Similar size (2.7B vs 3.7B)
- Commercial use OK
Cohere Labs Tiny Aya En-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model.
3.4BCC BY-NC 4.0124 12Sept 2026- Same category
- Similar size (3.4B vs 3.7B)
Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.
3.3BCC BY-NC 4.0527 49Feb 2026- Same category
- Similar size (3.3B vs 3.7B)