selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to granite-4.1-3b-llmon-preview

120 open-weight models that do the same job as granite-4.1-3b-llmon-preview (3.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ibm-granite logo≈3.3 GB

Model Summary: Granite-4.1-3B-LLMON-preview is a 3B parameter instruct model fine-tuned from Granite-4.1-3B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

3.7B128K ctx Apache 2.0
2.2KOct 2026gguf
--vram
any
--gpus
--quant
  1. openbmb logo

    BitCPM-CANN-3B

    openbmb·Chat

    ≈2.5 GB

    BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.

    3B32K ctx Apache 2.0
    3KMay 2026gguf
    • Same category
    • Similar size (3B vs 3.7B)
    • Commercial use OK
    vs
  2. openbmb logo

    MiniCPM5-2B-SFT

    openbmb·Chat

    ≈2.3 GB

    We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.

    2.5B128K ctx Apache 2.0
    6.6KAug 2026
    • Same category
    • Similar size (2.5B vs 3.7B)
    • Commercial use OK
    vs
  3. ai21labs logo

    AI21-Jamba2-3B

    ai21labs·Chat

    ≈2.4 GB

    Jamba2 3B is an ultra-compact open source model designed to bring enterprise-grade reliability to on-device deployments. At just 3B parameters, it runs efficiently on consumer devices—iPhones, Androids, Macs, and PCs—while maintaining the grounding and instruction-following capabilities required…

    3B256K ctx Apache 2.0
    6.6KJan 2026gguf
    • Same category
    • Similar size (3B vs 3.7B)
    • Commercial use OK
    vs
  4. Nanbeige logo

    Nanbeige4.2-3B-Base

    Nanbeige·Chat

    ≈3.7 GB

    Nanbeige4.2-3B-Base is a new base model in the Nanbeige4 series, trained from scratch with improvements to both model architecture and training data.

    4.2B128K ctx Apache 2.0
    889Jul 2026gguf
    • Same category
    • Similar size (4.2B vs 3.7B)
    • Commercial use OK
    vs
  5. Qwen logo

    Qwen2.5-3B

    Qwen·Chat

    ≈2.6 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    3.1B32K ctx Qwen Research License
    218.8KSept 2024gguf
    • Same category
    • Similar size (3.1B vs 3.7B)
    vs
  6. nvidia logo≈3.4 GB

    Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment.

    4B4K ctx NVIDIA Open Model License
    99.7KSept 2024ollama
    • Same category
    • Similar size (4B vs 3.7B)
    • Commercial use OK
    vs
  7. openbmb logo

    AgentCPM-Explore

    openbmb·Chat

    ≈4.0 GB

    We elaborate on the entire construction pipeline of AgentCPM-Explore on GitHub.

    4B256K ctx Apache 2.0
    2.4KJan 2026gguf
    • Same category
    • Similar size (4B vs 3.7B)
    • Commercial use OK
    vs
  8. LiquidAI logo

    LFM3-1.7B

    LiquidAI·Chat

    ≈1.9 GB

    LFM3-1.7B is a text model for local agents and specialized applications, based on our new tri-hybrid architecture.

    1.7B256K ctx lfm1.0
    103.7KOct 2026ollama
    • Same category
    • Smaller (1.7B vs 3.7B)
    • Newer release
    vs
  9. google logo≈4.6 GB

    T5Gemma is a family of lightweight yet powerful encoder-decoder research models from Google. These models are created by adapting pretrained decoder-only models into a encoder-decoder.

    5.6B8K ctx Gemma Terms of Use
    223.4KJun 2025
    • Same category
    • Similar size (5.6B vs 3.7B)
    vs
  10. openbmb logo≈2.3 GB

    We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.

    2.5B128K ctx Apache 2.0
    4.8KSept 2026
    • Same category
    • Similar size (2.5B vs 3.7B)
    • Commercial use OK
    vs
  11. CohereLabs logo

    tiny-aya-l2-thinker

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya L2-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model optimized to think in the same language as the user prompt before writing the final answer.

    3.4BCC BY-NC 4.0
    330Sept 2026
    • Same category
    • Similar size (3.4B vs 3.7B)
    vs
  12. ai9stars logo

    G9v3-3B

    ai9stars·Chat

    ≈2.7 GB

    G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.

    3B128K ctx Apache 2.0
    1.2KJul 2026gguf
    • Same category
    • Similar size (3B vs 3.7B)
    • Commercial use OK
    vs
  13. CohereLabs logo

    tiny-aya-fire

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    1.4KFeb 2026gguf
    • Same category
    • Similar size (3.3B vs 3.7B)
    vs
  14. ornith-ai logo

    Ornith-1.0-9B

    ornith-ai·Chat

    ≈6.8 GB

    Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.

    9B256K ctx MIT
    822.7KJun 2026gguf
    • Same category
    • Larger (9B vs 3.7B)
    • Commercial use OK
    vs
  15. ibm-granite logo

    granite-4.0-micro-base

    ibm-granite·Chat

    ≈3.1 GB

    Model Summary: Granite-4.0-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.

    3.4B128K ctx Apache 2.0
    3.2KSept 2025gguf
    • Same category
    • Similar size (3.4B vs 3.7B)
    • Commercial use OK
    vs
  16. tomg-group-umd logo

    huginn-0125

    tomg-group-umd·Chat

    ≈4.1 GB

    This is Huginn, version 01/25, a latent recurrent-depth model with 3.5B parameters, trained for 800B tokens on AMD MI250X machines. This is a proof-of-concept model, but surprisingly capable in reasoning and code given its training budget and size.

    3.9BApache 2.0
    20.7KJan 2025
    • Same category
    • Similar size (3.9B vs 3.7B)
    • Commercial use OK
    vs
  17. sbintuitions logo≈3.7 GB

    This repository provides Japanese language models trained by SB Intuitions.

    3.4B8K ctx MIT
    16KFeb 2025gguf
    • Same category
    • Similar size (3.4B vs 3.7B)
    • Commercial use OK
    vs
  18. ibm-granite logo

    granite-4.0-h-micro

    ibm-granite·Chat

    ≈3.0 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    3.2B128K ctx Apache 2.0
    5.1KSept 2025gguf
    • Same category
    • Similar size (3.2B vs 3.7B)
    • Commercial use OK
    vs
  19. Qwen logo

    Qwen3-8B

    Qwen·Chat

    ≈6.5 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    8.2B40K ctx Apache 2.0
    6.1MApr 2025ollama
    • Same category
    • Larger (8.2B vs 3.7B)
    • Commercial use OK
    • Widely used
    vs
  20. ibm-research logo

    PowerMoE-3b

    ibm-research·Chat

    ≈2.8 GB

    PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.

    3.4BA958M4K ctx Apache 2.0
    55.4KAug 2024gguf
    • Same category
    • Similar size (3.4B vs 3.7B)
    • Commercial use OK
    vs
  21. ornith-ai logo

    Ornith-1.5-9B

    ornith-ai·Chat

    ≈7.2 GB

    Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.

    9.7B256K ctx MIT
    570.4KAug 2026ollama
    • Same category
    • Larger (9.7B vs 3.7B)
    • Commercial use OK
    vs
  22. ByteDance logo

    Ouro-2.6B

    ByteDance·Chat

    ≈5.1 GB

    Ouro-2.6B is a 2.6 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.

    2.7B64K ctx Apache 2.0
    10.3KOct 2025gguf
    • Same category
    • Similar size (2.7B vs 3.7B)
    • Commercial use OK
    vs
  23. CohereLabs logo

    tiny-aya-en-thinker

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya En-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model.

    3.4BCC BY-NC 4.0
    124Sept 2026
    • Same category
    • Similar size (3.4B vs 3.7B)
    vs
  24. CohereLabs logo

    tiny-aya-water

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    527Feb 2026gguf
    • Same category
    • Similar size (3.3B vs 3.7B)
    vs