selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to granite-4.1-3b-llmon-preview

120 open-weight models that do the same job as granite-4.1-3b-llmon-preview (3.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ibm-granite logo≈3.3 GB

Model Summary: Granite-4.1-3B-LLMON-preview is a 3B parameter instruct model fine-tuned from Granite-4.1-3B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

3.7B128K ctx Apache 2.0
2.2KOct 2026gguf
--vram
any
--gpus
--quant
  1. lightonai logo

    colgrep-agent-2B

    lightonai·Chat

    ≈2.3 GB

    ColGrep-Agent-2B is a lightweight code-localization agent designed to identify the files and line ranges relevant to a GitHub issue, bug report, feature request, or natural-language question about a repository.

    2.5B128K ctx Apache 2.0
    1.1KOct 2026gguf
    • Same category
    • Similar size (2.5B vs 3.7B)
    • Commercial use OK
    • Newer release
    vs
  2. arcee-ai logo

    AFM-4.5B

    arcee-ai·Chat

    ≈3.8 GB

    AFM-4.5B is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.

    4.6B64K ctx Apache 2.0
    7.1KJul 2025gguf
    • Same category
    • Similar size (4.6B vs 3.7B)
    • Commercial use OK
    vs
  3. tencent logo≈1.9 GB

    This checkpoint is a five-layer draft model for Qwen3.8-27B, with block size 16 and an 8,192-token sliding window.

    2B256K ctx Apache 2.0
    5.6KNov 2026gguf
    • Same category
    • Similar size (2B vs 3.7B)
    • Commercial use OK
    • Newer release
    vs
  4. LiquidAI logo

    LFM2-2.6B-Longevity

    LiquidAI·Chat

    ≈2.5 GB

    Longevity-LLM (L-LLM) is a family of compact, domain-adapted language models for interpreting heterogeneous aging biology data. Longevity LFMs are available in two sizes:

    2.6B125K ctx lfm1.0
    2.1KMay 2026gguf
    • Same category
    • Similar size (2.6B vs 3.7B)
    vs
  5. janhq logo≈4.2 GB

    Jan-v3-4B-base-instruct is a 4B-parameter model obtained via post-training distillation from a larger teacher, transferring capabilities while preserving general-purpose performance on standard benchmarks.

    4.4B256K ctx Apache 2.0
    1.1KJan 2026gguf
    • Same category
    • Similar size (4.4B vs 3.7B)
    • Commercial use OK
    vs
  6. Qwen logo≈5.5 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    7.6B32K ctx Apache 2.0
    6.5MSept 2024ollama
    • Same category
    • Larger (7.6B vs 3.7B)
    • Commercial use OK
    • Widely used
    vs
  7. tiiuae logo≈2.6 GB

    For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report.

    3.1B128K ctx Falcon LLM License
    6KMay 2025gguf
    • Same category
    • Similar size (3.1B vs 3.7B)
    vs
  8. NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.

    8B64K ctx openmdw-1.1
    29.7KOct 2026gguf
    • Same category
    • Larger (8B vs 3.7B)
    • Commercial use OK
    • Newer release
    vs
  9. ibm-granite logo

    granite-3.3-2b-instruct

    ibm-granite·Chat

    ≈2.6 GB

    Model Summary: Granite-3.3-2B-Instruct is a 2-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

    2.5B128K ctx Apache 2.0
    40.8KApr 2025ollama
    • Same category
    • Similar size (2.5B vs 3.7B)
    • Commercial use OK
    vs
  10. allenai logo

    Olmo-3-7B-Instruct

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    128.7KNov 2025ollama
    • Same category
    • Similar size (7.3B vs 3.7B)
    • Commercial use OK
    vs
  11. deepcogito logo≈3.5 GB

    The Cogito LLMs are instruction tuned generative models (text in/text out). All models are released under an open license for commercial use.

    3.6B128K ctx Llama 3.2 Community License
    1.6KMar 2025gguf
    • Same category
    • Similar size (3.6B vs 3.7B)
    vs
  12. google logo

    gemma-2-2b-it

    google·Chat

    ≈2.9 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    2.6B8K ctx Gemma Terms of Use
    183.2KJul 2024ollama
    • Same category
    • Similar size (2.6B vs 3.7B)
    vs
  13. nvidia logo≈4.2 GB

    Llama-3.1-Nemotron-Nano-4B-v1.1 is a large language model (LLM) which is a derivative of nvidia/Llama-3.1-Minitron-4B-Width-Base, which is created from Llama 3.1 8B using our LLM compression technique and offers improvements in model accuracy and efficiency.

    4.5B128K ctx NVIDIA Open Model License
    6.6KMay 2025gguf
    • Same category
    • Similar size (4.5B vs 3.7B)
    • Commercial use OK
    vs
  14. LiquidAI logo

    LFM2-2.6B

    LiquidAI·Chat

    ≈2.5 GB

    LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

    2.6B125K ctx lfm1.0
    6.6KSept 2025gguf
    • Same category
    • Similar size (2.6B vs 3.7B)
    vs
  15. tiiuae logo≈3.1 GB

    Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.

    3.2B32K ctx Falcon LLM License
    7.3KDec 2024ollama
    • Same category
    • Similar size (3.2B vs 3.7B)
    vs
  16. LiquidAI logo

    LFM3-1.7B-Base

    LiquidAI·Chat

    ≈1.9 GB

    LFM3-1.7B-Base is the pre-trained checkpoint behind LFM3-1.7B, a text model for local agents and specialized applications based on our new tri-hybrid architecture.

    1.7B256K ctx lfm1.0
    12KOct 2026ollama
    • Same category
    • Smaller (1.7B vs 3.7B)
    • Newer release
    vs
  17. ibm-granite logo

    granite-4.2-8b

    ibm-granite·Chat

    ≈7.0 GB

    Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.

    8.8B128K ctx Apache 2.0
    59.9KAug 2026ollama
    • Same category
    • Larger (8.8B vs 3.7B)
    • Commercial use OK
    vs
  18. Menlo logo

    Jan-nano-128k

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of Jan-Nano, this enhanced version features a native 128k context window that enables deeper, more comprehensive research capabilities without the performance…

    4B128K ctx Apache 2.0
    1.1KJun 2025gguf
    • Same category
    • Similar size (4B vs 3.7B)
    • Commercial use OK
    vs
  19. openbmb logo

    MiniCPM3-4B

    openbmb·Chat

    ≈10 GB

    MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

    4B32K ctx Apache 2.0
    10.1KSept 2024gguf
    • Same category
    • Similar size (4B vs 3.7B)
    • Commercial use OK
    vs
  20. janhq logo

    Jan-v1-4B

    janhq·Chat

    ≈4.0 GB

    Jan-v1 is the first release in the Jan Family, designed for agentic reasoning and problem-solving within the Jan App. Based on our Lucy model, Jan-v1 achieves improved performance through model scaling.

    4B256K ctx Apache 2.0
    738Aug 2025gguf
    • Same category
    • Similar size (4B vs 3.7B)
    • Commercial use OK
    vs
  21. Qwen logo

    Qwen3-1.7B-Base

    Qwen·Chat

    ≈2.4 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    1.7B32K ctx Apache 2.0
    618.8KApr 2025gguf
    • Same category
    • Smaller (1.7B vs 3.7B)
    • Commercial use OK
    vs
  22. ibm-granite logo

    granite-3.1-3b-a800m-base

    ibm-granite·Chat

    ≈3.0 GB

    Model Summary: Granite-3.1-3B-A800M-Base extends the context length of Granite-3.0-3B-A800M-Base from 4K to 128K using a progressive training strategy by increasing the supported context length in increments while adjusting RoPE theta until the model has successfully adapted to desired length of…

    3.3BA800M128K ctx Apache 2.0
    4.5KDec 2024gguf
    • Same category
    • Similar size (3.3B vs 3.7B)
    • Commercial use OK
    vs
  23. ibm-granite logo

    granite-4.0-h-micro-base

    ibm-granite·Chat

    ≈3.0 GB

    Model Summary: Granite-4.0-H-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.

    3.2B128K ctx Apache 2.0
    696Sept 2025gguf
    • Same category
    • Similar size (3.2B vs 3.7B)
    • Commercial use OK
    vs
  24. LiquidAI logo

    LFM2-2.6B-Exp

    LiquidAI·Chat

    ≈2.5 GB

    LFM2-2.6B-Exp is an experimental checkpoint built on LFM2-2.6B using pure reinforcement learning.

    2.6B125K ctx lfm1.0
    2.4KDec 2025gguf
    • Same category
    • Similar size (2.6B vs 3.7B)
    vs