selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to granite-4.1-8b-llmon-preview

120 open-weight models that do the same job as granite-4.1-8b-llmon-preview (8.8B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ibm-granite logo≈7.0 GB

Model Summary: Granite-4.1-8B-LLMON-preview is an 8B-parameter instruct model fine-tuned from Granite-4.1-8B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

8.8B128K ctx Apache 2.0
428Oct 2026
--vram
any
--gpus
--quant
  1. tokyotech-llm logo

    Qwen3-Swallow-8B-RL-v0.2

    tokyotech-llm·Chat

    ≈6.5 GB

    Qwen3-Swallow v0.2 is a family of large language models available in 8B, 30B-A3B, and 32B parameter sizes. Built as bilingual Japanese-English models, they were developed through Continual Pre-Training (CPT), Supervised Fine-Tuning (SFT), and Reinforcement Learning with Verifiable Rewards (RLVR)…

    8.2B40K ctx Apache 2.0
    4.7KJan 2026gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  2. allenai logo

    Olmo-Hybrid-7B

    allenai·Chat

    ≈8.7 GB

    We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run.

    7.4B64K ctx Apache 2.0
    10.9KJan 2026
    • Same category
    • Similar size (7.4B vs 8.8B)
    • Commercial use OK
    vs
  3. google logo

    shieldgemma-9b

    google·Chat

    ≈8.6 GB

    ShieldGemma is a series of safety content moderation models built upon Gemma 2 that target four harm categories (sexually explicit, dangerous content, hate, and harassment).

    9.2B8K ctx Gemma Terms of Use
    257.4KJul 2024ollama
    • Same category
    • Similar size (9.2B vs 8.8B)
    vs
  4. NousResearch logo

    Hermes-3-Llama-3.1-8B

    NousResearch·Chat

    ≈6.3 GB

    Hermes 3 is the latest version of our flagship Hermes series of LLMs by Nous Research.

    8B128K ctx Llama 3 Community License
    336.5KJul 2024gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  5. openbmb logo

    MiniCPM-SALA

    openbmb·Chat

    ≈6.4 GB

    MiniCPM-SALA (Sparse Attention and Linear Attention) is the first large-scale hybrid model effectively integrating sparse and linear attention for million-token context modeling

    9.5B512K ctx Apache 2.0
    4KFeb 2026
    • Same category
    • Similar size (9.5B vs 8.8B)
    • Commercial use OK
    vs
  6. tencent logo

    ContextPilot-8B

    tencent·Chat

    ≈6.5 GB

    ContextPilot-8B is the Qwen3-8B checkpoint of ContextPilot, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools.

    8.2B40K ctx Custom licence
    908Aug 2026gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    vs
  7. Unbabel logo

    Tower-Plus-9B

    Unbabel·Chat

    ≈8.6 GB

    Tower+ 9B is build on top of Gemma 2 9B. The model goes through the Continuous Pretraining (CPT), Instruction Tuning (IT), Weighted Preference Optimization (WPO). During all stages we include parallel and multilingual data (covering 22 languages).

    9.2B8K ctx CC BY-NC-SA 4.0
    19KJun 2025gguf
    • Same category
    • Similar size (9.2B vs 8.8B)
    vs
  8. Dream-org logo

    Dream-v0-Instruct-7B

    Dream-org·Chat

    ≈5.5 GB

    This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:

    7.6B128K ctx Apache 2.0
    72KApr 2025gguf
    • Same category
    • Similar size (7.6B vs 8.8B)
    • Commercial use OK
    vs
  9. empero-ai logo

    Qwythos-9B-v2

    empero-ai·Chat

    ≈7.2 GB

    The next iteration of Qwythos: all the reasoning of Qwythos-9B, with the looping behavior fixed. v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use.

    9.7B1M ctx Apache 2.0
    1.3KJul 2026gguf
    • Same category
    • Similar size (9.7B vs 8.8B)
    • Commercial use OK
    vs
  10. ibm-granite logo

    granite-3.2-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.2-8B-Instruct is an 8-billion-parameter, long-context AI model fine-tuned for thinking capabilities.

    8.2B128K ctx Apache 2.0
    51.7KFeb 2025ollama
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  11. nvidia logo≈4.2 GB

    NVIDIA-Nemotron-3-Nano-4B-BF16 is a small language model (SLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.

    4B256K ctx nvidia-nemotron-open-model-license
    1.9MMar 2026gguf
    • Same category
    • Smaller (4B vs 8.8B)
    • Commercial use OK
    • Widely used
    vs
  12. empero-ai logo

    Qwen3.8-4B-Distill

    empero-ai·Chat

    ≈4.3 GB

    Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…

    4.7B256K ctx Apache 2.0
    112.4KAug 2026gguf
    • Same category
    • Similar size (4.7B vs 8.8B)
    • Commercial use OK
    vs
  13. swiss-ai logo

    Apertus-8B-2509

    swiss-ai·Chat

    ≈6.3 GB

    Apertus is a 70B and 8B parameter language model designed to push the boundaries of fully-open multilingual and transparent models.

    8.1B64K ctx Apache 2.0
    10.1KSept 2025gguf
    • Same category
    • Similar size (8.1B vs 8.8B)
    • Commercial use OK
    vs
  14. nvidia logo≈6.5 GB

    Orchestrator-8B is a state-of-the-art 8B parameter orchestration model designed to solve complex, multi-turn agentic tasks by coordinating a diverse set of expert models and tools.

    8.2B40K ctx Unknown licence
    4.5KNov 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    vs
  15. allenai logo

    AstaBrief_8B

    allenai·Chat

    ≈6.4 GB

    AstaBrief-8B is a model trained to turn a research question and retrieved scientific literature excerpts into a cited report using only supervised fine-tuning and offline direct preference optimization.

    8B40K ctx Apache 2.0
    2.8KFeb 2026gguf
    • Same category
    • Similar size (8B vs 8.8B)
    • Commercial use OK
    vs
  16. EssentialAI logo

    rnj-1-instruct

    EssentialAI·Chat

    ≈6.4 GB

    Rnj-1 is a family of 8B parameter open-weight, dense models trained from scratch by Essential AI, optimized for code and STEM with capabilities on par with SOTA open-weight models.

    8.3B32K ctx Apache 2.0
    3.3KDec 2025ollama
    • Same category
    • Similar size (8.3B vs 8.8B)
    • Commercial use OK
    vs
  17. IlyaGusev logo

    saiga_llama3_8b

    IlyaGusev·Chat

    ≈6.3 GB

    I've changed the prompt format from ChatML to the original Llama-3 format in v4. Don't forget to switch formats!

    8B8K ctx Llama 3 Community License
    415.1KApr 2024gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  18. meta-llama logo

    Meta-Llama-3-8B-Instruct

    meta-llama·Chat

    ≈6.3 GB

    Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes.

    8B8K ctx Llama 3 Community License
    421.3KApr 2024ollama
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  19. t-tech logo

    T-lite-it-2.1

    t-tech·Chat

    ≈6.5 GB

    T-lite-it-2.1 is an efficient Russian model built upon the Qwen 3 architecture, featuring significant improvements in instruction following and adds support for tool-calling capabilities — a key advancement over T-lite-it-1.0, which lacks tool-use support.

    8.2B40K ctx Apache 2.0
    3.1KDec 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  20. XiaomiMiMo logo

    MiMo-7B-RL

    XiaomiMiMo·Chat

    ≈6.3 GB

    Currently, most successful RL works, including open-source research, rely on relatively large base models, e.g., 32B models, particularly for enhancing code reasoning capabilities.

    7.8B32K ctx MIT
    30.6KApr 2025gguf
    • Same category
    • Similar size (7.8B vs 8.8B)
    • Commercial use OK
    vs
  21. zai-org logo

    GLM-4-9B-0414

    zai-org·Chat

    ≈6.4 GB

    The GLM family welcomes new members, the GLM-4-32B-0414 series models, featuring 32 billion parameters. Its performance is comparable to OpenAI’s GPT series and DeepSeek’s V3/R1 series. It also supports very user-friendly local deployment features.

    9.4B32K ctx MIT
    22.2KApr 2025ollama
    • Same category
    • Similar size (9.4B vs 8.8B)
    • Commercial use OK
    vs
  22. ibm-granite logo

    granite-4.0-h-tiny

    ibm-granite·Chat

    ≈5.2 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    6.9BA1.5B128K ctx Apache 2.0
    28.9KSept 2025gguf
    • Same category
    • Similar size (6.9B vs 8.8B)
    • Commercial use OK
    vs
  23. openbmb logo

    AgentCPM-Report

    openbmb·Chat

    ≈5.6 GB

    This repository contains AgentCPM-Report, an 8B-parameter deep research agent introduced in the paper AgentCPM-Report: Interleaving Drafting and Deepening for Open-Ended Deep Research.

    8.2B64K ctx Apache 2.0
    2.2KJan 2026gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  24. openbmb logo

    MiniCPM4.1-8B

    openbmb·Chat

    ≈5.6 GB

    ✅ Strong Reasoning Capability: Surpasses similar-sized models on 15 tasks!

    8.2B64K ctx Apache 2.0
    6.2KSept 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs