selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to granite-4.1-8b-llmon-preview

120 open-weight models that do the same job as granite-4.1-8b-llmon-preview (8.8B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ibm-granite logo≈7.0 GB

Model Summary: Granite-4.1-8B-LLMON-preview is an 8B-parameter instruct model fine-tuned from Granite-4.1-8B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

8.8B128K ctx Apache 2.0
428Oct 2026
--vram
any
--gpus
--quant
  1. allenai logo

    Olmo-3-1025-7B

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models. This suite includes Base, Instruct, and Think variants. The Base models were trained using a staged training approach.

    7.3B64K ctx Apache 2.0
    106.3KSept 2025gguf
    • Same category
    • Similar size (7.3B vs 8.8B)
    • Commercial use OK
    vs
  2. pfnet logo≈6.1 GB

    PLaMo-3-8B-Fin-Instruct is a Japanese language model for the financial domain, developed by Preferred Networks, Inc. It is fine-tuned from a PLaMo-3 base model through continued pre-training on financial corpora followed by supervised fine-tuning and direct preference optimization.

    8.5B256K ctx plamo-community-license
    983Nov 2026gguf
    • Same category
    • Similar size (8.5B vs 8.8B)
    • Newer release
    vs
  3. speakleash logo

    Bielik-11B-v3.0-Instruct

    speakleash·Chat

    ≈8.3 GB

    Bielik-11B-v3.0-Instruct is a generative text model featuring 11 billion parameters. It is an instruct fine-tuned version of the Bielik-11B-v3-Base-20250730.

    11.2BApache 2.0
    99.6KNov 2025gguf
    • Same category
    • Similar size (11.2B vs 8.8B)
    • Commercial use OK
    vs
  4. TokenRhythm logo

    NeoHorse-1-9B

    TokenRhythm·Chat

    ≈6.8 GB

    NeoHorse-1-9B is a 9B causal language model and an initial prototype on the path toward recursive self-improvement (RSI). It is post-trained from Qwen3.5-9B for text-based agent harnesses, tool use, coding, and instruction following.

    9B256K ctx Apache 2.0
    1.4KSept 2026gguf
    • Same category
    • Similar size (9B vs 8.8B)
    • Commercial use OK
    vs
  5. empero-ai logo≈7.1 GB

    Qwythos-9B is a full-parameter reasoning model built on top of a deeply uncensored Qwen3.5-9B base and post-trained on over 500 million tokens of high-quality Claude Mythos and Claude Fable traces, with chain-of-thought generated in-house by Empero AI's internal tool rethink.

    9.4B1M ctx Apache 2.0
    3.6KJun 2026gguf
    • Same category
    • Similar size (9.4B vs 8.8B)
    • Commercial use OK
    vs
  6. Salesforce logo

    Llama-xLAM-2-8b-fc-r

    Salesforce·Chat

    ≈6.3 GB

    Large Action Models (LAMs) are advanced language models designed to enhance decision-making by translating user intentions into executable actions.

    8B128K ctx CC BY-NC 4.0
    137.8KMar 2025gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  7. ibm-granite logo

    granite-3.3-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.3-8B-Instruct is a 8-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

    8.2B128K ctx Apache 2.0
    100.7KApr 2025ollama
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  8. LGAI-EXAONE logo

    EXAONE-3.5-7.8B-Instruct

    LGAI-EXAONE·Chat

    ≈6.1 GB

    We introduce EXAONE 3.5, a collection of instruction-tuned bilingual (English and Korean) generative models ranging from 2.4B to 32B parameters, developed and released by LG AI Research.

    7.8B32K ctx exaone
    383.6KDec 2024ollama
    • Same category
    • Similar size (7.8B vs 8.8B)
    vs
  9. LiquidAI logo

    LFM2.5-8B-A1B-Base

    LiquidAI·Chat

    ≈5.9 GB

    LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.

    8.5BA1B125K ctx lfm1.0
    3.1KMay 2026gguf
    • Same category
    • Similar size (8.5B vs 8.8B)
    vs
  10. nvidia logo≈6.1 GB

    Nemotron-Labs-Diffusion is a tri-mode language model that supports both AR decoding and diffusion-based parallel decoding by simply switching the attention pattern of the same model during inference.

    8.5B4K ctx nvidia-nemotron-open-model-license
    8.4KJan 2026
    • Same category
    • Similar size (8.5B vs 8.8B)
    • Commercial use OK
    vs
  11. openbmb logo

    MathForm-8B

    openbmb·Chat

    ≈6.5 GB

    MathForm-8B is an autoformalization model that translates natural-language mathematical statements into Lean 4. It is released with the paper MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement.

    8.2B40K ctx Apache 2.0
    2.2KAug 2026gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  12. amazon logo

    ALoDLM-8B

    amazon·Chat

    ≈6.5 GB

    ALoDLM is a family of diffusion language models developed at Amazon, available as ALoDLM-1.7B and ALoDLM-8B and initialized from the corresponding Qwen3 backbones.

    8.2B40K ctx CC BY-NC 4.0
    1.5KOct 2026gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Newer release
    vs
  13. utter-project logo

    EuroLLM-9B-Instruct-2512

    utter-project·Chat

    ≈7.2 GB

    This is the model card for EuroLLM-9B-Instruct-2512, an improved version of utter-project/EuroLLM-9B-Instruct. In comparison with the previous version, this version includes the long-context extension phase and the revamped post-training recipe from utter-project/EuroLLM-22B-Instruct.

    9.2B32K ctx Apache 2.0
    6.4KJan 2026gguf
    • Same category
    • Similar size (9.2B vs 8.8B)
    • Commercial use OK
    vs
  14. tencent logo

    ContextPilot-E4B

    tencent·Chat

    ≈5.9 GB

    ContextPilot-E4B is the Gemma4-E4B checkpoint of ContextPilot, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools.

    7.9B128K ctx Custom licence
    2.1KAug 2026gguf
    • Same category
    • Similar size (7.9B vs 8.8B)
    vs
  15. microsoft logo

    Sentiment-Analysis-7B

    microsoft·Chat

    ≈5.8 GB

    Sentiment-Analysis-7B is a 7B-parameter autoregressive language model fine-tuned for sentiment classification of user messages directed at a service, product, or agent (the "Target").

    7.2B32K ctx MIT
    3KOct 2026gguf
    • Same category
    • Similar size (7.2B vs 8.8B)
    • Commercial use OK
    • Newer release
    vs
  16. GSAI-ML logo

    LLaDA-8B-Instruct

    GSAI-ML·Chat

    ≈7.3 GB

    We introduce LLaDA, a diffusion model with an unprecedented 8B scale, trained entirely from scratch, rivaling LLaMA3 8B in performance.

    8B4K ctx MIT
    105KFeb 2025gguf
    • Same category
    • Similar size (8B vs 8.8B)
    • Commercial use OK
    vs
  17. Qwen logo

    Qwen2.5-7B

    Qwen·Chat

    ≈5.5 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    7.6B128K ctx Apache 2.0
    517KSept 2024gguf
    • Same category
    • Similar size (7.6B vs 8.8B)
    • Commercial use OK
    vs
  18. microsoft logo

    UserLM-2.0

    microsoft·Chat

    ≈6.3 GB

    UserLM-2.0 is an 8-billion-parameter user simulator for user-AI conversations. Unlike typical language models trained to play the assistant, UserLM-2.0 generates the user side of a conversation. It is conditioned on a task intent that describes the user's high-level objective.

    8B128K ctx MIT
    1.1KOct 2026gguf
    • Same category
    • Similar size (8B vs 8.8B)
    • Commercial use OK
    vs
  19. LiquidAI logo

    LFM2-8B-A1B

    LiquidAI·Chat

    ≈5.8 GB

    LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

    8.3BA1B125K ctx lfm1.0
    11.4KOct 2025gguf
    • Same category
    • Similar size (8.3B vs 8.8B)
    vs
  20. NVIDIA-Nemotron-Nano-9B-v2-Japanese is a large language model (LLM) trained from scratch by NVIDIA and designed as a unified model for both reasoning and non-reasoning tasks, specifically optimized for the Japanese language.

    8.9B128K ctx nvidia-nemotron-open-model-license
    3.2KFeb 2026gguf
    • Same category
    • Similar size (8.9B vs 8.8B)
    • Commercial use OK
    vs
  21. openbmb logo

    BitCPM-CANN-8B

    openbmb·Chat

    ≈5.5 GB

    BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.

    8B32K ctx Apache 2.0
    3KMay 2026gguf
    • Same category
    • Similar size (8B vs 8.8B)
    • Commercial use OK
    vs
  22. meta-llama logo

    Llama-3.1-8B

    meta-llama·Chat

    ≈6.3 GB

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out).

    8B128K ctx Llama 3.1 Community License
    443.8KJul 2024gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  23. internlm logo

    internlm3-8b-instruct

    internlm·Chat

    ≈6.1 GB

    InternLM3 has open-sourced an 8-billion parameter instruction model, InternLM3-8B-Instruct, designed for general-purpose usage and advanced reasoning. This model has the following characteristics:

    8.8B32K ctx Apache 2.0
    45.9KJan 2025gguf
    • Same category
    • Similar size (8.8B vs 8.8B)
    • Commercial use OK
    vs
  24. nvidia logo≈6.3 GB

    NVIDIA Nemotron-H-8B-Base-8K is a large language model (LLM) developed by NVIDIA that is designed as a completion model for a given piece of text. It uses a hybrid model architecture that consists primarily of Mamba-2 and MLP layers combined with just four Attention layers.

    8.1Bnvidia-internal-scientific-research-and-development-model-license
    58.6KMar 2025
    • Same category
    • Similar size (8.1B vs 8.8B)
    vs