selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Qwen3.8-4B-Distill

120 open-weight models that do the same job as Qwen3.8-4B-Distill (4.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
empero-ai logo

Qwen3.8-4B-Distill

empero-ai·Chat

≈4.3 GB

Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…

4.7B256K ctx Apache 2.0
130.3KAug 2026gguf
--vram
any
--gpus
--quant
  1. Salesforce logo

    Llama-xLAM-2-8b-fc-r

    Salesforce·Chat

    ≈6.3 GB

    Large Action Models (LAMs) are advanced language models designed to enhance decision-making by translating user intentions into executable actions.

    8B128K ctx CC BY-NC 4.0
    125.1KMar 2025gguf
    • Same category
    • Similar size (8B vs 4.7B)
    vs
  2. ai9stars logo

    G9v3-3B

    ai9stars·Chat

    ≈2.7 GB

    G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.

    3B128K ctx Apache 2.0
    1.2KJul 2026gguf
    • Same category
    • Similar size (3B vs 4.7B)
    • Commercial use OK
    vs
  3. Dream-org logo

    Dream-v0-Instruct-7B

    Dream-org·Chat

    ≈5.5 GB

    This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:

    7.6B128K ctx Apache 2.0
    72.8KApr 2025gguf
    • Same category
    • Similar size (7.6B vs 4.7B)
    • Commercial use OK
    vs
  4. ibm-granite logo

    granite-guardian-4.1-8b

    ibm-granite·Chat

    ≈6.7 GB

    Granite Guardian 4.1 8B introduces improved Bring Your Own Criteria (BYOC) support, enabling users to define arbitrary judging criteria beyond the pre-baked safety and hallucination detectors.

    8.4B128K ctx Apache 2.0
    9.2KApr 2026gguf
    • Same category
    • Similar size (8.4B vs 4.7B)
    • Commercial use OK
    vs
  5. tencent logo

    ContextPilot-E4B

    tencent·Chat

    ≈5.9 GB

    ContextPilot-E4B is the Gemma4-E4B checkpoint of ContextPilot, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools.

    7.9B128K ctx Custom licence
    2KAug 2026gguf
    • Same category
    • Similar size (7.9B vs 4.7B)
    • Newer release
    vs
  6. zgcagi logo

    ZGCM-1-7B

    zgcagi·Chat

    ≈5.9 GB

    ZGCM-1 is a 7.39B-parameter dense language model trained from scratch, built for mathematical reasoning and tool-assisted search. It combines deliberate internal thinking with active information gathering, supporting 256K-token context and both thinking and direct-response modes in a single model.

    7.4B256K ctx MIT
    957Sept 2026gguf
    • Same category
    • Similar size (7.4B vs 4.7B)
    • Commercial use OK
    • Newer release
    vs
  7. CohereLabs logo

    tiny-aya-fire

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    1.4KFeb 2026gguf
    • Same category
    • Similar size (3.3B vs 4.7B)
    vs
  8. ibm-granite logo

    granite-4.0-micro-base

    ibm-granite·Chat

    ≈3.1 GB

    Model Summary: Granite-4.0-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.

    3.4B128K ctx Apache 2.0
    3.2KSept 2025gguf
    • Same category
    • Similar size (3.4B vs 4.7B)
    • Commercial use OK
    vs
  9. ibm-granite logo

    granite-3.3-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.3-8B-Instruct is a 8-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

    8.2B128K ctx Apache 2.0
    101KApr 2025ollama
    • Same category
    • Similar size (8.2B vs 4.7B)
    • Commercial use OK
    vs
  10. sbintuitions logo≈3.7 GB

    This repository provides Japanese language models trained by SB Intuitions.

    3.4B8K ctx MIT
    16KFeb 2025gguf
    • Same category
    • Similar size (3.4B vs 4.7B)
    • Commercial use OK
    vs
  11. amazon logo

    ALoDLM-8B

    amazon·Chat

    ≈6.5 GB

    ALoDLM is a family of diffusion language models developed at Amazon, available as ALoDLM-1.7B and ALoDLM-8B and initialized from the corresponding Qwen3 backbones.

    8.2B40K ctx CC BY-NC 4.0
    1.6KOct 2026gguf
    • Same category
    • Similar size (8.2B vs 4.7B)
    • Newer release
    vs
  12. ibm-granite logo

    granite-4.0-h-micro

    ibm-granite·Chat

    ≈3.0 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    3.2B128K ctx Apache 2.0
    5.2KSept 2025gguf
    • Same category
    • Similar size (3.2B vs 4.7B)
    • Commercial use OK
    vs
  13. Menlo logo

    Jan-nano-128k

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of Jan-Nano, this enhanced version features a native 128k context window that enables deeper, more comprehensive research capabilities without the performance…

    4B128K ctx Apache 2.0
    1.1KJun 2025gguf
    • Same category
    • Similar size (4B vs 4.7B)
    • Commercial use OK
    vs
  14. mistralai logo≈5.8 GB

    The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.

    7.2B32K ctx Apache 2.0
    1.2MDec 2023ollama
    • Same category
    • Similar size (7.2B vs 4.7B)
    • Commercial use OK
    vs
  15. allenai logo≈5.1 GB

    OLMoE-1B-7B-0125-Instruct January 2025 is post-trained variant of the OLMoE-1B-7B January 2025 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset and further DPO training on this dataset, and finally RLVR training using this data.

    6.9BA1.3B4K ctx Apache 2.0
    33.1KJan 2025gguf
    • Same category
    • Similar size (6.9B vs 4.7B)
    • Commercial use OK
    vs
  16. GSAI-ML logo

    LLaDA-8B-Instruct

    GSAI-ML·Chat

    ≈7.3 GB

    We introduce LLaDA, a diffusion model with an unprecedented 8B scale, trained entirely from scratch, rivaling LLaMA3 8B in performance.

    8B4K ctx MIT
    103.3KFeb 2025gguf
    • Same category
    • Similar size (8B vs 4.7B)
    • Commercial use OK
    vs
  17. openbmb logo

    MathForm-8B

    openbmb·Chat

    ≈6.5 GB

    MathForm-8B is an autoformalization model that translates natural-language mathematical statements into Lean 4. It is released with the paper MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement.

    8.2B40K ctx Apache 2.0
    2KAug 2026gguf
    • Same category
    • Similar size (8.2B vs 4.7B)
    • Commercial use OK
    vs
  18. Qwen logo≈5.5 GB

    Qwen2.5-1M is the long-context version of the Qwen2.5 series models, supporting a context length of up to 1M tokens. Compared to the Qwen2.5 128K version, Qwen2.5-1M demonstrates significantly improved performance in handling long-context tasks while maintaining its capability in short tasks.

    7.6B1M ctx Apache 2.0
    79.4KJan 2025gguf
    • Same category
    • Similar size (7.6B vs 4.7B)
    • Commercial use OK
    vs
  19. allenai logo≈8.7 GB

    We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run.

    7.4B32K ctx Apache 2.0
    3KFeb 2026
    • Same category
    • Similar size (7.4B vs 4.7B)
    • Commercial use OK
    vs
  20. ibm-research logo

    PowerMoE-3b

    ibm-research·Chat

    ≈2.8 GB

    PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.

    3.4BA958M4K ctx Apache 2.0
    55.2KAug 2024gguf
    • Same category
    • Similar size (3.4B vs 4.7B)
    • Commercial use OK
    vs
  21. janhq logo

    Jan-v1-4B

    janhq·Chat

    ≈4.0 GB

    Jan-v1 is the first release in the Jan Family, designed for agentic reasoning and problem-solving within the Jan App. Based on our Lucy model, Jan-v1 achieves improved performance through model scaling.

    4B256K ctx Apache 2.0
    727Aug 2025gguf
    • Same category
    • Similar size (4B vs 4.7B)
    • Commercial use OK
    vs
  22. nvidia logo≈6.1 GB

    Nemotron-Labs-Diffusion is a tri-mode language model that supports both AR decoding and diffusion-based parallel decoding by simply switching the attention pattern of the same model during inference.

    8.5B4K ctx nvidia-nemotron-open-model-license
    13KJan 2026
    • Same category
    • Similar size (8.5B vs 4.7B)
    • Commercial use OK
    vs
  23. openbmb logo

    BitCPM-CANN-8B

    openbmb·Chat

    ≈5.5 GB

    BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.

    8B32K ctx Apache 2.0
    3KMay 2026gguf
    • Same category
    • Similar size (8B vs 4.7B)
    • Commercial use OK
    vs
  24. openbmb logo

    MiniCPM3-4B

    openbmb·Chat

    ≈10 GB

    MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

    4B32K ctx Apache 2.0
    10.2KSept 2024gguf
    • Same category
    • Similar size (4B vs 4.7B)
    • Commercial use OK
    vs