selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Qwen3.8-4B-Distill

120 open-weight models that do the same job as Qwen3.8-4B-Distill (4.7B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
empero-ai logo

Qwen3.8-4B-Distill

empero-ai·Chat

≈4.3 GB

Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…

4.7B256K ctx Apache 2.0
112.4KAug 2026gguf
--vram
any
--gpus
--quant
  1. microsoft logo

    Phi-4-mini-instruct

    microsoft·Chat

    ≈3.8 GB

    Phi-4-mini-instruct is a lightweight open model built upon synthetic data and filtered publicly available websites - with a focus on high-quality, reasoning dense data. The model belongs to the Phi-4 model family and supports 128K token context length.

    3.8B128K ctx MIT
    301.6KFeb 2025ollama
    • Same category
    • Similar size (3.8B vs 4.7B)
    • Commercial use OK
    vs
  2. ornith-ai logo

    Ornith-1.5-9B

    ornith-ai·Chat

    ≈7.2 GB

    Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.

    9.7B256K ctx MIT
    570.4KAug 2026ollama
    • Same category
    • Larger (9.7B vs 4.7B)
    • Commercial use OK
    • Newer release
    vs
  3. Nanbeige logo

    Nanbeige4.1-3B

    Nanbeige·Chat

    ≈3.3 GB

    Nanbeige4.1-3B is built upon Nanbeige4-3B-Base and represents an enhanced iteration of our previous reasoning model, Nanbeige4-3B-Thinking-2511, achieved through further post-training optimization with supervised fine-tuning (SFT) and reinforcement learning (RL).

    3.9B256K ctx Apache 2.0
    10.3KFeb 2026gguf
    • Same category
    • Similar size (3.9B vs 4.7B)
    • Commercial use OK
    vs
  4. arcee-ai logo

    AFM-4.5B

    arcee-ai·Chat

    ≈3.8 GB

    AFM-4.5B is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.

    4.6B64K ctx Apache 2.0
    7.1KJul 2025gguf
    • Same category
    • Similar size (4.6B vs 4.7B)
    • Commercial use OK
    vs
  5. CohereLabs logo

    tiny-aya-global

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    28.8KFeb 2026gguf
    • Same category
    • Similar size (3.3B vs 4.7B)
    vs
  6. Qwen logo≈5.5 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    7.6B32K ctx Apache 2.0
    6.5MSept 2024ollama
    • Same category
    • Similar size (7.6B vs 4.7B)
    • Commercial use OK
    • Widely used
    vs
  7. ibm-granite logo≈3.3 GB

    Model Summary: Granite-4.1-3B-LLMON-preview is a 3B parameter instruct model fine-tuned from Granite-4.1-3B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

    3.7B128K ctx Apache 2.0
    2.2KOct 2026gguf
    • Same category
    • Similar size (3.7B vs 4.7B)
    • Commercial use OK
    • Newer release
    vs
  8. NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.

    8B64K ctx openmdw-1.1
    29.7KOct 2026gguf
    • Same category
    • Similar size (8B vs 4.7B)
    • Commercial use OK
    • Newer release
    vs
  9. allenai logo

    Olmo-3-7B-Instruct

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    128.7KNov 2025ollama
    • Same category
    • Similar size (7.3B vs 4.7B)
    • Commercial use OK
    vs
  10. ibm-granite logo≈3.6 GB

    Model Summary: Granite Switch 4.1 3B Preview is a modular LLM built on IBM Granite 4.1 3B with embedded adapters from the Granite Libraries collection.

    4.1B128K ctx Apache 2.0
    1.8KMay 2026gguf
    • Same category
    • Similar size (4.1B vs 4.7B)
    • Commercial use OK
    vs
  11. Nanbeige logo

    Nanbeige4.2-3B-Base

    Nanbeige·Chat

    ≈3.7 GB

    Nanbeige4.2-3B-Base is a new base model in the Nanbeige4 series, trained from scratch with improvements to both model architecture and training data.

    4.2B128K ctx Apache 2.0
    889Jul 2026gguf
    • Same category
    • Similar size (4.2B vs 4.7B)
    • Commercial use OK
    vs
  12. HuggingFaceTB logo

    SmolLM3-3B

    HuggingFaceTB·Chat

    ≈2.9 GB

    SmolLM3 is a 3B parameter language model designed to push the boundaries of small models. It supports dual mode reasoning, 6 languages and long context. SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale.

    3.1B64K ctx Apache 2.0
    229.1KJul 2025gguf
    • Same category
    • Similar size (3.1B vs 4.7B)
    • Commercial use OK
    vs
  13. LiquidAI logo

    LFM2.5-2.6B

    LiquidAI·Chat

    ≈2.6 GB

    LFM2.5-2.6B is part of LFM2.5, a family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with a 128K context window and agentic post-training.

    2.7B128K ctx lfm1.0
    39.9KJul 2026gguf
    • Same category
    • Similar size (2.7B vs 4.7B)
    vs
  14. Qwen logo≈2.6 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    3.1B32K ctx Qwen Research License
    2MSept 2024ollama
    • Same category
    • Similar size (3.1B vs 4.7B)
    • Widely used
    vs
  15. ibm-granite logo

    granite-4.1-3b-base

    ibm-granite·Chat

    ≈3.1 GB

    Model Summary: Granite‑4.1‑3B‑Base is a decoder‑only language model with long‑context capabilities, designed to support a broad range of general text‑to‑text generation tasks, as well as fill‑in‑the‑Middle (FIM) code completion.

    3.4B128K ctx Apache 2.0
    10.6KApr 2026gguf
    • Same category
    • Similar size (3.4B vs 4.7B)
    • Commercial use OK
    vs
  16. microsoft logo

    Phi-3.5-mini-instruct

    microsoft·Chat

    ≈5.8 GB

    Phi-3.5-mini is a lightweight, state-of-the-art open model built upon datasets used for Phi-3 - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data. The model belongs to the Phi-3 model family and supports 128K token context length.

    3.8B128K ctx MIT
    340.3KAug 2024gguf
    • Same category
    • Similar size (3.8B vs 4.7B)
    • Commercial use OK
    vs
  17. ibm-granite logo

    granite-4.2-8b

    ibm-granite·Chat

    ≈7.0 GB

    Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.

    8.8B128K ctx Apache 2.0
    59.9KAug 2026ollama
    • Same category
    • Similar size (8.8B vs 4.7B)
    • Commercial use OK
    vs
  18. KRAFTON logo

    Raon-1-nano

    KRAFTON·Chat

    ≈5.6 GB

    Raon-1 nano is a dense language model with 1.5B effective parameters (3.1B total, including a 1.5B per-layer embedding table), developed by KRAFTON AI. It is designed to follow instructions, maintain conversational context, and call the right tools in both Korean and English.

    3.5B256K ctx Apache 2.0
    1.3KOct 2026gguf
    • Same category
    • Similar size (3.5B vs 4.7B)
    • Commercial use OK
    • Newer release
    vs
  19. microsoft logo

    Phi-tiny-MoE-instruct

    microsoft·Chat

    ≈3.0 GB

    Phi-tiny-MoE is a lightweight Mixture of Experts (MoE) model with 3.8B total parameters and 1.1B activated parameters. It is compressed and distilled from the base model shared by Phi-3.5-MoE and GRIN-MoE using the SlimMoE approach, then post-trained via supervised fine-tuning and direct preference…

    3.8BA1.3B4K ctx MIT
    30.3KJun 2025gguf
    • Same category
    • Similar size (3.8B vs 4.7B)
    • Commercial use OK
    vs
  20. allenai logo

    Olmo-3-1025-7B

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models. This suite includes Base, Instruct, and Think variants. The Base models were trained using a staged training approach.

    7.3B64K ctx Apache 2.0
    106.3KSept 2025gguf
    • Same category
    • Similar size (7.3B vs 4.7B)
    • Commercial use OK
    vs
  21. janhq logo≈4.2 GB

    Jan-v3-4B-base-instruct is a 4B-parameter model obtained via post-training distillation from a larger teacher, transferring capabilities while preserving general-purpose performance on standard benchmarks.

    4.4B256K ctx Apache 2.0
    1.1KJan 2026gguf
    • Same category
    • Similar size (4.4B vs 4.7B)
    • Commercial use OK
    vs
  22. meta-llama logo

    Llama-3.2-3B-Instruct

    meta-llama·Chat

    ≈3.3 GB

    The Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out).

    3.2B128K ctx Llama 3.2 Community License
    834.2KSept 2024ollama
    • Same category
    • Similar size (3.2B vs 4.7B)
    vs
  23. nvidia logo≈4.2 GB

    Llama-3.1-Nemotron-Nano-4B-v1.1 is a large language model (LLM) which is a derivative of nvidia/Llama-3.1-Minitron-4B-Width-Base, which is created from Llama 3.1 8B using our LLM compression technique and offers improvements in model accuracy and efficiency.

    4.5B128K ctx NVIDIA Open Model License
    6.6KMay 2025gguf
    • Same category
    • Similar size (4.5B vs 4.7B)
    • Commercial use OK
    vs
  24. openbmb logo

    AgentCPM-Explore

    openbmb·Chat

    ≈4.0 GB

    We elaborate on the entire construction pipeline of AgentCPM-Explore on GitHub.

    4B256K ctx Apache 2.0
    2.4KJan 2026gguf
    • Same category
    • Similar size (4B vs 4.7B)
    • Commercial use OK
    vs