selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Qwen3.8-27B-DSpine-b16

120 open-weight models that do the same job as Qwen3.8-27B-DSpine-b16 (2B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
tencent logo≈1.9 GB

This checkpoint is a five-layer draft model for Qwen3.8-27B, with block size 16 and an 8,192-token sliding window.

2B256K ctx Apache 2.0
4.9KNov 2026gguf
--vram
any
--gpus
--quant
  1. ai9stars logo

    G9v3-3B

    ai9stars·Chat

    ≈2.7 GB

    G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.

    3B128K ctx Apache 2.0
    1.2KJul 2026gguf
    • Same category
    • Similar size (3B vs 2B)
    • Commercial use OK
    vs
  2. m-a-p logo≈3.7 GB

    --- Our model's name is YuE (乐). In Chinese, the word means "music" and "happiness." Some of you may find words that start with Yu hard to pronounce. If so, you can just call it "yeah." We wrote a song with our model's name.

    2B8K ctx Apache 2.0
    2.7KJan 2025gguf
    • Same category
    • Similar size (2B vs 2B)
    • Commercial use OK
    vs
  3. ibm-granite logo

    granite-3.1-2b-instruct

    ibm-granite·Chat

    ≈2.6 GB

    Model Summary: Granite-3.1-2B-Instruct is a 2B parameter long-context instruct model finetuned from Granite-3.1-2B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems.

    2.5B128K ctx Apache 2.0
    21.6KDec 2024gguf
    • Same category
    • Similar size (2.5B vs 2B)
    • Commercial use OK
    vs
  4. google logo

    gemma-2-2b

    google·Chat

    ≈2.9 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    2.6B8K ctx Gemma Terms of Use
    78.5KJul 2024gguf
    • Same category
    • Similar size (2.6B vs 2B)
    vs
  5. meta-llama logo

    Llama-3.2-3B

    meta-llama·Chat

    ≈3.3 GB

    The Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out).

    3.2B128K ctx Llama 3.2 Community License
    317KSept 2024gguf
    • Same category
    • Similar size (3.2B vs 2B)
    vs
  6. Qwen logo

    Qwen2.5-3B

    Qwen·Chat

    ≈2.6 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    3.1B32K ctx Qwen Research License
    221.6KSept 2024gguf
    • Same category
    • Similar size (3.1B vs 2B)
    vs
  7. Qwen logo

    Qwen3-4B-Base

    Qwen·Chat

    ≈4.0 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    4B32K ctx Apache 2.0
    445.2KApr 2025gguf
    • Same category
    • Similar size (4B vs 2B)
    • Commercial use OK
    vs
  8. google logo

    txgemma-2b-predict

    google·Chat

    ≈2.6 GB

    TxGemma is a collection of lightweight, state-of-the-art, open language models built upon Gemma 2, fine-tuned for therapeutic development. It comes in 3 sizes, 2B, 9B, and 27B.

    2.6Bhealth-ai-developer-foundations
    10.9KMar 2025gguf
    • Same category
    • Similar size (2.6B vs 2B)
    vs
  9. ibm-granite logo

    granite-4.0-h-1b

    ibm-granite·Chat

    ≈2.0 GB

    Model Summary: Granite-4.0-H-1B is a lightweight instruct model finetuned from Granite-4.0-H-1B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets.

    1.5B128K ctx Apache 2.0
    4.1KOct 2025gguf
    • Same category
    • Similar size (1.5B vs 2B)
    • Commercial use OK
    vs
  10. kyutai logo≈2.7 GB

    Helium-1 preview is a lightweight language model with 2B parameters, targeting edge and mobile devices. It supports the following languages: English, French, German, Italian, Portuguese, Spanish.

    2.2B4K ctx CC BY 4.0
    3.1KJan 2025
    • Same category
    • Similar size (2.2B vs 2B)
    • Commercial use OK
    vs
  11. Almawave logo

    Velvet-2B

    Almawave·Chat

    ≈2.4 GB

    Velvet is an Italian family of large language models, developed from scratch, featuring a dense architecture. This model was trained on the HPC Leonardo infrastructure hosted by CINECA, utilizing public data that underwent extensive curation.

    2.2BApache 2.0
    2.8KFeb 2025gguf
    • Same category
    • Similar size (2.2B vs 2B)
    • Commercial use OK
    vs
  12. microsoft logo≈2.2 GB

    This repository contains the weights for BitNet b1.58 2B4T, the first open-source, native 1-bit Large Language Model (LLM) at the 2-billion parameter scale, developed by Microsoft Research.

    2.4B4K ctx MIT
    3.5KApr 2025gguf
    • Same category
    • Similar size (2.4B vs 2B)
    • Commercial use OK
    vs
  13. Qwen logo

    Qwen2-1.5B

    Qwen·Chat

    ≈1.6 GB

    Qwen2 is the new series of Qwen large language models. For Qwen2, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters, including a Mixture-of-Experts model. This repo contains the 1.5B Qwen2 base language model.

    1.5B128K ctx Apache 2.0
    103KMay 2024gguf
    • Same category
    • Similar size (1.5B vs 2B)
    • Commercial use OK
    vs
  14. ibm-granite logo

    granite-4.0-micro

    ibm-granite·Chat

    ≈3.1 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    3.4B128K ctx Apache 2.0
    23.8KSept 2025gguf
    • Same category
    • Similar size (3.4B vs 2B)
    • Commercial use OK
    vs
  15. LiquidAI logo

    LFM2-2.6B-Transcript

    LiquidAI·Chat

    ≈2.5 GB

    Based on LFM2-2.6B, LFM2-2.6B-Transcript is designed for private, on-device meeting summarization. We partnered with AMD to deliver cloud-level summary quality while running entirely locally, ensuring that your meeting data never leaves your device.

    2.6B125K ctx lfm1.0
    744Jan 2026gguf
    • Same category
    • Similar size (2.6B vs 2B)
    vs
  16. CohereLabs logo

    tiny-aya-earth

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    5.9KFeb 2026gguf
    • Same category
    • Similar size (3.3B vs 2B)
    vs
  17. HuggingFaceTB logo

    SmolLM-1.7B

    HuggingFaceTB·Chat

    ≈1.9 GB

    SmolLM is a series of state-of-the-art small language models available in three sizes: 135M, 360M, and 1.7B parameters. These models are built on Cosmo-Corpus, a meticulously curated high-quality training dataset.

    1.7B2K ctx Apache 2.0
    23.4KJul 2024ollama
    • Same category
    • Similar size (1.7B vs 2B)
    • Commercial use OK
    vs
  18. microsoft logo

    Phi-4-mini-instruct

    microsoft·Chat

    ≈3.8 GB

    Phi-4-mini-instruct is a lightweight open model built upon synthetic data and filtered publicly available websites - with a focus on high-quality, reasoning dense data. The model belongs to the Phi-4 model family and supports 128K token context length.

    3.8B128K ctx MIT
    306.1KFeb 2025ollama
    • Same category
    • Similar size (3.8B vs 2B)
    • Commercial use OK
    vs
  19. openbmb logo

    MiniCPM-2B-sft-bf16

    openbmb·Chat

    ≈3.1 GB

    MiniCPM is an End-Size LLM developed by ModelBest Inc. and TsinghuaNLP, with only 2.4B parameters excluding embeddings.

    2B4K ctx Unknown licence
    20.8KJan 2024gguf
    • Same category
    • Similar size (2B vs 2B)
    vs
  20. Qwen logo≈1.6 GB

    Qwen2 is the new series of Qwen large language models. For Qwen2, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters, including a Mixture-of-Experts model. This repo contains the instruction-tuned 1.5B Qwen2 model.

    1.5B32K ctx Apache 2.0
    82KJun 2024ollama
    • Same category
    • Similar size (1.5B vs 2B)
    • Commercial use OK
    vs
  21. XHToken logo

    Spark-X2.5-4B

    XHToken·Chat

    ≈4.1 GB

    We are introducing Spark-X2.5-4B and Spark-X2.5-1.7B, two compact, general-purpose language models designed to make capable AI more practical, efficient, and accessible.

    4.1B1M ctx Apache 2.0
    8.6KAug 2026gguf
    • Same category
    • Larger (4.1B vs 2B)
    • Commercial use OK
    vs
  22. allenai logo

    Bolmo-1B

    allenai·Chat

    ≈1.9 GB

    OLMo 2 1B retrofitted to operate over bytes instead of tokens via byteification through a short additional training procedure.

    1.5B4K ctx Apache 2.0
    1.7KDec 2025
    • Same category
    • Similar size (1.5B vs 2B)
    • Commercial use OK
    vs
  23. ibm-granite logo

    granite-3.3-2b-base

    ibm-granite·Chat

    ≈2.6 GB

    Granite-3.3-2B-Base is a decoder-only language model with a 128K token context window. It improves upon Granite-3.1-2B-Base by adding support for Fill-in-the-Middle (FIM) using specialized tokens, enabling the model to generate content conditioned on both prefix and suffix.

    2.5B128K ctx Apache 2.0
    4.4KApr 2025gguf
    • Same category
    • Similar size (2.5B vs 2B)
    • Commercial use OK
    vs
  24. LiquidAI logo

    LFM2.5-1.2B-JP-202606

    LiquidAI·Chat

    ≈1.4 GB

    LFM2.5-1.2B-JP-202606 is our latest general purpose Japanese chat model, delivering significant improvements in knowledge, instruction following, math, code, and tool-use over both the models of comparable size and LFM2.5-1.2B-JP.

    1.2B125K ctx lfm1.0
    3.9KMay 2026gguf
    • Same category
    • Similar size (1.2B vs 2B)
    vs