selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Spark-X2.6-4B-Base

120 open-weight models that do the same job as Spark-X2.6-4B-Base (4.1B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
XHToken logo

Spark-X2.6-4B-Base

XHToken·Chat

≈4.1 GB

A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward.

4.1B1M ctx Apache 2.0
2.5KOct 2026gguf
--vram
any
--gpus
--quant
  1. ibm-granite logo

    granite-4.0-micro-base

    ibm-granite·Chat

    ≈3.1 GB

    Model Summary: Granite-4.0-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.

    3.4B128K ctx Apache 2.0
    3.2KSept 2025gguf
    • Same category
    • Similar size (3.4B vs 4.1B)
    • Commercial use OK
    vs
  2. ibm-granite logo

    granite-4.0-h-micro

    ibm-granite·Chat

    ≈3.0 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    3.2B128K ctx Apache 2.0
    5.1KSept 2025gguf
    • Same category
    • Similar size (3.2B vs 4.1B)
    • Commercial use OK
    vs
  3. sbintuitions logo≈3.7 GB

    This repository provides Japanese language models trained by SB Intuitions.

    3.4B8K ctx MIT
    16KFeb 2025gguf
    • Same category
    • Similar size (3.4B vs 4.1B)
    • Commercial use OK
    vs
  4. tencent logo

    Hunyuan-4B-Instruct

    tencent·Chat

    ≈4.1 GB

    Hunyuan is Tencent's open-source efficient large language model series, designed for versatile deployment across diverse computational environments.

    4.2B256K ctx Unknown licence
    987Jul 2025gguf
    • Same category
    • Similar size (4.2B vs 4.1B)
    vs
  5. Menlo logo

    Jan-nano-128k

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of Jan-Nano, this enhanced version features a native 128k context window that enables deeper, more comprehensive research capabilities without the performance…

    4B128K ctx Apache 2.0
    1.1KJun 2025gguf
    • Same category
    • Similar size (4B vs 4.1B)
    • Commercial use OK
    vs
  6. ibm-research logo

    PowerMoE-3b

    ibm-research·Chat

    ≈2.8 GB

    PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.

    3.4BA958M4K ctx Apache 2.0
    55.4KAug 2024gguf
    • Same category
    • Similar size (3.4B vs 4.1B)
    • Commercial use OK
    vs
  7. inclusionAI logo

    Ling-3.0-tiny

    inclusionAI·Chat

    ≈6.7 GB

    We are introducing Ling-3.0-tiny, a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token.

    7.9BA1.4B128K ctx MIT
    13.6KAug 2026gguf
    • Same category
    • Similar size (7.9B vs 4.1B)
    • Commercial use OK
    vs
  8. janhq logo

    Jan-v1-4B

    janhq·Chat

    ≈4.0 GB

    Jan-v1 is the first release in the Jan Family, designed for agentic reasoning and problem-solving within the Jan App. Based on our Lucy model, Jan-v1 achieves improved performance through model scaling.

    4B256K ctx Apache 2.0
    738Aug 2025gguf
    • Same category
    • Similar size (4B vs 4.1B)
    • Commercial use OK
    vs
  9. openbmb logo

    MiniCPM3-4B

    openbmb·Chat

    ≈10 GB

    MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

    4B32K ctx Apache 2.0
    10.1KSept 2024gguf
    • Same category
    • Similar size (4B vs 4.1B)
    • Commercial use OK
    vs
  10. ibm-granite logo

    granite-4.1-8b

    ibm-granite·Chat

    ≈7.0 GB

    Model Summary: Granite-4.1-8B is a 8B parameter long-context instruct model finetuned from Granite-4.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets.

    8.8B128K ctx Apache 2.0
    82.2KApr 2026ollama
    • Same category
    • Larger (8.8B vs 4.1B)
    • Commercial use OK
    vs
  11. Menlo logo

    Jan-nano

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.

    4B40K ctx Apache 2.0
    1KJun 2025gguf
    • Same category
    • Similar size (4B vs 4.1B)
    • Commercial use OK
    vs
  12. Qwen logo

    Qwen3-8B-Base

    Qwen·Chat

    ≈6.5 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    8.2B32K ctx Apache 2.0
    597.9KApr 2025gguf
    • Same category
    • Similar size (8.2B vs 4.1B)
    • Commercial use OK
    vs
  13. arcee-ai logo

    AFM-4.5B-Base

    arcee-ai·Chat

    ≈3.8 GB

    AFM-4.5B-Base is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.

    4.6B64K ctx Apache 2.0
    1.6KJul 2025gguf
    • Same category
    • Similar size (4.6B vs 4.1B)
    • Commercial use OK
    vs
  14. meta-llama logo

    Llama-3.1-8B-Instruct

    meta-llama·Chat

    ≈6.3 GB

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out).

    8B128K ctx Llama 3.1 Community License
    4.2MJul 2024ollama
    • Same category
    • Similar size (8B vs 4.1B)
    • Widely used
    vs
  15. microsoft logo

    Sentiment-Analysis-7B

    microsoft·Chat

    ≈5.8 GB

    Sentiment-Analysis-7B is a 7B-parameter autoregressive language model fine-tuned for sentiment classification of user messages directed at a service, product, or agent (the "Target").

    7.2B32K ctx MIT
    3KOct 2026gguf
    • Same category
    • Similar size (7.2B vs 4.1B)
    • Commercial use OK
    vs
  16. IFM logo

    K2-Horizon-7B

    IFM·Chat

    ≈7.0 GB

    K2-Horizon-7B is the medium dense member of the K2-Horizon family: a 7B-core decoder-only model with a 512K context window.

    9B512K ctx Apache 2.0
    28.7KSept 2026gguf
    • Same category
    • Larger (9B vs 4.1B)
    • Commercial use OK
    vs
  17. nvidia logo≈6.6 GB

    Nemotron-Labs-Diffusion is a tri-mode language model that supports both AR decoding and diffusion-based parallel decoding by simply switching the attention pattern of the same model during inference.

    8.5B256K ctx nvidia-nemotron-open-model-license
    60.5KMar 2026gguf
    • Same category
    • Larger (8.5B vs 4.1B)
    • Commercial use OK
    vs
  18. swiss-ai logo≈6.3 GB

    Apertus is a 70B and 8B parameter language model designed to push the boundaries of fully-open multilingual and transparent models.

    8.1B64K ctx Apache 2.0
    204.9KAug 2025gguf
    • Same category
    • Similar size (8.1B vs 4.1B)
    • Commercial use OK
    vs
  19. A compact 9B reasoning model distilled from DeepSeek-V4-Pro in Max Effect mode

    9.4B256K ctx Apache 2.0
    27KOct 2026gguf
    • Same category
    • Larger (9.4B vs 4.1B)
    • Commercial use OK
    • Newer release
    vs
  20. ByteDance logo

    Ouro-2.6B

    ByteDance·Chat

    ≈5.1 GB

    Ouro-2.6B is a 2.6 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.

    2.7B64K ctx Apache 2.0
    10.3KOct 2025gguf
    • Same category
    • Similar size (2.7B vs 4.1B)
    • Commercial use OK
    vs
  21. CohereLabs logo

    tiny-aya-en-thinker

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya En-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model.

    3.4BCC BY-NC 4.0
    124Sept 2026
    • Same category
    • Similar size (3.4B vs 4.1B)
    vs
  22. CohereLabs logo

    tiny-aya-water

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    527Feb 2026gguf
    • Same category
    • Similar size (3.3B vs 4.1B)
    vs
  23. llm-jp logo≈6.6 GB

    LLM-jp-4 is a series of large language models developed by the Research and Development Center for Large Language Models at the National Institute of Informatics.

    8.6B64K ctx Apache 2.0
    48.6KMar 2026gguf
    • Same category
    • Larger (8.6B vs 4.1B)
    • Commercial use OK
    vs
  24. ServiceNow-AI logo

    Apriel-5B-Instruct

    ServiceNow-AI·Chat

    ≈4.2 GB

    Apriel is a family of models built for versatility, offering high throughput and efficiency across a wide range of tasks.

    4.8B16K ctx MIT
    3.9KApr 2025
    • Same category
    • Similar size (4.8B vs 4.1B)
    • Commercial use OK
    vs