selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Spark-X2.6-4B-Base

120 open-weight models that do the same job as Spark-X2.6-4B-Base (4.1B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
XHToken logo

Spark-X2.6-4B-Base

XHToken·Chat

≈4.1 GB

A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward.

4.1B1M ctx Apache 2.0
2.4KOct 2026gguf
--vram
any
--gpus
--quant
  1. Qwen logo≈6.5 GB

    Qwen3Guard is a series of safety moderation models built upon Qwen3 and trained on a dataset of 1.19 million prompts and responses labeled for safety.

    8.2B32K ctx Apache 2.0
    110.5KSept 2025gguf
    • Same category
    • Similar size (8.2B vs 4.1B)
    • Commercial use OK
    vs
  2. speakleash logo≈4.1 GB

    Bielik-4.5B-v3-Instruct is a generative text model featuring 4.6 billion parameters. It is an instruct fine-tuned version of the Bielik-4.5B-v3.

    4.8BApache 2.0
    2.4KApr 2025gguf
    • Same category
    • Similar size (4.8B vs 4.1B)
    • Commercial use OK
    vs
  3. LiquidAI logo

    LFM2-2.6B-Longevity

    LiquidAI·Chat

    ≈2.5 GB

    Longevity-LLM (L-LLM) is a family of compact, domain-adapted language models for interpreting heterogeneous aging biology data. Longevity LFMs are available in two sizes:

    2.6B125K ctx lfm1.0
    2KMay 2026gguf
    • Same category
    • Similar size (2.6B vs 4.1B)
    vs
  4. LiquidAI logo

    LFM2.5-8B-A1B

    LiquidAI·Chat

    ≈5.9 GB

    LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.

    8.5BA1B125K ctx lfm1.0
    19.7KMay 2026ollama
    • Same category
    • Larger (8.5B vs 4.1B)
    vs
  5. tencent logo≈1.9 GB

    This checkpoint is a five-layer draft model for Qwen3.8-27B, with block size 16 and an 8,192-token sliding window.

    2B256K ctx Apache 2.0
    4.9KNov 2026gguf
    • Same category
    • Smaller (2B vs 4.1B)
    • Commercial use OK
    • Newer release
    vs
  6. tiiuae logo≈2.6 GB

    For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report.

    3.1B128K ctx Falcon LLM License
    5.9KMay 2025gguf
    • Same category
    • Similar size (3.1B vs 4.1B)
    vs
  7. allenai logo

    Olmo-Hybrid-7B

    allenai·Chat

    ≈8.7 GB

    We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run.

    7.4B64K ctx Apache 2.0
    11.1KJan 2026
    • Same category
    • Similar size (7.4B vs 4.1B)
    • Commercial use OK
    vs
  8. ibm-granite logo

    granite-3.3-2b-instruct

    ibm-granite·Chat

    ≈2.6 GB

    Model Summary: Granite-3.3-2B-Instruct is a 2-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

    2.5B128K ctx Apache 2.0
    41.1KApr 2025ollama
    • Same category
    • Similar size (2.5B vs 4.1B)
    • Commercial use OK
    vs
  9. deepcogito logo≈3.5 GB

    The Cogito LLMs are instruction tuned generative models (text in/text out). All models are released under an open license for commercial use.

    3.6B128K ctx Llama 3.2 Community License
    1.6KMar 2025gguf
    • Same category
    • Similar size (3.6B vs 4.1B)
    vs
  10. arcee-ai logo

    Trinity-Nano-Preview

    arcee-ai·Chat

    ≈4.6 GB

    Trinity Nano Preview is a preview of Arcee AI's 6B MoE model with 1B active parameters. It is the small-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.

    6.1BA1B128K ctx openmdw-1.1
    2.7KDec 2025gguf
    • Same category
    • Similar size (6.1B vs 4.1B)
    • Commercial use OK
    vs
  11. LGAI-EXAONE logo

    EXAONE-3.5-7.8B-Instruct

    LGAI-EXAONE·Chat

    ≈6.1 GB

    We introduce EXAONE 3.5, a collection of instruction-tuned bilingual (English and Korean) generative models ranging from 2.4B to 32B parameters, developed and released by LG AI Research.

    7.8B32K ctx exaone
    395.6KDec 2024ollama
    • Same category
    • Similar size (7.8B vs 4.1B)
    vs
  12. llm-jp logo≈6.6 GB

    LLM-jp-4 is a series of large language models developed by the Research and Development Center for Large Language Models at the National Institute of Informatics.

    8.6B64K ctx Apache 2.0
    22.4KMar 2026gguf
    • Same category
    • Larger (8.6B vs 4.1B)
    • Commercial use OK
    vs
  13. zai-org logo

    glm-edge-4b-chat

    zai-org·Chat

    ≈4.0 GB

    The usage of this model’s weights is subject to the terms outlined in the LICENSE.

    4.3B8K ctx GLM-4 License
    2KNov 2024gguf
    • Same category
    • Similar size (4.3B vs 4.1B)
    vs
  14. ibm-granite logo

    granite-switch-4.1-8b

    ibm-granite·Chat

    ≈7.0 GB

    📝 Read the launch blog: Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint

    8.8B128K ctx Apache 2.0
    6.3KOct 2026gguf
    • Same category
    • Larger (8.8B vs 4.1B)
    • Commercial use OK
    vs
  15. Qwen logo

    Qwen2.5-7B

    Qwen·Chat

    ≈5.5 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    7.6B128K ctx Apache 2.0
    531.9KSept 2024gguf
    • Same category
    • Similar size (7.6B vs 4.1B)
    • Commercial use OK
    vs
  16. google logo

    gemma-2-2b-it

    google·Chat

    ≈2.9 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    2.6B8K ctx Gemma Terms of Use
    170.2KJul 2024ollama
    • Same category
    • Similar size (2.6B vs 4.1B)
    vs
  17. ibm-granite logo

    granite-4.1-8b-base

    ibm-granite·Chat

    ≈6.7 GB

    Model Summary: Granite‑4.1‑8B‑Base is a decoder‑only language model with long‑context capabilities, designed to support a broad range of text‑to‑text generation tasks.

    8.4B128K ctx Apache 2.0
    14.4KApr 2026gguf
    • Same category
    • Larger (8.4B vs 4.1B)
    • Commercial use OK
    vs
  18. LiquidAI logo

    LFM2-2.6B

    LiquidAI·Chat

    ≈2.5 GB

    LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

    2.6B125K ctx lfm1.0
    6.7KSept 2025gguf
    • Same category
    • Similar size (2.6B vs 4.1B)
    vs
  19. tiiuae logo≈3.1 GB

    Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.

    3.2B32K ctx Falcon LLM License
    7.3KDec 2024ollama
    • Same category
    • Similar size (3.2B vs 4.1B)
    vs
  20. LiquidAI logo

    LFM3-1.7B-Base

    LiquidAI·Chat

    ≈1.9 GB

    LFM3-1.7B-Base is the pre-trained checkpoint behind LFM3-1.7B, a text model for local agents and specialized applications based on our new tri-hybrid architecture.

    1.7B256K ctx lfm1.0
    11.6KOct 2026ollama
    • Same category
    • Smaller (1.7B vs 4.1B)
    • Newer release
    vs
  21. arcee-ai logo

    Trinity-Nano-Base

    arcee-ai·Chat

    ≈4.6 GB

    Trinity Nano is an Arcee AI 6B MoE model with 1B active parameters. It is the small-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.

    6.1BA1B128K ctx openmdw-1.1
    1.9KDec 2025gguf
    • Same category
    • Similar size (6.1B vs 4.1B)
    • Commercial use OK
    vs
  22. nvidia logo

    Minitron-4B-Base

    nvidia·Chat

    ≈3.4 GB

    Minitron-4B-Base is a large language model (LLM) obtained by pruning Nemotron-4 15B; specifically, we prune model embedding size, number of attention heads, and MLP intermediate dimension.

    4B4K ctx NVIDIA Open Model License
    2.9KJul 2024gguf
    • Same category
    • Similar size (4B vs 4.1B)
    • Commercial use OK
    vs
  23. nvidia logo≈7.5 GB

    NVIDIA-Nemotron-Nano-9B-v2 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.

    8.9B128K ctx NVIDIA Open Model License
    122.4KAug 2025gguf
    • Same category
    • Larger (8.9B vs 4.1B)
    • Commercial use OK
    vs
  24. Dream-org logo

    Dream-v0-Instruct-7B

    Dream-org·Chat

    ≈5.5 GB

    This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:

    7.6B128K ctx Apache 2.0
    72.8KApr 2025gguf
    • Same category
    • Similar size (7.6B vs 4.1B)
    • Commercial use OK
    vs