selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Cola2

120 open-weight models that do the same job as Cola2 (8.8B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ByteDance-Seed logo

Cola2

ByteDance-Seed·Chat

≈6.8 GB

Cola2 is a continuous-latent language model that co-adapts semantic compression and discrete text generation. It combines a dynamic-compression VAE, a block-causal Diffusion Transformer (DiT), and a span-causal token decoder with latent feedback.

8.8B32K ctx Unknown licence
1.4KNov 2026
--vram
any
--gpus
--quant
  1. nvidia logo≈6.5 GB

    We're excited to introduce Nemotron-Cascade-8B, a powerful general-purpose model trained through sequential and domain-wise reinforcement learning. Nemotron-Cascade-8B is post-trained from the Qwen3-8B-Base model.

    8.2B32K ctx NVIDIA Open Model License
    1.1KDec 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  2. tiiuae logo

    Falcon-H1R-7B

    tiiuae·Chat

    ≈5.3 GB

    This repository presents Falcon-H1R-7B, a reasoning-specialized model introduced in the paper Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling.

    7.6B256K ctx Falcon LLM License
    3.2KOct 2025gguf
    • Same category
    • Similar size (7.6B vs 8.8B)
    vs
  3. Nanbeige logo

    Nanbeige4.2-3B

    Nanbeige·Chat

    ≈3.7 GB

    Nanbeige4.2-3B is a compact agentic model built on Nanbeige4.2-3B-Base, designed to combine strong agentic behavior with broad reasoning and alignment capabilities. Its Looped Transformer architecture reuses the transformer layers to increase model capacity without adding parameters.

    4.2B256K ctx Apache 2.0
    89.1KJul 2026gguf
    • Same category
    • Smaller (4.2B vs 8.8B)
    • Commercial use OK
    vs
  4. nvidia logo≈6.3 GB

    Llama-3.1-Nemotron-Nano-8B-v1 is a large language model (LLM) which is a derivative of Meta Llama-3.1-8B-Instruct (AKA the reference model). It is a reasoning model that is post trained for reasoning, human chat preferences, and tasks, such as RAG and tool calling.

    8B128K ctx NVIDIA Open Model License
    9.8KMar 2025gguf
    • Same category
    • Similar size (8B vs 8.8B)
    • Commercial use OK
    vs
  5. allenai logo≈6.8 GB

    Upon the initial release of OLMo-2 models, we realized the post-trained models did not share the pre-tokenization logic that the base models use. As a result, we have trained new post-trained models.

    7.3B4K ctx Apache 2.0
    42.2KDec 2024ollama
    • Same category
    • Similar size (7.3B vs 8.8B)
    • Commercial use OK
    vs
  6. allenai logo

    wildguard

    allenai·Chat

    ≈5.8 GB

    WildGuard is an open one-stop moderation model that achieves three goals: 1) Detection of harm in users prompts. 2) Detection of harm in LLMs responses. 3) Refusal evaluation of LLMs responses.

    7.2BApache 2.0
    190.7KJun 2024
    • Same category
    • Similar size (7.2B vs 8.8B)
    • Commercial use OK
    vs
  7. CohereLabs logo

    aya-expanse-8b

    CohereLabs·Chat

    ≈6.3 GB

    Aya Expanse 8B is an open-weight research release of a model with highly advanced multilingual capabilities. It focuses on pairing a highly performant pre-trained Command family of models with the result of a year’s dedicated research from Cohere Labs, including data arbitrage, multilingual…

    8BCC BY-NC 4.0
    25.4KOct 2024ollama
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  8. ibm-granite logo

    granite-guardian-3.3-8b

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite Guardian 3.3 8b is a specialized Granite 3.3 8B model designed to judge if the input prompts and the output responses of an LLM based system meet specified criteria.

    8.2B128K ctx Apache 2.0
    4.1KJun 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  9. Qwen logo

    Qwen3-4B

    Qwen·Chat

    ≈4.0 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    4B40K ctx Apache 2.0
    3.1MApr 2025ollama
    • Same category
    • Smaller (4B vs 8.8B)
    • Commercial use OK
    • Widely used
    vs
  10. tencent logo

    Hunyuan-7B-Instruct

    tencent·Chat

    ≈6.0 GB

    Hunyuan is Tencent's open-source efficient large language model series, designed for versatile deployment across diverse computational environments.

    7.5B32K ctx Unknown licence
    5.4KJul 2025gguf
    • Same category
    • Similar size (7.5B vs 8.8B)
    vs
  11. speakleash logo

    Bielik-11B-v3.1-Instruct

    speakleash·Chat

    ≈8.3 GB

    Bielik-11B-v3.1-Instruct is a generative text model featuring 11 billion parameters. It is an update to the Bielik 11B v3 line that expands multilingual continual pre-training and strengthens post-training for instruction following, tool use, and reasoning.

    11.2B32K ctx Apache 2.0
    377Oct 2026gguf
    • Same category
    • Similar size (11.2B vs 8.8B)
    • Commercial use OK
    vs
  12. allenai logo≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    2.4KDec 2025gguf
    • Same category
    • Similar size (7.3B vs 8.8B)
    • Commercial use OK
    vs
  13. EssentialAI logo

    rnj-1

    EssentialAI·Chat

    ≈6.4 GB

    Rnj-1 is a family of 8B parameter open-weight, dense models trained from scratch by Essential AI, optimized for code and STEM with capabilities on par with SOTA open-weight models.

    8.3B32K ctx Apache 2.0
    884Nov 2025gguf
    • Same category
    • Similar size (8.3B vs 8.8B)
    • Commercial use OK
    vs
  14. meta-llama logo

    Meta-Llama-3-8B

    meta-llama·Chat

    ≈6.3 GB

    Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes.

    8B8K ctx Llama 3 Community License
    101.3KApr 2024gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  15. BSC-LT logo≈6.1 GB

    This repository contains the model described in Salamandra Technical Report.

    7.8B8K ctx Apache 2.0
    33.7KSept 2024gguf
    • Same category
    • Similar size (7.8B vs 8.8B)
    • Commercial use OK
    vs
  16. meta-llama logo

    Llama-Guard-3-8B

    meta-llama·Chat

    ≈6.3 GB

    Llama Guard 3 is a Llama-3.1-8B pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification).

    8BLlama 3.1 Community License
    42.1KJul 2024ollama
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  17. tencent logo

    HiLS-Attention-7B

    tencent·Chat

    ≈8.8 GB

    HiLS-Attention is a chunk-wise sparse attention mechanism that learns chunk selection end-to-end under the language-modeling loss, enabling native sparse training for efficient long-context modeling. This repository hosts the 7B checkpoint continued-trained on top of an OLMo3-style backbone.

    7.3B128K ctx Apache 2.0
    416Jul 2026
    • Same category
    • Similar size (7.3B vs 8.8B)
    • Commercial use OK
    vs
  18. tencent logo

    WeDLM-8B-Instruct

    tencent·Chat

    ≈6.5 GB

    WeDLM-8B-Instruct is our flagship instruction-tuned diffusion language model that performs parallel decoding under standard causal attention, fine-tuned from WeDLM-8B.

    8.2B16K ctx Apache 2.0
    657Dec 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  19. utter-project logo

    EuroLLM-9B-Instruct

    utter-project·Chat

    ≈7.0 GB

    This is the model card for EuroLLM-9B-Instruct. You can also check the pre-trained version: EuroLLM-9B.

    9.2BApache 2.0
    11.1KNov 2024gguf
    • Same category
    • Similar size (9.2B vs 8.8B)
    • Commercial use OK
    vs
  20. NousResearch logo

    Meta-Llama-3.1-8B

    NousResearch·Chat

    ≈6.3 GB

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out).

    8B128K ctx Llama 3.1 Community License
    38.1KJul 2024gguf
    • Same category
    • Similar size (8B vs 8.8B)
    vs
  21. allenai logo≈5.1 GB

    OLMoE-1B-7B-0125-Instruct January 2025 is post-trained variant of the OLMoE-1B-7B January 2025 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset and further DPO training on this dataset, and finally RLVR training using this data.

    6.9BA1.3B4K ctx Apache 2.0
    32.7KJan 2025gguf
    • Same category
    • Similar size (6.9B vs 8.8B)
    • Commercial use OK
    vs
  22. ibm-granite logo

    granite-3.3-8b-base

    ibm-granite·Chat

    ≈6.6 GB

    Granite-3.3-8B-Base is a decoder-only language model with a 128K token context window. It improves upon Granite-3.1-8B-Base by adding support for Fill-in-the-Middle (FIM) using specialized tokens, enabling the model to generate content conditioned on both prefix and suffix.

    8.2B128K ctx Apache 2.0
    4.5KApr 2025gguf
    • Same category
    • Similar size (8.2B vs 8.8B)
    • Commercial use OK
    vs
  23. nvidia logo≈9.8 GB

    Nemotron-Labs-Diffusion is a tri-mode language model that supports both AR decoding and diffusion-based parallel decoding by simply switching the attention pattern of the same model during inference.

    13.5B256K ctx nvidia-nemotron-open-model-license
    6.5KApr 2026gguf
    • Same category
    • Similar size (13.5B vs 8.8B)
    • Commercial use OK
    vs
  24. XHToken logo

    Spark-X2.6-4B

    XHToken·Chat

    ≈4.1 GB

    A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward.

    4.1B1M ctx Apache 2.0
    30.8KOct 2026gguf
    • Same category
    • Smaller (4.1B vs 8.8B)
    • Commercial use OK
    vs