selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic

120 open-weight models that do the same job as DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic (9.4B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original

A compact 9B reasoning model distilled from DeepSeek-V4-Pro in Max Effect mode

9.4B256K ctx Apache 2.0
27KOct 2026gguf
--vram
any
--gpus
--quant
  1. openbmb logo

    BitCPM-CANN-8B

    openbmb·Chat

    ≈5.5 GB

    BitCPM-CANN is the first end-to-end 1.58-bit (ternary) large language model training system natively built on Huawei Ascend NPU.

    8B32K ctx Apache 2.0
    3KMay 2026gguf
    • Same category
    • Similar size (8B vs 9.4B)
    • Commercial use OK
    vs
  2. ibm-granite logo≈7.0 GB

    Model Summary: Granite-4.1-8B-LLMON-preview is an 8B-parameter instruct model fine-tuned from Granite-4.1-8B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

    8.8B128K ctx Apache 2.0
    428Oct 2026
    • Same category
    • Similar size (8.8B vs 9.4B)
    • Commercial use OK
    vs
  3. internlm logo

    internlm3-8b-instruct

    internlm·Chat

    ≈6.1 GB

    InternLM3 has open-sourced an 8-billion parameter instruction model, InternLM3-8B-Instruct, designed for general-purpose usage and advanced reasoning. This model has the following characteristics:

    8.8B32K ctx Apache 2.0
    45.9KJan 2025gguf
    • Same category
    • Similar size (8.8B vs 9.4B)
    • Commercial use OK
    vs
  4. meta-llama logo

    Llama-3.1-8B

    meta-llama·Chat

    ≈6.3 GB

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out).

    8B128K ctx Llama 3.1 Community License
    443.8KJul 2024gguf
    • Same category
    • Similar size (8B vs 9.4B)
    vs
  5. nvidia logo≈6.3 GB

    NVIDIA Nemotron-H-8B-Base-8K is a large language model (LLM) developed by NVIDIA that is designed as a completion model for a given piece of text. It uses a hybrid model architecture that consists primarily of Mamba-2 and MLP layers combined with just four Attention layers.

    8.1Bnvidia-internal-scientific-research-and-development-model-license
    58.6KMar 2025
    • Same category
    • Similar size (8.1B vs 9.4B)
    vs
  6. allenai logo

    Olmo-Hybrid-7B

    allenai·Chat

    ≈8.7 GB

    We expand on our Olmo model series by introducing Olmo Hybrid, a new 7B hybrid RNN model in the Olmo family. Olmo Hybrid dramatically outperforms Olmo 3 in final performance, consistently showing roughly 2x data efficiency on core evals over the course of our pretraining run.

    7.4B64K ctx Apache 2.0
    10.9KJan 2026
    • Same category
    • Similar size (7.4B vs 9.4B)
    • Commercial use OK
    vs
  7. ByteDance-Seed logo

    academic-ds-9B

    ByteDance-Seed·Chat

    ≈7.5 GB

    This is a 9B model whose architecture is deepseek-v3, trained from scratch using 350B+ tokens from fully open-source, English-only datasets. It is designed for development and debugging purposes within the open-source community.

    9.4BA1.6B8K ctx Apache 2.0
    12.7KApr 2025gguf
    • Same category
    • Similar size (9.4B vs 9.4B)
    • Commercial use OK
    vs
  8. google logo

    gemma-2-9b-it

    google·Chat

    ≈8.6 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    9.2B8K ctx Gemma Terms of Use
    130.7KJun 2024ollama
    • Same category
    • Similar size (9.2B vs 9.4B)
    vs
  9. K-intelligence logo

    Midm-2.0-Base-Instruct

    K-intelligence·Chat

    ≈8.8 GB

    Mi:dm 2.0 is a "Korea-centric AI" model developed using KT's proprietary technology. The term "Korea-centric AI" refers to a model that deeply internalizes the unique values, cognitive frameworks, and commonsense reasoning inherent to Korean society.

    11.5B32K ctx MIT
    39.6KJul 2025gguf
    • Same category
    • Similar size (11.5B vs 9.4B)
    • Commercial use OK
    vs
  10. tencent logo

    ContextPilot-8B

    tencent·Chat

    ≈6.5 GB

    ContextPilot-8B is the Qwen3-8B checkpoint of ContextPilot, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools.

    8.2B40K ctx Custom licence
    908Aug 2026gguf
    • Same category
    • Similar size (8.2B vs 9.4B)
    vs
  11. tokyotech-llm logo

    Qwen3-Swallow-8B-RL-v0.2

    tokyotech-llm·Chat

    ≈6.5 GB

    Qwen3-Swallow v0.2 is a family of large language models available in 8B, 30B-A3B, and 32B parameter sizes. Built as bilingual Japanese-English models, they were developed through Continual Pre-Training (CPT), Supervised Fine-Tuning (SFT), and Reinforcement Learning with Verifiable Rewards (RLVR)…

    8.2B40K ctx Apache 2.0
    4.7KJan 2026gguf
    • Same category
    • Similar size (8.2B vs 9.4B)
    • Commercial use OK
    vs
  12. ibm-granite logo≈7.5 GB

    Model Summary: Granite Switch 4.1 8B Preview is a modular LLM built on IBM Granite 4.1 8B with embedded adapters from the Granite Libraries collection.

    9.6B128K ctx Apache 2.0
    669May 2026
    • Same category
    • Similar size (9.6B vs 9.4B)
    • Commercial use OK
    vs
  13. NousResearch logo

    Hermes-3-Llama-3.1-8B

    NousResearch·Chat

    ≈6.3 GB

    Hermes 3 is the latest version of our flagship Hermes series of LLMs by Nous Research.

    8B128K ctx Llama 3 Community License
    336.5KJul 2024gguf
    • Same category
    • Similar size (8B vs 9.4B)
    vs
  14. Dream-org logo

    Dream-v0-Instruct-7B

    Dream-org·Chat

    ≈5.5 GB

    This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:

    7.6B128K ctx Apache 2.0
    72KApr 2025gguf
    • Same category
    • Similar size (7.6B vs 9.4B)
    • Commercial use OK
    vs
  15. openai logo

    gpt-oss-20b

    openai·Chat

    ≈13 GB

    Welcome to the gpt-oss series, OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases.

    20.9BA4.2B128K ctx Apache 2.0
    5.6MAug 2025ollama
    • Same category
    • Larger (20.9B vs 9.4B)
    • Commercial use OK
    • Widely used
    vs
  16. ibm-granite logo

    granite-3.2-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.2-8B-Instruct is an 8-billion-parameter, long-context AI model fine-tuned for thinking capabilities.

    8.2B128K ctx Apache 2.0
    51.7KFeb 2025ollama
    • Same category
    • Similar size (8.2B vs 9.4B)
    • Commercial use OK
    vs
  17. nvidia logo≈4.2 GB

    NVIDIA-Nemotron-3-Nano-4B-BF16 is a small language model (SLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.

    4B256K ctx nvidia-nemotron-open-model-license
    1.9MMar 2026gguf
    • Same category
    • Smaller (4B vs 9.4B)
    • Commercial use OK
    • Widely used
    vs
  18. empero-ai logo

    Qwen3.8-4B-Distill

    empero-ai·Chat

    ≈4.3 GB

    Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…

    4.7B256K ctx Apache 2.0
    112.4KAug 2026gguf
    • Same category
    • Smaller (4.7B vs 9.4B)
    • Commercial use OK
    vs
  19. nvidia logo≈6.5 GB

    Orchestrator-8B is a state-of-the-art 8B parameter orchestration model designed to solve complex, multi-turn agentic tasks by coordinating a diverse set of expert models and tools.

    8.2B40K ctx Unknown licence
    4.5KNov 2025gguf
    • Same category
    • Similar size (8.2B vs 9.4B)
    vs
  20. swiss-ai logo

    Apertus-8B-2509

    swiss-ai·Chat

    ≈6.3 GB

    Apertus is a 70B and 8B parameter language model designed to push the boundaries of fully-open multilingual and transparent models.

    8.1B64K ctx Apache 2.0
    10.1KSept 2025gguf
    • Same category
    • Similar size (8.1B vs 9.4B)
    • Commercial use OK
    vs
  21. allenai logo

    AstaBrief_8B

    allenai·Chat

    ≈6.4 GB

    AstaBrief-8B is a model trained to turn a research question and retrieved scientific literature excerpts into a cited report using only supervised fine-tuning and offline direct preference optimization.

    8B40K ctx Apache 2.0
    2.8KFeb 2026gguf
    • Same category
    • Similar size (8B vs 9.4B)
    • Commercial use OK
    vs
  22. EssentialAI logo

    rnj-1-instruct

    EssentialAI·Chat

    ≈6.4 GB

    Rnj-1 is a family of 8B parameter open-weight, dense models trained from scratch by Essential AI, optimized for code and STEM with capabilities on par with SOTA open-weight models.

    8.3B32K ctx Apache 2.0
    3.3KDec 2025ollama
    • Same category
    • Similar size (8.3B vs 9.4B)
    • Commercial use OK
    vs
  23. IlyaGusev logo

    saiga_llama3_8b

    IlyaGusev·Chat

    ≈6.3 GB

    I've changed the prompt format from ChatML to the original Llama-3 format in v4. Don't forget to switch formats!

    8B8K ctx Llama 3 Community License
    415.1KApr 2024gguf
    • Same category
    • Similar size (8B vs 9.4B)
    vs
  24. meta-llama logo

    Meta-Llama-3-8B-Instruct

    meta-llama·Chat

    ≈6.3 GB

    Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes.

    8B8K ctx Llama 3 Community License
    421.3KApr 2024ollama
    • Same category
    • Similar size (8B vs 9.4B)
    vs