selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to plamo-3-8b-fin-instruct

120 open-weight models that do the same job as plamo-3-8b-fin-instruct (8.5B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
pfnet logo≈6.1 GB

PLaMo-3-8B-Fin-Instruct is a Japanese language model for the financial domain, developed by Preferred Networks, Inc. It is fine-tuned from a PLaMo-3 base model through continued pre-training on financial corpora followed by supervised fine-tuning and direct preference optimization.

8.5B256K ctx plamo-community-license
983Nov 2026gguf
--vram
any
--gpus
--quant
  1. NousResearch logo

    Hermes-3-Llama-3.1-8B

    NousResearch·Chat

    ≈6.3 GB

    Hermes 3 is the latest version of our flagship Hermes series of LLMs by Nous Research.

    8B128K ctx Llama 3 Community License
    336.5KJul 2024gguf
    • Same category
    • Similar size (8B vs 8.5B)
    vs
  2. Dream-org logo

    Dream-v0-Instruct-7B

    Dream-org·Chat

    ≈5.5 GB

    This is the instruct model of Dream 7B, which is an open diffusion large language model with top-tier performance. More details about the model and usage can be found in the blog and github bellow:

    7.6B128K ctx Apache 2.0
    72KApr 2025gguf
    • Same category
    • Similar size (7.6B vs 8.5B)
    • Commercial use OK
    vs
  3. ibm-granite logo

    granite-3.2-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.2-8B-Instruct is an 8-billion-parameter, long-context AI model fine-tuned for thinking capabilities.

    8.2B128K ctx Apache 2.0
    51.7KFeb 2025ollama
    • Same category
    • Similar size (8.2B vs 8.5B)
    • Commercial use OK
    vs
  4. nvidia logo≈4.2 GB

    NVIDIA-Nemotron-3-Nano-4B-BF16 is a small language model (SLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response.

    4B256K ctx nvidia-nemotron-open-model-license
    1.9MMar 2026gguf
    • Same category
    • Smaller (4B vs 8.5B)
    • Commercial use OK
    • Widely used
    vs
  5. NVIDIA-Nemotron-Nano-9B-v2-Japanese is a large language model (LLM) trained from scratch by NVIDIA and designed as a unified model for both reasoning and non-reasoning tasks, specifically optimized for the Japanese language.

    8.9B128K ctx nvidia-nemotron-open-model-license
    3.2KFeb 2026gguf
    • Same category
    • Similar size (8.9B vs 8.5B)
    • Commercial use OK
    vs
  6. empero-ai logo

    Qwen3.8-4B-Distill

    empero-ai·Chat

    ≈4.3 GB

    Qwen3.8-4B is a full-parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5-4B architecture. The student was trained on ~45,000 curated teacher traces from our internal Qwen3.8 distillation datasets — dense chain-of-thought spanning mathematics, general reasoning, and instruction following…

    4.7B256K ctx Apache 2.0
    112.4KAug 2026gguf
    • Same category
    • Similar size (4.7B vs 8.5B)
    • Commercial use OK
    vs
  7. ibm-granite logo≈7.0 GB

    Model Summary: Granite-4.1-8B-LLMON-preview is an 8B-parameter instruct model fine-tuned from Granite-4.1-8B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

    8.8B128K ctx Apache 2.0
    428Oct 2026
    • Same category
    • Similar size (8.8B vs 8.5B)
    • Commercial use OK
    vs
  8. internlm logo

    internlm3-8b-instruct

    internlm·Chat

    ≈6.1 GB

    InternLM3 has open-sourced an 8-billion parameter instruction model, InternLM3-8B-Instruct, designed for general-purpose usage and advanced reasoning. This model has the following characteristics:

    8.8B32K ctx Apache 2.0
    45.9KJan 2025gguf
    • Same category
    • Similar size (8.8B vs 8.5B)
    • Commercial use OK
    vs
  9. nvidia logo≈6.5 GB

    Orchestrator-8B is a state-of-the-art 8B parameter orchestration model designed to solve complex, multi-turn agentic tasks by coordinating a diverse set of expert models and tools.

    8.2B40K ctx Unknown licence
    4.5KNov 2025gguf
    • Same category
    • Similar size (8.2B vs 8.5B)
    vs
  10. swiss-ai logo

    Apertus-8B-2509

    swiss-ai·Chat

    ≈6.3 GB

    Apertus is a 70B and 8B parameter language model designed to push the boundaries of fully-open multilingual and transparent models.

    8.1B64K ctx Apache 2.0
    10.1KSept 2025gguf
    • Same category
    • Similar size (8.1B vs 8.5B)
    • Commercial use OK
    vs
  11. allenai logo

    AstaBrief_8B

    allenai·Chat

    ≈6.4 GB

    AstaBrief-8B is a model trained to turn a research question and retrieved scientific literature excerpts into a cited report using only supervised fine-tuning and offline direct preference optimization.

    8B40K ctx Apache 2.0
    2.8KFeb 2026gguf
    • Same category
    • Similar size (8B vs 8.5B)
    • Commercial use OK
    vs
  12. google logo

    shieldgemma-9b

    google·Chat

    ≈8.6 GB

    ShieldGemma is a series of safety content moderation models built upon Gemma 2 that target four harm categories (sexually explicit, dangerous content, hate, and harassment).

    9.2B8K ctx Gemma Terms of Use
    257.4KJul 2024ollama
    • Same category
    • Similar size (9.2B vs 8.5B)
    vs
  13. openbmb logo

    MiniCPM-SALA

    openbmb·Chat

    ≈6.4 GB

    MiniCPM-SALA (Sparse Attention and Linear Attention) is the first large-scale hybrid model effectively integrating sparse and linear attention for million-token context modeling

    9.5B512K ctx Apache 2.0
    4KFeb 2026
    • Same category
    • Similar size (9.5B vs 8.5B)
    • Commercial use OK
    vs
  14. XiaomiMiMo logo

    MiMo-7B-RL

    XiaomiMiMo·Chat

    ≈6.3 GB

    Currently, most successful RL works, including open-source research, rely on relatively large base models, e.g., 32B models, particularly for enhancing code reasoning capabilities.

    7.8B32K ctx MIT
    30.6KApr 2025gguf
    • Same category
    • Similar size (7.8B vs 8.5B)
    • Commercial use OK
    vs
  15. EssentialAI logo

    rnj-1-instruct

    EssentialAI·Chat

    ≈6.4 GB

    Rnj-1 is a family of 8B parameter open-weight, dense models trained from scratch by Essential AI, optimized for code and STEM with capabilities on par with SOTA open-weight models.

    8.3B32K ctx Apache 2.0
    3.3KDec 2025ollama
    • Same category
    • Similar size (8.3B vs 8.5B)
    • Commercial use OK
    vs
  16. ibm-granite logo

    granite-4.0-h-tiny

    ibm-granite·Chat

    ≈5.2 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    6.9BA1.5B128K ctx Apache 2.0
    28.9KSept 2025gguf
    • Same category
    • Similar size (6.9B vs 8.5B)
    • Commercial use OK
    vs
  17. IlyaGusev logo

    saiga_llama3_8b

    IlyaGusev·Chat

    ≈6.3 GB

    I've changed the prompt format from ChatML to the original Llama-3 format in v4. Don't forget to switch formats!

    8B8K ctx Llama 3 Community License
    415.1KApr 2024gguf
    • Same category
    • Similar size (8B vs 8.5B)
    vs
  18. meta-llama logo

    Meta-Llama-3-8B-Instruct

    meta-llama·Chat

    ≈6.3 GB

    Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes.

    8B8K ctx Llama 3 Community License
    421.3KApr 2024ollama
    • Same category
    • Similar size (8B vs 8.5B)
    vs
  19. t-tech logo

    T-lite-it-2.1

    t-tech·Chat

    ≈6.5 GB

    T-lite-it-2.1 is an efficient Russian model built upon the Qwen 3 architecture, featuring significant improvements in instruction following and adds support for tool-calling capabilities — a key advancement over T-lite-it-1.0, which lacks tool-use support.

    8.2B40K ctx Apache 2.0
    3.1KDec 2025gguf
    • Same category
    • Similar size (8.2B vs 8.5B)
    • Commercial use OK
    vs
  20. empero-ai logo

    Qwythos-9B-v2

    empero-ai·Chat

    ≈7.2 GB

    The next iteration of Qwythos: all the reasoning of Qwythos-9B, with the looping behavior fixed. v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use.

    9.7B1M ctx Apache 2.0
    1.3KJul 2026gguf
    • Same category
    • Similar size (9.7B vs 8.5B)
    • Commercial use OK
    vs
  21. Unbabel logo

    Tower-Plus-9B

    Unbabel·Chat

    ≈8.6 GB

    Tower+ 9B is build on top of Gemma 2 9B. The model goes through the Continuous Pretraining (CPT), Instruction Tuning (IT), Weighted Preference Optimization (WPO). During all stages we include parallel and multilingual data (covering 22 languages).

    9.2B8K ctx CC BY-NC-SA 4.0
    19KJun 2025gguf
    • Same category
    • Similar size (9.2B vs 8.5B)
    vs
  22. openbmb logo

    AgentCPM-Report

    openbmb·Chat

    ≈5.6 GB

    This repository contains AgentCPM-Report, an 8B-parameter deep research agent introduced in the paper AgentCPM-Report: Interleaving Drafting and Deepening for Open-Ended Deep Research.

    8.2B64K ctx Apache 2.0
    2.2KJan 2026gguf
    • Same category
    • Similar size (8.2B vs 8.5B)
    • Commercial use OK
    vs
  23. openbmb logo

    MiniCPM4.1-8B

    openbmb·Chat

    ≈5.6 GB

    ✅ Strong Reasoning Capability: Surpasses similar-sized models on 15 tasks!

    8.2B64K ctx Apache 2.0
    6.2KSept 2025gguf
    • Same category
    • Similar size (8.2B vs 8.5B)
    • Commercial use OK
    vs
  24. zgcagi logo

    ZGCM-1-7B

    zgcagi·Chat

    ≈5.9 GB

    ZGCM-1 is a 7.39B-parameter dense language model trained from scratch, built for mathematical reasoning and tool-assisted search. It combines deliberate internal thinking with active information gathering, supporting 256K-token context and both thinking and direct-response modes in a single model.

    7.4B256K ctx MIT
    944Sept 2026gguf
    • Same category
    • Similar size (7.4B vs 8.5B)
    • Commercial use OK
    vs