selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to UserLM-2.0

120 open-weight models that do the same job as UserLM-2.0 (8B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
microsoft logo

UserLM-2.0

microsoft·Chat

≈6.3 GB

UserLM-2.0 is an 8-billion-parameter user simulator for user-AI conversations. Unlike typical language models trained to play the assistant, UserLM-2.0 generates the user side of a conversation. It is conditioned on a task intent that describes the user's high-level objective.

8B128K ctx MIT
1.1KOct 2026gguf
--vram
any
--gpus
--quant
  1. Qwen logo≈4.0 GB

    We introduce the updated version of the Qwen3-4B non-thinking mode, named Qwen3-4B-Instruct-2507, featuring the following key enhancements:

    4B256K ctx Apache 2.0
    2.7MAug 2025gguf
    • Same category
    • Similar size (4B vs 8B)
    • Commercial use OK
    • Widely used
    vs
  2. mistralai logo≈5.8 GB

    The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.

    7.2B32K ctx Apache 2.0
    1.2MDec 2023ollama
    • Same category
    • Similar size (7.2B vs 8B)
    • Commercial use OK
    vs
  3. NVIDIA-Nemotron-Nano-9B-v2-Japanese is a large language model (LLM) trained from scratch by NVIDIA and designed as a unified model for both reasoning and non-reasoning tasks, specifically optimized for the Japanese language.

    8.9B128K ctx nvidia-nemotron-open-model-license
    3.2KFeb 2026gguf
    • Same category
    • Similar size (8.9B vs 8B)
    • Commercial use OK
    vs
  4. ibm-granite logo≈7.0 GB

    Model Summary: Granite-4.1-8B-LLMON-preview is an 8B-parameter instruct model fine-tuned from Granite-4.1-8B-base to consume prompts in LLMON (LLM Object Notation) instead of a conventional chat template.

    8.8B128K ctx Apache 2.0
    428Oct 2026
    • Same category
    • Similar size (8.8B vs 8B)
    • Commercial use OK
    vs
  5. ibm-granite logo

    granite-3.1-8b-instruct

    ibm-granite·Chat

    ≈6.6 GB

    Model Summary: Granite-3.1-8B-Instruct is a 8B parameter long-context instruct model finetuned from Granite-3.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems.

    8.2B128K ctx Apache 2.0
    33.6KDec 2024gguf
    • Same category
    • Similar size (8.2B vs 8B)
    • Commercial use OK
    vs
  6. IFM logo≈4.6 GB

    K2-Horizon-3.7B is the small dense member of the K2-Horizon family: a 3.7B-core decoder-only model with a 512K context window.

    5.1B512K ctx Apache 2.0
    15.2KSept 2026gguf
    • Same category
    • Similar size (5.1B vs 8B)
    • Commercial use OK
    vs
  7. microsoft logo

    UserLM-8b

    microsoft·Chat

    ≈6.3 GB

    Unlike typical LLMs that are trained to play the role of the "assistant" in conversation, we trained UserLM-8b to simulate the “user” role in conversation (by training it to predict user turns in a large corpus of conversations called WildChat).

    8B8K ctx MIT
    2.8KSept 2025gguf
    • Same category
    • Similar size (8B vs 8B)
    • Commercial use OK
    vs
  8. stepfun-ai logo

    PaCoRe-8B

    stepfun-ai·Chat

    ≈6.5 GB

    We introduce PaCoRe (Parallel Coordinated Reasoning), a framework that shifts the driver of inference from sequential depth to coordinated parallel breadth, breaking the model context limitation and massively scaling test time compute: Think in Parallel: PaCoRe launches massive parallel exploration…

    8.2B320K ctx MIT
    2.1KDec 2025gguf
    • Same category
    • Similar size (8.2B vs 8B)
    • Commercial use OK
    vs
  9. tokyotech-llm logo≈6.3 GB

    Llama 3.1 Swallow is a series of large language models (8B, 70B) that were built by continual pre-training on the Meta Llama 3.1 models. Llama 3.1 Swallow enhanced the Japanese language capabilities of the original Llama 3.1 while retaining the English language capabilities.

    8B128K ctx Llama 3.3 Community License
    6.9KJun 2025gguf
    • Same category
    • Similar size (8B vs 8B)
    vs
  10. internlm logo

    internlm3-8b-instruct

    internlm·Chat

    ≈6.1 GB

    InternLM3 has open-sourced an 8-billion parameter instruction model, InternLM3-8B-Instruct, designed for general-purpose usage and advanced reasoning. This model has the following characteristics:

    8.8B32K ctx Apache 2.0
    45.9KJan 2025gguf
    • Same category
    • Similar size (8.8B vs 8B)
    • Commercial use OK
    vs
  11. openbmb logo

    MiniCPM4-8B

    openbmb·Chat

    ≈5.6 GB

    MiniCPM4 series are highly efficient large language models (LLMs) designed explicitly for end-side devices, which achieves this efficiency through systematic innovation in four key dimensions: model architecture, training data, training algorithms, and inference systems.

    8.2B32K ctx Apache 2.0
    8.1KJun 2025gguf
    • Same category
    • Similar size (8.2B vs 8B)
    • Commercial use OK
    vs
  12. openbmb logo

    MiniCPM4-MCP

    openbmb·Chat

    ≈5.6 GB

    MiniCPM4 series are highly efficient large language models (LLMs) designed explicitly for end-side devices, which achieves this efficiency through systematic innovation in four key dimensions: model architecture, training data, training algorithms, and inference systems.

    8.2B32K ctx Apache 2.0
    8.1KJun 2025gguf
    • Same category
    • Similar size (8.2B vs 8B)
    • Commercial use OK
    vs
  13. allenai logo≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    4KNov 2025gguf
    • Same category
    • Similar size (7.3B vs 8B)
    • Commercial use OK
    vs
  14. google logo

    shieldgemma-9b

    google·Chat

    ≈8.6 GB

    ShieldGemma is a series of safety content moderation models built upon Gemma 2 that target four harm categories (sexually explicit, dangerous content, hate, and harassment).

    9.2B8K ctx Gemma Terms of Use
    257.4KJul 2024ollama
    • Same category
    • Similar size (9.2B vs 8B)
    vs
  15. openbmb logo

    MiniCPM-SALA

    openbmb·Chat

    ≈6.4 GB

    MiniCPM-SALA (Sparse Attention and Linear Attention) is the first large-scale hybrid model effectively integrating sparse and linear attention for million-token context modeling

    9.5B512K ctx Apache 2.0
    4KFeb 2026
    • Same category
    • Similar size (9.5B vs 8B)
    • Commercial use OK
    vs
  16. Nanbeige logo

    Nanbeige4.2-3B

    Nanbeige·Chat

    ≈3.7 GB

    Nanbeige4.2-3B is a compact agentic model built on Nanbeige4.2-3B-Base, designed to combine strong agentic behavior with broad reasoning and alignment capabilities. Its Looped Transformer architecture reuses the transformer layers to increase model capacity without adding parameters.

    4.2B256K ctx Apache 2.0
    89.1KJul 2026gguf
    • Same category
    • Similar size (4.2B vs 8B)
    • Commercial use OK
    vs
  17. tiiuae logo

    Falcon-H1R-7B

    tiiuae·Chat

    ≈5.3 GB

    This repository presents Falcon-H1R-7B, a reasoning-specialized model introduced in the paper Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling.

    7.6B256K ctx Falcon LLM License
    3.2KOct 2025gguf
    • Same category
    • Similar size (7.6B vs 8B)
    vs
  18. Unbabel logo

    Tower-Plus-9B

    Unbabel·Chat

    ≈8.6 GB

    Tower+ 9B is build on top of Gemma 2 9B. The model goes through the Continuous Pretraining (CPT), Instruction Tuning (IT), Weighted Preference Optimization (WPO). During all stages we include parallel and multilingual data (covering 22 languages).

    9.2B8K ctx CC BY-NC-SA 4.0
    19KJun 2025gguf
    • Same category
    • Similar size (9.2B vs 8B)
    vs
  19. allenai logo

    wildguard

    allenai·Chat

    ≈5.8 GB

    WildGuard is an open one-stop moderation model that achieves three goals: 1) Detection of harm in users prompts. 2) Detection of harm in LLMs responses. 3) Refusal evaluation of LLMs responses.

    7.2BApache 2.0
    190.7KJun 2024
    • Same category
    • Similar size (7.2B vs 8B)
    • Commercial use OK
    vs
  20. empero-ai logo

    Qwythos-9B-v2

    empero-ai·Chat

    ≈7.2 GB

    The next iteration of Qwythos: all the reasoning of Qwythos-9B, with the looping behavior fixed. v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use.

    9.7B1M ctx Apache 2.0
    1.3KJul 2026gguf
    • Same category
    • Similar size (9.7B vs 8B)
    • Commercial use OK
    vs
  21. nvidia logo≈6.3 GB

    Llama-3.1-Nemotron-Nano-8B-v1 is a large language model (LLM) which is a derivative of Meta Llama-3.1-8B-Instruct (AKA the reference model). It is a reasoning model that is post trained for reasoning, human chat preferences, and tasks, such as RAG and tool calling.

    8B128K ctx NVIDIA Open Model License
    9.8KMar 2025gguf
    • Same category
    • Similar size (8B vs 8B)
    • Commercial use OK
    vs
  22. allenai logo≈6.8 GB

    Upon the initial release of OLMo-2 models, we realized the post-trained models did not share the pre-tokenization logic that the base models use. As a result, we have trained new post-trained models.

    7.3B4K ctx Apache 2.0
    42.2KDec 2024ollama
    • Same category
    • Similar size (7.3B vs 8B)
    • Commercial use OK
    vs
  23. CohereLabs logo

    aya-expanse-8b

    CohereLabs·Chat

    ≈6.3 GB

    Aya Expanse 8B is an open-weight research release of a model with highly advanced multilingual capabilities. It focuses on pairing a highly performant pre-trained Command family of models with the result of a year’s dedicated research from Cohere Labs, including data arbitrage, multilingual…

    8BCC BY-NC 4.0
    25.4KOct 2024ollama
    • Same category
    • Similar size (8B vs 8B)
    vs
  24. allenai logo≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    2.4KDec 2025gguf
    • Same category
    • Similar size (7.3B vs 8B)
    • Commercial use OK
    vs