selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to Raon-1-nano

120 open-weight models that do the same job as Raon-1-nano (3.5B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
KRAFTON logo

Raon-1-nano

KRAFTON·Chat

≈5.6 GB

Raon-1 nano is a dense language model with 1.5B effective parameters (3.1B total, including a 1.5B per-layer embedding table), developed by KRAFTON AI. It is designed to follow instructions, maintain conversational context, and call the right tools in both Korean and English.

3.5B256K ctx Apache 2.0
1.3KOct 2026gguf
--vram
any
--gpus
--quant
  1. tencent logo≈1.9 GB

    This checkpoint is a five-layer draft model for Qwen3.8-27B, with block size 16 and an 8,192-token sliding window.

    2B256K ctx Apache 2.0
    5.6KNov 2026gguf
    • Same category
    • Similar size (2B vs 3.5B)
    • Commercial use OK
    • Newer release
    vs
  2. LiquidAI logo

    LFM2-2.6B-Longevity

    LiquidAI·Chat

    ≈2.5 GB

    Longevity-LLM (L-LLM) is a family of compact, domain-adapted language models for interpreting heterogeneous aging biology data. Longevity LFMs are available in two sizes:

    2.6B125K ctx lfm1.0
    2.1KMay 2026gguf
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  3. ornith-ai logo

    Ornith-1.5-9B

    ornith-ai·Chat

    ≈7.2 GB

    Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.

    9.7B256K ctx MIT
    570.4KAug 2026ollama
    • Same category
    • Larger (9.7B vs 3.5B)
    • Commercial use OK
    vs
  4. tiiuae logo≈2.6 GB

    For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report.

    3.1B128K ctx Falcon LLM License
    6KMay 2025gguf
    • Same category
    • Similar size (3.1B vs 3.5B)
    vs
  5. ibm-granite logo

    granite-3.3-2b-instruct

    ibm-granite·Chat

    ≈2.6 GB

    Model Summary: Granite-3.3-2B-Instruct is a 2-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

    2.5B128K ctx Apache 2.0
    40.8KApr 2025ollama
    • Same category
    • Similar size (2.5B vs 3.5B)
    • Commercial use OK
    vs
  6. google logo

    gemma-2-2b-it

    google·Chat

    ≈2.9 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    2.6B8K ctx Gemma Terms of Use
    183.2KJul 2024ollama
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  7. arcee-ai logo

    AFM-4.5B

    arcee-ai·Chat

    ≈3.8 GB

    AFM-4.5B is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.

    4.6B64K ctx Apache 2.0
    7.1KJul 2025gguf
    • Same category
    • Similar size (4.6B vs 3.5B)
    • Commercial use OK
    vs
  8. LiquidAI logo

    LFM2-2.6B

    LiquidAI·Chat

    ≈2.5 GB

    LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

    2.6B125K ctx lfm1.0
    6.6KSept 2025gguf
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  9. tiiuae logo≈3.1 GB

    Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.

    3.2B32K ctx Falcon LLM License
    7.3KDec 2024ollama
    • Same category
    • Similar size (3.2B vs 3.5B)
    vs
  10. LiquidAI logo

    LFM3-1.7B-Base

    LiquidAI·Chat

    ≈1.9 GB

    LFM3-1.7B-Base is the pre-trained checkpoint behind LFM3-1.7B, a text model for local agents and specialized applications based on our new tri-hybrid architecture.

    1.7B256K ctx lfm1.0
    12KOct 2026ollama
    • Same category
    • Smaller (1.7B vs 3.5B)
    vs
  11. deepcogito logo≈3.5 GB

    The Cogito LLMs are instruction tuned generative models (text in/text out). All models are released under an open license for commercial use.

    3.6B128K ctx Llama 3.2 Community License
    1.6KMar 2025gguf
    • Same category
    • Similar size (3.6B vs 3.5B)
    vs
  12. janhq logo≈4.2 GB

    Jan-v3-4B-base-instruct is a 4B-parameter model obtained via post-training distillation from a larger teacher, transferring capabilities while preserving general-purpose performance on standard benchmarks.

    4.4B256K ctx Apache 2.0
    1.1KJan 2026gguf
    • Same category
    • Similar size (4.4B vs 3.5B)
    • Commercial use OK
    vs
  13. Qwen logo≈5.5 GB

    Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

    7.6B32K ctx Apache 2.0
    6.5MSept 2024ollama
    • Same category
    • Larger (7.6B vs 3.5B)
    • Commercial use OK
    • Widely used
    vs
  14. NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.

    8B64K ctx openmdw-1.1
    29.7KOct 2026gguf
    • Same category
    • Larger (8B vs 3.5B)
    • Commercial use OK
    vs
  15. Qwen logo

    Qwen3-1.7B-Base

    Qwen·Chat

    ≈2.4 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    1.7B32K ctx Apache 2.0
    618.8KApr 2025gguf
    • Same category
    • Smaller (1.7B vs 3.5B)
    • Commercial use OK
    vs
  16. allenai logo

    Olmo-3-7B-Instruct

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding.

    7.3B64K ctx Apache 2.0
    128.7KNov 2025ollama
    • Same category
    • Larger (7.3B vs 3.5B)
    • Commercial use OK
    vs
  17. ibm-granite logo

    granite-3.1-3b-a800m-base

    ibm-granite·Chat

    ≈3.0 GB

    Model Summary: Granite-3.1-3B-A800M-Base extends the context length of Granite-3.0-3B-A800M-Base from 4K to 128K using a progressive training strategy by increasing the supported context length in increments while adjusting RoPE theta until the model has successfully adapted to desired length of…

    3.3BA800M128K ctx Apache 2.0
    4.5KDec 2024gguf
    • Same category
    • Similar size (3.3B vs 3.5B)
    • Commercial use OK
    vs
  18. ibm-granite logo

    granite-4.0-h-micro-base

    ibm-granite·Chat

    ≈3.0 GB

    Model Summary: Granite-4.0-H-Micro-Base is a decoder-only, long-context language model designed for a wide range of text-to-text generation tasks. It also supports Fill-in-the-Middle (FIM) code completion through the use of specialized prefix and suffix tokens.

    3.2B128K ctx Apache 2.0
    696Sept 2025gguf
    • Same category
    • Similar size (3.2B vs 3.5B)
    • Commercial use OK
    vs
  19. LiquidAI logo

    LFM2-2.6B-Exp

    LiquidAI·Chat

    ≈2.5 GB

    LFM2-2.6B-Exp is an experimental checkpoint built on LFM2-2.6B using pure reinforcement learning.

    2.6B125K ctx lfm1.0
    2.4KDec 2025gguf
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  20. LGAI-EXAONE logo

    EXAONE-3.5-2.4B-Instruct

    LGAI-EXAONE·Chat

    ≈2.5 GB

    We introduce EXAONE 3.5, a collection of instruction-tuned bilingual (English and Korean) generative models ranging from 2.4B to 32B parameters, developed and released by LG AI Research.

    2.4B32K ctx exaone
    70.8KDec 2024ollama
    • Same category
    • Similar size (2.4B vs 3.5B)
    vs
  21. nvidia logo≈4.2 GB

    Llama-3.1-Nemotron-Nano-4B-v1.1 is a large language model (LLM) which is a derivative of nvidia/Llama-3.1-Minitron-4B-Width-Base, which is created from Llama 3.1 8B using our LLM compression technique and offers improvements in model accuracy and efficiency.

    4.5B128K ctx NVIDIA Open Model License
    6.6KMay 2025gguf
    • Same category
    • Similar size (4.5B vs 3.5B)
    • Commercial use OK
    vs
  22. google logo

    gemma-2-2b

    google·Chat

    ≈2.9 GB

    Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.

    2.6B8K ctx Gemma Terms of Use
    80.1KJul 2024gguf
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  23. google logo

    txgemma-2b-predict

    google·Chat

    ≈2.6 GB

    TxGemma is a collection of lightweight, state-of-the-art, open language models built upon Gemma 2, fine-tuned for therapeutic development. It comes in 3 sizes, 2B, 9B, and 27B.

    2.6Bhealth-ai-developer-foundations
    12.2KMar 2025gguf
    • Same category
    • Similar size (2.6B vs 3.5B)
    vs
  24. NousResearch logo

    Hermes-3-Llama-3.2-3B

    NousResearch·Chat

    ≈3.3 GB

    Hermes 3 3B is a small but mighty new addition to the Hermes series of LLMs by Nous Research, and is Nous's first fine-tune in this parameter class.

    3.2B128K ctx Llama 3 Community License
    4.5KDec 2024gguf
    • Same category
    • Similar size (3.2B vs 3.5B)
    vs