selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Alternatives to lumi-4b

120 open-weight models that do the same job as lumi-4b (4B chat), ranked by how close they are in task and size, then by popularity and how recent they are. Licence and VRAM are shown for each.

the original
ceia-br logo

lumi-4b

ceia-br·Chat

≈4.2 GB

O Overall é a média aritmética simples dessas cinco métricas, com peso igual para cada uma. Nesse recorte, o Lumi-4B ocupa a 2ª posição entre 9 modelos.

4B256K ctx Unknown licence
4.1KOct 2026gguf
--vram
any
--gpus
--quant
  1. sbintuitions logo≈3.7 GB

    This repository provides Japanese language models trained by SB Intuitions.

    3.4B8K ctx MIT
    16KFeb 2025gguf
    • Same category
    • Similar size (3.4B vs 4B)
    • Commercial use OK
    vs
  2. ibm-granite logo

    granite-4.0-h-micro

    ibm-granite·Chat

    ≈3.0 GB

    📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

    3.2B128K ctx Apache 2.0
    5.1KSept 2025gguf
    • Same category
    • Similar size (3.2B vs 4B)
    • Commercial use OK
    vs
  3. ibm-research logo

    PowerMoE-3b

    ibm-research·Chat

    ≈2.8 GB

    PowerMoE-3b is an open-weight chat model with 3.4B parameters from ibm-research, published on Hugging Face.

    3.4BA958M4K ctx Apache 2.0
    55.4KAug 2024gguf
    • Same category
    • Similar size (3.4B vs 4B)
    • Commercial use OK
    vs
  4. ibm-granite logo

    granite-4.2-8b

    ibm-granite·Chat

    ≈7.0 GB

    Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.

    8.8B128K ctx Apache 2.0
    59.9KAug 2026ollama
    • Same category
    • Larger (8.8B vs 4B)
    • Commercial use OK
    vs
  5. Menlo logo

    Jan-nano-128k

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of Jan-Nano, this enhanced version features a native 128k context window that enables deeper, more comprehensive research capabilities without the performance…

    4B128K ctx Apache 2.0
    1.1KJun 2025gguf
    • Same category
    • Similar size (4B vs 4B)
    • Commercial use OK
    vs
  6. openbmb logo

    MiniCPM3-4B

    openbmb·Chat

    ≈10 GB

    MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

    4B32K ctx Apache 2.0
    10.1KSept 2024gguf
    • Same category
    • Similar size (4B vs 4B)
    • Commercial use OK
    vs
  7. janhq logo

    Jan-v1-4B

    janhq·Chat

    ≈4.0 GB

    Jan-v1 is the first release in the Jan Family, designed for agentic reasoning and problem-solving within the Jan App. Based on our Lucy model, Jan-v1 achieves improved performance through model scaling.

    4B256K ctx Apache 2.0
    738Aug 2025gguf
    • Same category
    • Similar size (4B vs 4B)
    • Commercial use OK
    vs
  8. Menlo logo

    Jan-nano

    Menlo·Chat

    ≈4.0 GB

    Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.

    4B40K ctx Apache 2.0
    1KJun 2025gguf
    • Same category
    • Similar size (4B vs 4B)
    • Commercial use OK
    vs
  9. allenai logo

    Olmo-3-1025-7B

    allenai·Chat

    ≈8.8 GB

    We introduce Olmo 3, a new family of 7B and 32B models. This suite includes Base, Instruct, and Think variants. The Base models were trained using a staged training approach.

    7.3B64K ctx Apache 2.0
    106.3KSept 2025gguf
    • Same category
    • Similar size (7.3B vs 4B)
    • Commercial use OK
    vs
  10. tencent logo

    Hunyuan-4B-Instruct

    tencent·Chat

    ≈4.1 GB

    Hunyuan is Tencent's open-source efficient large language model series, designed for versatile deployment across diverse computational environments.

    4.2B256K ctx Unknown licence
    987Jul 2025gguf
    • Same category
    • Similar size (4.2B vs 4B)
    vs
  11. ByteDance logo

    Ouro-2.6B

    ByteDance·Chat

    ≈5.1 GB

    Ouro-2.6B is a 2.6 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.

    2.7B64K ctx Apache 2.0
    10.3KOct 2025gguf
    • Same category
    • Similar size (2.7B vs 4B)
    • Commercial use OK
    vs
  12. CohereLabs logo

    tiny-aya-en-thinker

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya En-Thinker is an open-weights research release of a 3.35 billion parameter multilingual reasoning model.

    3.4BCC BY-NC 4.0
    124Sept 2026
    • Same category
    • Similar size (3.4B vs 4B)
    vs
  13. CohereLabs logo

    tiny-aya-water

    CohereLabs·Chat

    ≈3.1 GB

    Cohere Labs Tiny Aya is an open weights research release of a pretrained 3.35 billion parameter model optimized for efficient, strong, and balanced multilingual representation across 70+ languages, including many lower-resourced ones.

    3.3BCC BY-NC 4.0
    527Feb 2026gguf
    • Same category
    • Similar size (3.3B vs 4B)
    vs
  14. inclusionAI logo

    Ling-3.0-tiny

    inclusionAI·Chat

    ≈6.7 GB

    We are introducing Ling-3.0-tiny, a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token.

    7.9BA1.4B128K ctx MIT
    13.6KAug 2026gguf
    • Same category
    • Similar size (7.9B vs 4B)
    • Commercial use OK
    vs
  15. lightonai logo

    colgrep-agent-2B

    lightonai·Chat

    ≈2.3 GB

    ColGrep-Agent-2B is a lightweight code-localization agent designed to identify the files and line ranges relevant to a GitHub issue, bug report, feature request, or natural-language question about a repository.

    2.5B128K ctx Apache 2.0
    1.1KOct 2026gguf
    • Same category
    • Similar size (2.5B vs 4B)
    • Commercial use OK
    vs
  16. ibm-granite logo

    granite-4.1-8b

    ibm-granite·Chat

    ≈7.0 GB

    Model Summary: Granite-4.1-8B is a 8B parameter long-context instruct model finetuned from Granite-4.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets.

    8.8B128K ctx Apache 2.0
    82.2KApr 2026ollama
    • Same category
    • Larger (8.8B vs 4B)
    • Commercial use OK
    vs
  17. meta-llama logo

    Llama-3.1-8B-Instruct

    meta-llama·Chat

    ≈6.3 GB

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out).

    8B128K ctx Llama 3.1 Community License
    4.2MJul 2024ollama
    • Same category
    • Larger (8B vs 4B)
    • Widely used
    vs
  18. Qwen logo

    Qwen3-8B-Base

    Qwen·Chat

    ≈6.5 GB

    Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

    8.2B32K ctx Apache 2.0
    597.9KApr 2025gguf
    • Same category
    • Larger (8.2B vs 4B)
    • Commercial use OK
    vs
  19. tencent logo≈1.9 GB

    This checkpoint is a five-layer draft model for Qwen3.8-27B, with block size 16 and an 8,192-token sliding window.

    2B256K ctx Apache 2.0
    5.6KNov 2026gguf
    • Same category
    • Similar size (2B vs 4B)
    • Commercial use OK
    • Newer release
    vs
  20. arcee-ai logo

    AFM-4.5B-Base

    arcee-ai·Chat

    ≈3.8 GB

    AFM-4.5B-Base is a 4.5 billion parameter instruction-tuned model developed by Arcee.ai, designed for enterprise-grade performance across diverse deployment environments from cloud to edge.

    4.6B64K ctx Apache 2.0
    1.6KJul 2025gguf
    • Same category
    • Similar size (4.6B vs 4B)
    • Commercial use OK
    vs
  21. LiquidAI logo

    LFM2-2.6B-Longevity

    LiquidAI·Chat

    ≈2.5 GB

    Longevity-LLM (L-LLM) is a family of compact, domain-adapted language models for interpreting heterogeneous aging biology data. Longevity LFMs are available in two sizes:

    2.6B125K ctx lfm1.0
    2.1KMay 2026gguf
    • Same category
    • Similar size (2.6B vs 4B)
    vs
  22. swiss-ai logo≈6.3 GB

    Apertus is a 70B and 8B parameter language model designed to push the boundaries of fully-open multilingual and transparent models.

    8.1B64K ctx Apache 2.0
    204.9KAug 2025gguf
    • Same category
    • Larger (8.1B vs 4B)
    • Commercial use OK
    vs
  23. microsoft logo

    Sentiment-Analysis-7B

    microsoft·Chat

    ≈5.8 GB

    Sentiment-Analysis-7B is a 7B-parameter autoregressive language model fine-tuned for sentiment classification of user messages directed at a service, product, or agent (the "Target").

    7.2B32K ctx MIT
    3KOct 2026gguf
    • Same category
    • Similar size (7.2B vs 4B)
    • Commercial use OK
    vs
  24. IFM logo

    K2-Horizon-7B

    IFM·Chat

    ≈7.0 GB

    K2-Horizon-7B is the medium dense member of the K2-Horizon family: a 7B-core decoder-only model with a 512K context window.

    9B512K ctx Apache 2.0
    28.7KSept 2026gguf
    • Same category
    • Larger (9B vs 4B)
    • Commercial use OK
    vs