selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

lemonade logo

Self-host lemonade

v2026.45.3

Local AI server for chat, images, and speech on GPU/NPU

ReleaseOpen SourceApache-2.0
sudo dnf install ./lemonade-server-*-fc43.x86_64.rpm
Updated4 days ago
LanguageC++
Setup difficultyEasy
MobileNative app
Stars
6 157
Port
13305 (HTTP server (API and web GUI))
Docker
ghcr.io/lemonade-sdk/lemonade-server
Model Manager screen for browsing and downloading models

What is lemonade?

Lemonade is an open-source local AI server that aims to provide cloud-API capabilities for free and privately, running chat, coding, speech, and image-generation models on a PC's own NPU and GPU. It ships in two flavors: Lemonade Server, a service exposing OpenAI-, Anthropic-, and Ollama-compatible endpoints plus an MCP gateway, and an embeddable portable binary developers can bundle into their own apps. A CLI and a built-in app (GUI) cover chat, image generation, speech generation, and transcription, and a Model Manager downloads GGUF, FLM, and ONNX models from Hugging Face or ModelScope. Inference is auto-configured across engines such as llama.cpp, whisper.cpp, vLLM, ONNX Runtime, and FastFlowLM, targeting AMD NPUs and GPUs, Apple Silicon, NVIDIA, and plain CPUs. Installers exist for Windows (MSI), Debian, Fedora, Ubuntu, Arch, Snap, and macOS, alongside a GHCR container image; cloud offload can additionally route requests to OpenAI-compatible providers. The project is a community effort with optimizations contributed by AMD engineers, and cloud routing is still marked experimental.

lemonade alternatives

Should you self-host lemonade?

lemonade scores 71/100 on selfhost.directory (how scoring works) and ranks #8 of 25 in LLM Inference. It has 6 157 GitHub stars, +325 in the last 30 days.

It shipped 41 stable releases in the past year. The latest, pr-3930, came out on 8 November 2026. New versions land roughly every 6 days.

Setup is easy: most people get it running in one sitting. An official Docker image is available. It is Apache-2.0-licensed and written mostly in C++.

Its closest alternative on selfhost.directory is Ollama (95/100, 186 429 stars). It scores higher overall, so compare the two before you pick. See lemonade vs Ollama side by side.

Features

  • API Key AuthenticationUnset by default; endpoints are unauthenticated unless keys are set.
  • CLI
  • Cloud offload routingMarked experimental by the project.
  • Embeddable SDK binary
  • GPU/NPU/CPU backend auto-selection
  • MCP server gateway
  • Model aliases with failover
  • Model manager and downloader
  • Multi-modal local inference
  • OpenAI Compatible API
  • OpenTelemetry tracing
  • Performance stats endpoint
  • Web and desktop GUI

lemonade README

How to install lemonade

Install lemonade with Docker

Environment variables
LEMONADE_API_KEY
docker run -d \
  --name lemonade-server \
  -p 13305:13305 \
  -v lemonade-cache:/opt/lemonade/.cache/huggingface \
  -v lemonade-llama:/opt/lemonade/llama \
  -v lemonade-data:/opt/lemonade/.cache/lemonade \
  -v lemonade-config:/opt/lemonade/.config/lemonade \
  ghcr.io/lemonade-sdk/lemonade-server:latest

The published API is unauthenticated by default; publish to host loopback only (-p 127.0.0.1:13305:13305) and/or set LEMONADE_API_KEY.

How to configure lemonade

  • port13305Port number for the HTTP server

    values: int

  • host"localhost"Address to bind for connections

    values: string

  • log_level"info"Logging level (trace, debug, info, warning, error, fatal, none)

    values: string

  • global_timeout600Timeout in seconds for HTTP, inference, and readiness checks

    values: int

  • max_loaded_models1Max models per type slot. Use -1 for unlimited

    values: int

lemonade releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

FAQ

Can TTS voices be mixed?

Yes, two voices can be mixed using a format like `af_jessica.5+af_kore.4`.

What voices are supported for TTS?

Most of the Kokoro-82M voices list; OpenAI voices come from a default picker and other voices can be typed manually.

How do I use my own llama.cpp or whisper.cpp binaries?

Set environment variables pointing to the full path of your custom llama-server or whisper-server binary instead of the bundled ones.

How do I run Lemonade Server on one PC and access it from another?

Lemonade supports running the server on one machine while using the app from another on the same network; see the Remote Server Connection configuration docs.

Does Lemonade work on older AMD processors or non-Ryzen AI systems?

Yes; it supports Vulkan GPU acceleration on various AMD chips, Radeon GPUs, any x86 CPU, and CPU inference on Intel/NVIDIA systems with GPU support via llama.cpp + Vulkan.

Does LLM inference with the NPU only work on Windows?

On Linux, NPU-only inference is available via FastFlowLM, while Ryzen AI SW's NPU and hybrid inference is currently Windows-only.

Can Lemonade print out stats like tokens per second?

Yes, the /stats endpoint returns performance metrics from the most recent completion request; debug logging and `lemonade logs` are also available.

What's the difference between GGUF and ONNX models?

GGUF works with the llama.cpp backend on CPU and GPU (Vulkan or ROCm), while ONNX runs on OnnxRuntime GenAI and supports NPU and NPU+iGPU hybrid execution.

What models are supported?

A wide range of LLMs including LLaMA, DeepSeek, Qwen, Gemma, Phi and gpt-oss; most GGUF models can also be added by users through the Model Manager or the pull command.

Where are models stored and how do I change that?

Models go to the Hugging Face cache at ~/.cache/huggingface/hub by default, changeable via HF_HOME or HF_HUB_CACHE; a secondary GGUF directory can be scanned with extra_models_dir, and FastFlowLM keeps its models at FLM_MODEL_PATH.

Is Linux supported? What about macOS?

Yes, both are supported. macOS gets a .pkg installer for Apple Silicon using the llama.cpp backend with Metal acceleration.

Which devices are supported?

The Supported Configurations section of the README gives a CPU/GPU/NPU support matrix; NPU details are covered in the hybrid/NPU questions.

How do I install Lemonade SDK or Server?

Follow the installation guide and pick the options that apply to you.

What is Lemonade and what does it include?

An open-source local LLM solution with one-click installers, auto-configured inference engines, an app for setting up and testing LLMs, and LLMs exposed through the OpenAI API standard.

More in LLM Inference

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…