selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

LocalAI logo

Self-host LocalAI

v4.12.1

Open-source AI engine for running any model on any hardware

ReleaseOpen SourceMIT
Updated3 weeks ago
LanguageGo
Setup difficultyModerate
Stars
50 378
Docker
localai/localai

What is LocalAI?

LocalAI is an open-source AI runtime for running models locally on your own hardware. It supports language models, vision, voice, image, and video generation without requiring a GPU. The software exposes OpenAI-, Anthropic-, and ElevenLabs-compatible APIs so existing clients work with just a URL change. A small core pulls inference backends like llama.cpp, vLLM, whisper.cpp, and stable-diffusion on demand as separate container images. It runs on CPU-only, NVIDIA CUDA, AMD ROCm, Intel oneAPI, Apple Metal, Vulkan, and NVIDIA Jetson. Key features include built-in agents with tool use and RAG, realtime voice over WebRTC, distributed cluster mode with VRAM-aware routing, multi-user authentication with API keys and OIDC, per-user quotas, and a built-in web UI. You can install it via Docker, Podman, macOS DMG, Linux binaries, Kubernetes/Helm, or build from source.

Should you self-host LocalAI?

LocalAI scores 82/100 on selfhost.directory (how scoring works) and ranks #11 of 123 in AI. It has 50 378 GitHub stars, +900 in the last 30 days.

It shipped 31 stable releases in the past year. The latest, v4.12.1, came out on 23 October 2026. New versions land roughly every 1 days.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is MIT-licensed and written mostly in Go.

Its closest alternative on selfhost.directory is openclaw (93/100, 394 525 stars). It scores higher overall, so compare the two before you pick. See LocalAI vs openclaw side by side.

LocalAI README

LocalAI: your own AI, on your own hardware. Agents, documents and every kind of model, for you and your team. The LocalAI llama mascot wears sunglasses.

Latest release MIT license Join the LocalAI Discord

Documentation | Quick start | Models | Discord | FAQ | Blog

LocalAI is your own AI, on your own hardware, ready to work for you. It is open source. Chat with open models, run agents that use your files, and work on documents with your team. It also does voice, images, video and more. No GPU required.

LocalAI releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

Models LocalAI runs

Popular open-weight models with LocalAI support, with VRAM needs and licence at a glance.

openai logo20.9BA4.2BCommercial OK≈13 GB↓ 5.6M
meta-llama logo8BConditions≈6.3 GB↓ 4.2M
openai logo117BA5.8BCommercial OK≈70 GB↓ 2.4M
zai-org logo
GLM-5.3zai-org
753BA41.8BCheck licence≈476 GB↓ 1.8M
Qwen logo8.2BCommercial OK≈6.5 GB↓ 6.1M
Qwen logo752MCommercial OK≈1.8 GB↓ 18.5M
Qwen logo14.8BCommercial OK≈11 GB↓ 13M
LiquidAI logo
LFM3-1.7BLiquidAI
1.7BConditions≈1.9 GB↓ 100.6K

Browse all 525 models →

More in AI

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…