selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

litellm logo

Self-host litellm

v1.108.9

Open-source AI gateway for 100+ LLMs via OpenAI API

ReleaseOpen CoreMIT
Updatedyesterday
LanguagePython
Setup difficultyModerate
Stars
63 307
Port
4000 (HTTP API and Admin UI)
Docker
docker.litellm.ai/berriai/litellm

What is litellm?

LiteLLM provides a single OpenAI-compatible API to access over 100 large language model providers such as OpenAI, Anthropic, Bedrock, Azure, Vertex AI, and Google Gemini. It works as a Python library for direct integration or as a standalone proxy server that adds virtual keys, spend tracking, budgets, rate limits, guardrails, load balancing with automatic fallbacks, caching, and a web-based admin dashboard. The proxy persists model configurations, credentials, and usage logs in PostgreSQL and can use Redis for distributed caching and load-balancer state. Enterprise capabilities like SSO/SAML, audit logs, role-based access control, secret-manager integration, IP allowlists, multi-region deployments, and dedicated support are enabled by a license key on the same container image. The core is MIT-licensed; enterprise features use a commercial license.

Should you self-host litellm?

litellm scores 87/100 on selfhost.directory (how scoring works) and ranks #8 of 123 in AI. It has 63 307 GitHub stars, +2 324 in the last 30 days.

It shipped 129 stable releases in the past year. The latest, v1.108.9, came out on 14 November 2026.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is MIT-licensed and written mostly in Python.

Its closest alternative on selfhost.directory is openclaw (93/100, 394 525 stars). It scores higher overall, so compare the two before you pick. See litellm vs openclaw side by side.

litellm README

litellm releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

More in AI

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…