selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

openlit logo

Self-host openlit

openlit-2.1.1

Agent observability, evals and guardrails on OpenTelemetry

ReleaseOpen CoreApache-2.0
helm install openlit openlit/openlit
Updated2 weeks ago
LanguageTypescript
Setup difficultyModerate
Stars
3 072
Ports
3000 (OpenLIT web UI and API), 4317 (OTLP gRPC receiver), 4318 (OTLP HTTP receiver)
Requires
ClickHouse
Docker
ghcr.io/openlit/openlit
Coding agent trace view with LLM calls, tool calls and costTraces view with full agent conversation, spans and cost breakdownAutomated evaluation dashboard with hallucination, bias and toxicity metricsConnectors catalog with ClickHouse, Tempo, Loki, Prometheus and JaegerPrompt Hub detail page with versions and linked rulesRule engine rule detail with condition groups and live preview

What is openlit?

openlit alternatives

Should you self-host openlit?

openlit scores 67/100 on selfhost.directory (how scoring works) and ranks #2 of 2 in LLMOps. It has 3 072 GitHub stars, +235 in the last 30 days.

It shipped 26 stable releases in the past year. The latest, otel-gpu-collector-1.0.0, came out on 13 October 2026. New versions land roughly every 2 days.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Typescript.

Its closest alternative on selfhost.directory is arize-phoenix (74/100, 12 280 stars). It scores higher overall, so compare the two before you pick. See openlit vs arize-phoenix side by side.

Features

  • Built-in AI copilot
  • Coding agent monitoring
  • Custom dashboards
  • GPU Monitoring
  • Guardrails
  • LLM & agent observability
  • LLM-as-a-judge evaluations
  • LLM Cost Tracking
  • Model comparison playground
  • Multi-tenancy
  • OpenTelemetry-native tracing
  • Prompt Management
  • REST API
  • Rule Engine
  • Secret vault

openlit README

OpenLIT logo

Same Agent, Smaller Bill!

Trace, evaluate, guard, and improve AI agents and coding agents with OpenTelemetry. Agent observability · Evals · Guardrails · Prompt management · Cost & GPU monitoring · Self-host free (Apache 2.0)

OpenLIT agent harness trace view showing LLM calls, tool calls and cost

⭐ Star     🚀 Quickstart     📚 Docs

Documentation License Downloads Slack X

Website · Documentation · Quickstart · Compare · Join Slack


What is OpenLIT?

OpenLIT is an open-source agent harness engineering platform. It gives teams OpenTelemetry-native tracing, evaluations, guardrails, prompt and context management, and cost and GPU monitoring for the harness around their AI agents and coding agents, so every agent failure can be traced, scored, and turned into a harness fix. OpenLIT is free to self-host under Apache 2.0 and works with any model, framework, or harness: Claude Code, Codex, Cursor, OpenAI Agents SDK, LangGraph, CrewAI, and 70+ more integrations.

How to install openlit

Install openlit with Docker Compose

Docker and Docker Compose
Environment variables
PORT, INIT_DB_HOST, INIT_DB_PORT, INIT_DB_DATABASE, INIT_DB_USERNAME, INIT_DB_PASSWORD, SQLITE_DATABASE_URL, TELEMETRY_ENABLED, NEXTAUTH_SECRET, GOOGLE_CLIENT_ID, GITHUB_CLIENT_ID
git clone https://github.com/openlit/openlit.git
cd openlit

docker compose up -d

Open:

http://127.0.0.1:3000

Deploys OpenLIT (dashboard + OTLP receiver) and ClickHouse; the standalone otel-collector container is no longer used.

How to configure openlit

  • INIT_DB_HOSTSeed-only at install: host address written into the default Database Config on first setup.
  • INIT_DB_PORTSeed-only: ClickHouse HTTP port for the default Database Config (commonly 8123).
  • INIT_DB_DATABASESeed-only: ClickHouse database name for the default Database Config.
  • INIT_DB_USERNAMESeed-only: username stored on the default Database Config.
  • INIT_DB_PASSWORDSeed-only: password stored on the default Database Config; rotate later via the Database Config UI.

openlit releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

FAQ

Is OpenLIT free to self-host?

Yes; the Apache-2.0 community edition is free with no license key or usage limits, though a few governance features (custom roles, audit logs, alerts) are part of OpenLIT Enterprise.

What do I need to self-host OpenLIT?

Docker with Docker Compose for the quickest path, or a Kubernetes cluster with Helm; either way it deploys OpenLIT (dashboard + OTLP receiver) plus ClickHouse.

Can OpenLIT send data to my existing observability stack?

Yes; being OpenTelemetry-native, it can export traces and metrics to Grafana, Datadog, New Relic, SigNoz or any OTLP-compatible backend.

Does OpenLIT require code changes to instrument my app?

No; the SDK auto-instruments 70+ LLMs, agent frameworks and vector databases with zero code changes, or you can call openlit.init() once for manual control.

Is OpenLIT open source?

Yes, fully open source under Apache 2.0 and self-hostable via Docker Compose or Helm, so telemetry and prompts stay on your infrastructure.

What is an agent harness?

Everything in an AI agent except the model — tools, context, prompts, memory, hooks, guardrails and feedback loops; Claude Code, Codex, LangGraph or CrewAI are harnesses OpenLIT observes and improves.

What is OpenLIT?

It is an open-source agent harness engineering platform providing OpenTelemetry-native tracing, evaluations, guardrails, prompt management and cost/GPU monitoring for AI and coding agents, free to self-host under Apache 2.0.

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…