# Otari

> A self-hosted, open-source LLM gateway that unifies 40+ model providers behind one OpenAI-compatible endpoint, with virtual keys, budget controls, and usage analytics.

- **Category:** API Gateway
- **Licence:** Apache-2.0
- **Latest version:** v0.33.0
- **Open source:** oss
- **Languages:** Typescript, Python
- **Platforms:** Docker, Docker Compose, Homebrew, Build from Source
- **Tags:** Mcp, Gateway, LLMOps, LLM, Anthropic, Openai, Ai Gateway, Code Execution, Cost Tracking, Web Search, API Key Management, Docker, Open Source, AI, Python, Self Hosted, Multi provider, Usage tracking, Openai compatible, Llm routing, Llm gateway, Llm proxy, Guardrails, Budgets, Budget Enforcement, Litellm Alternative, Anthropic Compatible, Routing Policies

## Description

Otari is an LLM gateway from Mozilla.ai that sits between applications and model providers. It routes requests to 40+ providers through a unified OpenAI-compatible endpoint, manages provider credentials securely behind the gateway, issues revocable virtual API keys with user/workspace/model scope, enforces budgets before requests are dispatched, and records usage after settlement. It supports local routing policies for failover, weighted selection, and learned routing. Optional features include sandboxed code execution, web search, MCP integration, inference guardrails like prompt-injection detection, and file understanding for local models. The gateway is deployed via Docker or Docker Compose with PostgreSQL for production, and includes a web dashboard for managing providers, models, routing, keys, members, budgets, and observability. The CLI tool (installable via Homebrew) adds agent guardrails for coding agents like Claude Code without requiring the server.

## Links

- [Homepage](https://github.com/mozilla-ai/otari)
- [Website](https://otari.ai/docs/gateway)
- [Docker](mzdotai/otari)
- [Documentation](https://docs.otari.ai/otari)
- [GitHub Repository](https://github.com/mozilla-ai/otari)
- [Discord Community](https://discord.gg/ZfZPfTdtSe)
- [Launch Blog Post](https://blog.mozilla.ai/otari-own-your-ai-stack/)
- [Railway Deployment Template](https://github.com/mozilla-ai/otari/blob/v0.32.0/deploy/railway/README.md)

---
Source: https://selfhost.directory/project/otari