# OpenGateLLM

> Self-hosted open-source API gateway unifying generative AI models with OpenAI-compatible endpoints, access control, rate limiting, and usage tracking.

- **Category:** API Gateway
- **Licence:** MIT
- **Latest version:** 0.8.0
- **Open source:** oss
- **Languages:** Python
- **Platforms:** Docker Compose, Kubernetes
- **Tags:** API, SSO, LLM, Mistral, Ollama, OIDC, Api Gateway, Rate Limiting, Self Hosted, Vllm, Openai compatible, Whisperx, Tei, Usage Monitoring, Carbon Footprint

## Description

OpenGateLLM is a freely licensed API gateway for generative AI, created for organizations that require complete authority over their data and infrastructure. It delivers a single OpenAI-compatible interface that directs requests to various model providers such as vLLM, Ollama, Mistral On-Prem, Text Embeddings Inference, and WhisperX. The system ships with built-in access governance covering roles, users, and organizations, along with usage controls including rate limiting, inference monitoring, model pricing budgets, and carbon footprint tracking. Both password-based login and OIDC-based Single Sign-On are supported. Deployment uses Docker Compose for quick starts or Kubernetes (Helm charts in progress), with PostgreSQL and Redis as required dependencies. The project comes from DINUM (French government digital service) and CentraleSupélec under the MIT license.

## Links

- [Homepage](https://github.com/etalab-ia/OpenGateLLM)
- [Website](https://docs.opengatellm.org)
- [Docker](ghcr.io/etalab-ia/opengatellm/api)
- [API Reference](https://albert.api.etalab.gouv.fr/reference)
- [GitHub Repository](https://github.com/etalab-ia/OpenGateLLM)
- [Release Notes](https://github.com/etalab-ia/OpenGateLLM/releases)

---
Source: https://selfhost.directory/project/opengatellm