Self-host OpenGateLLM

OpenGateLLM is a freely licensed API gateway for generative AI, created for organizations that require complete authority over their data and infrastructure. It delivers a single OpenAI-compatible interface that directs requests to various model providers such as vLLM, Ollama, Mistral On-Prem, Text Embeddings Inference, and WhisperX. The system ships with built-in access governance covering roles, users, and organizations, along with usage controls including rate limiting, inference monitoring, model pricing budgets, and carbon footprint tracking. Both password-based login and OIDC-based Single Sign-On are supported. Deployment uses Docker Compose for quick starts or Kubernetes (Helm charts in progress), with PostgreSQL and Redis as required dependencies. The project comes from DINUM (French government digital service) and CentraleSupélec under the MIT license.