# AISIX OSS

> Self-hosted, open-source AI gateway with one OpenAI-compatible API for 100+ LLM providers, routing, guardrails, caching, rate limits, and observability — built in Rust.

- **Category:** API Gateway
- **Licence:** Apache-2.0
- **Latest version:** v1.7.1
- **Open source:** oss
- **Languages:** Typescript, Rust
- **Platforms:** Docker
- **Tags:** Ai Agents, Gateway, Observability, LLMOps, LLM, Anthropic, Gemini, Openai, Routing, OIDC, Ai Gateway, Etcd, Rate Limiting, Rust, Failover, Prometheus, Caching, Self Hosted, Bedrock, Apache 2.0, Openai compatible, Llm gateway, Llm proxy, Llm router, Guardrails, Mcp gateway, Otlp, Anthropic Compatible, A2a Gateway, Declarative Config, Inference Gateway, Ai Gateway Rust, Aisix

## Description

AISIX OSS is a Rust gateway that unifies many LLM providers behind one OpenAI-compatible API. The software executes as a single static binary with fast startup and lock-free config reads, supporting hot reloads via SIGHUP. Features include six routing methods, rate limiting with request and token budgets, content guardrails from multiple providers, exact-match caching with memory or Redis, MCP gateway for upstream MCP servers, A2A agent gateway, and OIDC/JWT auth with Entra ID, Okta, and Google Workspace. Observability covers Prometheus metrics, OTLP/GenAI spans to Langfuse, Honeycomb, Grafana Cloud, plus log exporters for Datadog and Aliyun SLS. Config uses one resources.yaml file or etcd for clusters. The same binary powers the commercial AISIX Enterprise and AISIX Cloud data planes.

## Links

- [Homepage](https://github.com/api7/aisix)
- [Website](https://api7.ai/ai-gateway)
- [Docker](ghcr.io/api7/aisix)
- [Demo](https://aisix-demo.api7.ai/)
- [Documentation](https://docs.api7.ai/ai-gateway/)
- [GitHub Repository](https://github.com/api7/aisix)
- [Discord Community](https://discord.gg/dUmRZ7Rvf)
- [Gateway Quickstart](https://docs.api7.ai/ai-gateway/getting-started/gateway-quickstart)
- [Resources File Reference](https://docs.api7.ai/ai-gateway/reference/resources-file)

---
Source: https://selfhost.directory/project/aisix