Self-host AISIX OSS
v1.7.1Rust AI gateway unifying 100+ LLM providers via OpenAI API
- Stars
- 207
- Ports
- 3000 (OpenAI-compatible proxy API (chat/completions, embeddings, etc.)), 9090 (Metrics and status listener (Prometheus /metrics, /status/*)), 3001 (Admin listener (read-only resource surface, OpenAPI 3 with Scalar UI, playground))
ghcr.io/api7/aisix
What is AISIX OSS?
AISIX OSS is a Rust gateway that unifies many LLM providers behind one OpenAI-compatible API. The software executes as a single static binary with fast startup and lock-free config reads, supporting hot reloads via SIGHUP. Features include six routing methods, rate limiting with request and token budgets, content guardrails from multiple providers, exact-match caching with memory or Redis, MCP gateway for upstream MCP servers, A2A agent gateway, and OIDC/JWT auth with Entra ID, Okta, and Google Workspace. Observability covers Prometheus metrics, OTLP/GenAI spans to Langfuse, Honeycomb, Grafana Cloud, plus log exporters for Datadog and Aliyun SLS. Config uses one resources.yaml file or etcd for clusters. The same binary powers the commercial AISIX Enterprise and AISIX Cloud data planes.
Should you self-host AISIX OSS?
AISIX OSS scores 50/100 on selfhost.directory (how scoring works) and ranks #21 of 39 in API Gateway. It has 207 GitHub stars.
It shipped 2 stable releases in the past year. The latest, v1.7.1, came out on 27 October 2026. New versions land roughly every 5 days.
Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Rust.
Its closest alternative on selfhost.directory is Kong Gateway (82/100, 44 314 stars). It scores higher overall, so compare the two before you pick. See AISIX OSS vs Kong Gateway side by side.
Features
- A2A agent gateway
- Anthropic Messages API
- Caching
- Declarative Configuration
- Ensemble models
- Guardrails
- MCP Gateway
- Observability
- OpenAI Compatible API
- Operational endpoints
- Rate limiting & concurrency
- Routing & failover
- Semantic routing
AISIX OSS README
More in API Gateway
anythingmcpSelf-hosted gateway turning APIs and databases into MCP tools for AI assistants, with hundreds of ready connectors and access controls.
api200Self-hosted API gateway simplifying third-party integrations with auth, caching, retries, mocks, schema watching, and MCP support via one URL.
apimeSelf-hosted, open-source WhatsApp REST API gateway in Go with multi-instance dashboard, webhooks, and Node.js SDK.
apisixOpen-source, self-hosted API and AI gateway built on NGINX and etcd, with hot-loaded plugins, dynamic routing, load balancing and rate limiting.
bifrostOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
BricksLLMOpen-source Go AI gateway that meters LLM traffic with per-key rate limits, spend caps, and PII masking, covering OpenAI-style APIs, Anthropic, Azure and vLLM.
CatGPT-GatewaySelf-hosted gateway turning ChatGPT/Claude browser sessions into an OpenAI-compatible API with tool calling, vision, and file attachments.
ccLoadOpen-source gateway you host that combines AI keys and subscriptions into one endpoint with failover, protocol translation, and usage costs for coding assistants.
claude-code-aws-gatewaySelf-hosted proxy giving teams complete Claude Code capabilities via their AWS Bedrock accounts, with budgets, SSO, and analytics.
ClawRouterSelf-hosted LLM router with local smart routing across 88 models. Agents pay per request via USDC/x402 or credit-card API keys. MIT licensed.
CLI2APISelf-hosted OpenAI-compatible API that turns your own Qoder, WorkBuddy, and Trae account logins into a local API endpoint with multi-account routing and a web console.
cliproxyapi-cloudflare-stackA deployment template for running an OpenAI-compatible LLM API gateway on your own infrastructure using CLIProxyAPI and Cloudflare services.
0 comments