OpenGateLLM
API Gateway
0.8.0
OpenGateLLM is a freely licensed API gateway for generative AI, created for organizations that require complete authority over their data and infrastructure.todayMITDockerModerate
Self-hosted alternatives to TensorZero
~/index>
--sort
1 project· by score
Projects
Also in API Gateway
Not listed as TensorZero alternatives, but they cover the same ground and are worth a look.
llm-gatewaySelf-hosted open-source API gateway routing 250+ LLM models from 40+ providers via unified OpenAI-compatible API with cost tracking, caching, and failover.
voidllmSelf-hosted LLM proxy routing to OpenAI, Anthropic, Azure, Ollama, vLLM with load balancing, RBAC, rate limits, and zero-knowledge architecture.
lmgateSelf-hosted gateway adding enterprise auth, rate limits, and model ACLs to Ollama, llama.cpp, and LM Studio via Docker Compose.
BricksLLMOpen-source Go AI gateway that meters LLM traffic with per-key rate limits, spend caps, and PII masking, covering OpenAI-style APIs, Anthropic, Azure and vLLM.
AISIX OSSSelf-hosted, open-source AI gateway with one OpenAI-compatible API for 100+ LLM providers, routing, guardrails, caching, rate limits, and observability — built in Rust.
inference-gatewaySelf-hosted gateway that routes requests to 16+ LLM providers through a single OpenAI-compatible endpoint with MCP tools, A2A agents, guardrails, and observability.
About these TensorZero alternatives
1 open-source, self-hosted alternatives to TensorZero are listed here, ranked by popularity, maintenance and documentation.
- Highest rated
- OpenGateLLM (218 GitHub stars, MIT license, written in Python)
- Docker
- 1 of the top 1 ship an official Docker image
- Recently updated
- OpenGateLLM 0.8.0 on 2026-10-28
TensorZero alternatives compared
| Project | License | Language | Stars | Docker | Setup | Latest release | Score |
|---|---|---|---|---|---|---|---|
| OpenGateLLM | MIT | Python | 218 | Yes | Moderate | 0.8.0 | 46 |