vLLM
LLM Inference
v0.32.0
vLLM is a high-performance library for running large language model inference and serving, created at UC Berkeley's Sky Computing Lab.10d agoApache-2.0DockerModerate
Projects tagged #Openai Api
~/index>
--sort
39 projects· by score
Projects
bifrost
API Gateway
transports/v2.3.2Bifrost is an open-source high-performance AI gateway that provides unified access to over 23 LLM providers through a single OpenAI-compatible API.7d agoApache-2.0DockerEasy
llama-swap
AI Workflows
v268A lightweight Go binary that manages multiple AI inference servers and switches between them based on incoming API requests.todayMITDockerModerate
lemonade
LLM Inference
v2026.43.3Lemonade is an open-source local AI server that aims to provide cloud-API capabilities for free and privately, running chat, coding, speech, and image-genera…6d agoApache-2.0DockerEasy
Manifest
LLM Integration
manifest@6.28.10An open-source router for large-language-model traffic, Manifest sits between your AI agents and every model provider you use.5d agoMITDockerEasy
envoy-ai-gateway
AI
v1.2.0Agent Router is an open-source control plane for managing AI agent traffic using Envoy Gateway technology (previously called Envoy AI Gateway).21d agoApache-2.0DockerAdvanced
Speaches
Audio
v0.9.0-rc.3Speaches is a self-hosted server that implements the OpenAI Audio API for speech-to-text and text-to-speech.3mo agoMITDockerModerate
tabbyAPI
LLM Inference
0.0.1TabbyAPI is a FastAPI-based application that serves as the official API backend for ExllamaV3, enabling self-hosted LLM inference with an OpenAI-compatible API.4mo agoAGPL-3.0DockerAdvanced
OpenReader
Audiobook Management
v5.3.0OpenReader reads EPUB, PDF, DOCX, TXT, and Markdown files aloud with word-by-word highlighting.7d agoMITDockerModerate
gemini-web2api-go
API Gateway
v4.26.0gemini-web2api-go reverse-proxies the Gemini web application (gemini.google.com) into an OpenAI-compatible REST API.todayMITDockerModerate
Chat with GPT is an open-source unofficial ChatGPT client built with TypeScript and React.chat-with-gpt
AI Chat
2y agoMITDockerEasy
Chatpad AI provides a premium-quality user interface for ChatGPT, available as both a web application and a desktop app.chatpad
AI Chat
2y agoAGPL-3.0DockerEasy
chatterbox-tts-api
Text to Speech
v1.0.1Chatterbox TTS API is a FastAPI-powered REST server that provides an OpenAI-compatible text-to-speech endpoint with voice cloning capabilities.1y agoAGPL-3.0No DockerDemoModerate
NornicDB
Databases & storage
v1.4.3NornicDB is a Go-based graph database aimed at AI workloads such as agent memory, Graph-RAG style retrieval pipelines, and canonical truth stores, keeping gr…6d agoMITDockerModerate
ccLoad
API Gateway
v4.13.1This Go program runs on your own machine or server.todayMITDockerModerate
ggrun
LLM Inference
v3.2.12ggrun (from "gguf run") is a launcher for running local large language models on your own hardware.todayMITNo DockerModerate
Turbo-LLM
LLM Inference
v1.14.5TurboLLM is a self-hosted local LLM platform that runs any inference engine — llama.cpp, community forks, vLLM, MLX, KoboldCpp, llamafile, and more — auto-tu…todayFSL-1.1-ALv2No DockerModerate
A self-hosted gateway that automates a real Chromium browser to turn your ChatGPT or Claude web login into an OpenAI-compatible API.CatGPT-Gateway
AI
4mo agoMITNo DockerAdvanced
faster-chat
AI Chat
v0.2.1This self-hosted web application lets you chat with AI models while keeping full control over your data.6mo agoMITNo DockerModerate
SNDR Core Engine
LLM Inference
v12.1.0Genesis is a runtime patch layer for vLLM that applies hundreds of small changes at startup, letting large open models run on 24 GB consumer NVIDIA cards.28d agoApache-2.0No DockerAdvanced
Veridrop
API
v0.1.0Veridrop checks third-party AI API relays — the reseller gateways that claim to pass your requests straight through to Claude, GPT or Gemini.1mo agoAGPL-3.0No DockerModerate
OpenOpenAI implements the stateful portions of OpenAI's Assistants API — Assistants, Threads, Runs, Messages, Files, and the retrieval tool — with 100% auto-…OpenOpenAI
AI Assistant
1y agoMITNo DockerAdvanced
Open Assistant API provides a drop-in replacement for the OpenAI Assistants API that you can run on your own infrastructure.open-assistant-api
AI Assistant
1y agoMITDockerModerate
llamactl
LLM Inference
v0.22.1llamactl is a self-hosted control plane that lets you run and manage local LLM inference servers.todayMITNo DockerModerate
KaaS
Knowledge Management
v0.1.0-rc.2KaaS (Knowledge as a Service) compiles raw content — pasted text, uploaded files, or fetched URLs — through a four-phase LLM pipeline (Extract, Classify, Wri…1mo agoMITDockerModerate
Reame
LLM Inference
v2.0.0Reame is an LLM inference server designed for CPU-only environments, especially free-tier ARM cloud instances.16d agoMITNo DockerDemoAdvanced
Open Responses
AI
v0.1Open Responses runs a server that implements the OpenAI Responses API specification, letting you use models from Anthropic, Alibaba, DeepSeek, Ollama, and ot…1y agoApache-2.0DockerModerate
GitHub Analyzer is a web app that looks at the projects and activity of a GitHub account and uses an AI to write a fun, sharp summary of what that person has…GitHub Analyzer
Developer Tools
1y agoMITNo DockerModerate
