# Self-Hosted AI Stack

> Open-source Docker Compose project running local AI models, chat, documents, voice, and MCP tools on your server with optional HTTPS and GPU acceleration.

- **Category:** AI Chat
- **Licence:** MIT
- **Latest version:** v2026.10.2
- **Open source:** oss
- **Languages:** Shell
- **Platforms:** Docker Compose, Podman
- **Tags:** Mcp, Local Ai, LLM, Rag, Gpu, Ollama, Cuda, Docker, AI, Docker Compose, Linux, Self Hosted, Embeddings, Text To Speech, Whisper, Speech To Text, Litellm, Openai compatible, Private ai, Kokoro, Anythingllm, Ai Stack, Docling

## Description

Self-Hosted AI Stack is a Docker Compose project that bundles multiple AI services into a single deployable stack. It includes InferCrate (Ollama) for running local LLM models, AnythingLLM for a password-protected web chat UI, GatewayCrate (LiteLLM) as an AI gateway with admin UI routing to 100+ providers, EmbedCrate (Hugging Face TEI) for embeddings, ScribeCrate (Whisper) for speech-to-text, ScribeCrate Live for real-time transcription, SpeakCrate (Kokoro) for text-to-speech, UplinkCrate (MCPHub) for MCP tools, and ParseCrate (Docling) for document parsing. Services auto-configure on first start with generated API keys and passwords. The stack supports lightweight variants for lower memory (as low as ~4.5 GB), optional NVIDIA GPU acceleration via CUDA, and an optional Caddy overlay for automatic HTTPS. It runs on Linux (amd64/arm64) with Docker or Podman. The configuration is MIT licensed while included services retain their own licenses.

## Links

- [Homepage](https://github.com/hwdsl2/self-hosted-ai-stack)
- [Website](https://selfhostedaistack.com)
- [Docker](hwdsl2/ollama-server)
- [GitHub Repository](https://github.com/hwdsl2/self-hosted-ai-stack)
- [Documentation](https://github.com/hwdsl2/self-hosted-ai-stack#readme)
- [Community (Reddit)](https://www.reddit.com/r/selfhostedstack/)
- [Troubleshooting Guide](https://github.com/hwdsl2/self-hosted-ai-stack/blob/main/docs/troubleshooting.md)
- [Backup and Restore Guide](https://github.com/hwdsl2/self-hosted-ai-stack/blob/main/docs/backup-restore.md)
- [Goose Setup Guide](https://selfhostedaistack.com/goose)
- [Local AI Readiness Guide](https://selfhostedaistack.com/ready)

---
Source: https://selfhost.directory/project/self-hosted-ai-stack