Self-host DreamServer
v3.0.0 curl -fsSL https://install.osmantic.com/ods.sh | bash- Stars
- 7 897
- Ports
- 3001 (Portal dashboard web interface), 3000 (Open WebUI chat interface), 11434 (llama-server API endpoint (Linux Docker))
- Requires
- Docker
What is DreamServer?
ODS (Osmantic Deployment System) is a local AI server stack running on your own hardware without cloud dependencies. It manages model selection, chat interface, control dashboard, voice processing, workflow automation, retrieval augmented generation search, and image generation through one-command installers for Linux, macOS, and Windows. The project supports various hardware tiers from CPU-only systems to machines with NVIDIA, AMD Strix Halo, or Intel Arc GPUs. All data stays local with no telemetry collection. Default installation includes inference and dashboard; optional Full Stack adds voice, workflows, search, RAG, image generation, and developer tools as extensions.
Should you self-host DreamServer?
DreamServer scores 64/100 on selfhost.directory (how scoring works) and ranks #3 of 7 in Local AI. It has 7 897 GitHub stars, +319 in the last 30 days.
It shipped 6 stable releases in the past year. The latest, v3.0.0, came out on 24 September 2026. New versions land roughly every 4 days.
Setup is moderate: expect some configuration beyond a single command. It is Apache-2.0-licensed and written mostly in Python.
Its closest alternative on selfhost.directory is AnythingLLM (87/100, 68 502 stars). It scores higher overall, so compare the two before you pick. See DreamServer vs AnythingLLM side by side.
DreamServer README
Osmantic Deployment System
Public testing and refinement ahead of the official V3 launch.
Turn your PC, Mac, or Linux box into a private AI server.
AI server and homelab setup is rapidly becoming a solved problem. It should feel that way for everyone.
ODS installs and wires together everything you need to run AI locally, so you do not have to assemble Ollama, Open WebUI, n8n, ComfyUI, and privacy tools by hand:
- Local model inference — run open models on your own hardware
- ChatGPT-style web UI — talk to your models from any browser
- Control dashboard — manage models, services, setup, GPU status, and extensions from one place
- Voice, agents, and workflows — build automations that can listen, speak, call tools, and get work done
- RAG and search — connect local documents, private search, and retrieval workflows
- Image generation — run local image tools without sending prompts to a hosted API
- Privacy and ops — keep service auth, secrets, observability, and diagnostics in one local stack
FAQ
What is ODS?
ODS installs a local AI stack including llama-server model server, ODS Dashboard at localhost:3001, and Open WebUI chat UI at localhost:3000. Core Only is minimal; Full Stack adds voice, workflows, RAG, and more.
More in Local AI
engrimEngrim is a self-hosted, open-source episodic memory engine that lets AI coding agents share project context across sessions via a local SQLite database.
exllamaOpen-source Python/C++/CUDA runner for 4-bit GPTQ-quantized Llama models on consumer NVIDIA GPUs, with a self-hosted chat web UI you can build and run in Docker.
exoSelf-hosted, open-source AI cluster that links your Macs and Linux boxes to run large LLMs locally via MLX, with Thunderbolt 5 RDMA and an OpenAI/Ollama-compatible API.
FastChatSelf-hosted, open-source LLM serving platform: run open chat models behind a Gradio web UI, a CLI, or an OpenAI-compatible REST API.
Home AssistantSelf-hosted open-source home automation platform with 1500+ integrations, powerful automations, customizable dashboards, and a built-in voice assistant.
homelabSelf-hosted autonomous agent factory running OpenClaw, Kilo Pipeline, Crawl4AI, Qdrant, and Ollama locally on low-power x86 hardware.
InvokeAISelf-hosted, open-source AI image generation studio with a layered Unified Canvas, node-based workflows, ControlNet, and broad local model support from SD 1.5 to Flux.
jevosOpen-source, self-hosted decision model answering yes/no, choice and score questions with probabilities on a laptop CPU in 28-130 ms, an alternative to Jev's cloud.
koboldcppSelf-hosted, open-source (AGPL-3.0) single-file GGUF LLM server with a bundled KoboldAI Lite web UI and OpenAI-, KoboldAI- and Ollama-compatible API endpoints.
lemonadeSelf-hosted, open-source local AI server that runs LLM, vision, image, speech, and transcription models on your own GPU or NPU and serves them through OpenAI-style APIs.
llama.cppllama.cpp is an open-source, self-hosted LLM inference engine written in C/C++ that runs quantized models locally on CPU and GPU with minimal dependencies.
llama-gptSelf-hosted, open-source ChatGPT-style chatbot that runs Llama 2 and Code Llama locally, with a web chat UI and an OpenAI-compatible API.
0 comments