# llamactl

> Self-hosted control plane that manages llama.cpp, MLX, and vLLM inference servers through a web dashboard with a unified OpenAI-compatible API.

- **Category:** LLM Inference
- **Licence:** MIT
- **Latest version:** v0.22.1
- **Open source:** oss
- **Languages:** Typescript, Go
- **Platforms:** Docker Compose, Linux, Build from Source
- **Tags:** LLM, Inference, Self Hosted, Openai Api, Web Dashboard, Vllm, Llm inference, Huggingface, Llama.cpp, Mlx, Llm router, Llama Cpp, Localllama, Llama Server, Localllm, Model Router, Mlx Lm

## Description

llamactl is a self-hosted control plane that lets you run and manage local LLM inference servers. It handles llama.cpp, MLX on Apple Silicon, and vLLM through one web dashboard, exposing a single OpenAI-compatible API that directs requests to specific model instances. You get a built-in HuggingFace downloader for GGUF and Safetensors models, a llama.cpp router that loads models only when needed, automatic idle shutdown and least-recently-used cleanup, grouped instance limits, and the ability to run instances on remote machines. The dashboard and management API use API keys, while inference endpoints use separate keys; you can also add OpenID Connect login via Authentik, Keycloak, or Authelia. Built with Go and React, it defaults to port 8080 and uses a local SQLite database with no extra services required. Install via pre-built binaries, Docker images with GPU support, or compile from source using Go 1.24+ and Node.js 22+.

## Links

- [Homepage](https://github.com/lordmathis/llamactl)
- [Website](http://llamactl.org/)
- [GitHub Repository](https://github.com/lordmathis/llamactl)
- [Documentation](https://llamactl.org/dev/)
- [Releases](https://github.com/lordmathis/llamactl/releases)

---
Source: https://selfhost.directory/project/llamactl