Self-host matrixhub
v0.2.0Open-source AI model registry for enterprise inference
- Stars
- 362
- Ports
- 3001 (HTTP API and web console), 22 (SSH for Git/LFS access), 9527 (HTTP API (Kubernetes service port))
ghcr.io/matrixhub-ai/matrixhubWhat is matrixhub?
This software provides a private, self-hosted model registry that replaces Hugging Face for enterprise AI teams. It accelerates inference engines like vLLM and SGLang by caching model weights on first pull and distributing them across GPU clusters at high throughput. The registry speaks the Hugging Face API, so existing workflows work unchanged when the endpoint is redirected. It adds project-level access control with audit trails, works with local disks, NFS, or S3-compatible object stores, and can replicate models across data centers. You can run it via Docker Compose on a single machine (SQLite by default) or on Kubernetes with Helm (MySQL). It also connects with llm-d, Dynamo, and ModelExpress for advanced model distribution and GPU-to-GPU weight sharing. The latest release is v0.2.0, still in pre-1.0 development.
Should you self-host matrixhub?
matrixhub scores 46/100 on selfhost.directory (how scoring works) and ranks #70 of 125 in AI. It has 362 GitHub stars.
It shipped 3 stable releases in the past year. The latest, v0.2.0, came out on 21 September 2026. New versions land roughly every 2 months.
Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Go.
Its closest alternative on selfhost.directory is ComfyUI (93/100, 143 741 stars). It scores higher overall, so compare the two before you pick. See matrixhub vs ComfyUI side by side.
Features
- Dynamo GPU P2P
- Dynamo integration
- Git/LFS access
- Hugging Face-compatible API
- Llm-d integration
- ModelExpress cache reuse
- Multi-region replication
- On-demand proxy caching
- Project Isolation
- RBAC and audit logs
- Robot accounts and tokens
- SGLang integration
- Storage-agnostic backends
- vLLM integration
matrixhub README
More in Container Orchestration
mesosOpen-source Apache Mesos is a self-hosted cluster manager that pools CPU, memory and GPU across your own servers for frameworks like Hadoop, Spark and Jenkins.
Minecraft Server on ProxmoxBash scripts deploy PaperMC Java or Bedrock servers on Proxmox VE (VM/LXC) with Fill v3 API auto-updates, SHA256 verification, systemd, and adaptive JVM memory.
mortiseMortise brings Railway-style git-push deployments to your own Kubernetes cluster. Open-source, self-hosted, handles builds, TLS, domains, and preview environments.
nanoclNanocl is a self-hosted, open-source orchestrator for containers and VMs using declarative Statefiles to manage workloads on your infrastructure.
NomadSelf-hosted Nomad clusters schedule containers, VMs, binaries and batch jobs on Linux, Windows or macOS and need no external datastore.
noraOpen-source control plane to run AI agent fleets on your infrastructure via Docker or Kubernetes with dashboard, API, CLI, and MCP automation.
NucleusSelf-hosted container runtime for Linux/NixOS with kernel-level isolation, three modes, declarative NixOS integration, gVisor, signed snapshots, TLA+ verified.
openresty-managerOpenResty Manager is a self-hosted web control panel for OpenResty with reverse proxy, free SSL, host terminal, file manager, Docker app store, and multi-node CDN.
openrunA self-hosted GitOps platform that deploys web apps to Docker or Kubernetes using declarative config, with built-in SSO, RBAC, and database bindings.
project-pegaproxSelf-hosted, open-source web UI for Proxmox VE and XCP-ng with multi-cluster control, live migration, load balancing, and compliance features.
proxmoxSelf-hosted Proxmox VE running in Docker with KVM acceleration, LXC containers, and the full web interface for managing VMs and containers.
proxmox-backup-serverSelf-hosted, open-source Docker build of Proxmox Backup Server for AMD64 and ARM64, providing backup storage and management with a web UI on port 8007.
0 comments