selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

matrixhub logo

Self-host matrixhub

v0.2.0

Open-source AI model registry for enterprise inference

BetaOpen SourceApache-2.0
Updated10 hours ago
LanguageGo
Setup difficultyModerate
Stars
362
Ports
3001 (HTTP API and web console), 22 (SSH for Git/LFS access), 9527 (HTTP API (Kubernetes service port))
Docker
ghcr.io/matrixhub-ai/matrixhub
Install with Docker Compose

What is matrixhub?

This software provides a private, self-hosted model registry that replaces Hugging Face for enterprise AI teams. It accelerates inference engines like vLLM and SGLang by caching model weights on first pull and distributing them across GPU clusters at high throughput. The registry speaks the Hugging Face API, so existing workflows work unchanged when the endpoint is redirected. It adds project-level access control with audit trails, works with local disks, NFS, or S3-compatible object stores, and can replicate models across data centers. You can run it via Docker Compose on a single machine (SQLite by default) or on Kubernetes with Helm (MySQL). It also connects with llm-d, Dynamo, and ModelExpress for advanced model distribution and GPU-to-GPU weight sharing. The latest release is v0.2.0, still in pre-1.0 development.

Should you self-host matrixhub?

matrixhub scores 46/100 on selfhost.directory (how scoring works) and ranks #70 of 125 in AI. It has 362 GitHub stars.

It shipped 3 stable releases in the past year. The latest, v0.2.0, came out on 21 September 2026. New versions land roughly every 2 months.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Go.

Its closest alternative on selfhost.directory is ComfyUI (93/100, 143 741 stars). It scores higher overall, so compare the two before you pick. See matrixhub vs ComfyUI side by side.

Features

  • Dynamo GPU P2P
  • Dynamo integration
  • Git/LFS access
  • Hugging Face-compatible API
  • Llm-d integration
  • ModelExpress cache reuse
  • Multi-region replication
  • On-demand proxy caching
  • Project Isolation
  • RBAC and audit logs
  • Robot accounts and tokens
  • SGLang integration
  • Storage-agnostic backends
  • vLLM integration

matrixhub README

How to install matrixhub

Install matrixhub with Docker Compose

Docker and Docker Compose
Environment variables
MATRIXHUB_VERSION, MATRIXHUB_IMAGE_TAG, MATRIXHUB_HTTP_PORT, MATRIXHUB_SSH_PORT, MYSQL_ROOT_PASSWORD, MYSQL_PASSWORD

export MATRIXHUB_VERSION=v0.2.0 mkdir -p matrixhub && cd matrixhub curl -fL
"https://raw.githubusercontent.com/matrixhub-ai/matrixhub/$MATRIXHUB_VERSION/deploy/docker-compose.yml"
-o docker-compose.yml curl -fL
"https://raw.githubusercontent.com/matrixhub-ai/matrixhub/$MATRIXHUB_VERSION/deploy/config.yaml"
-o config.yaml MATRIXHUB_IMAGE_TAG="$MATRIXHUB_VERSION" docker compose up -d

Default deployment uses SQLite; set MATRIXHUB_HTTP_PORT if port 3001 is in use. For MySQL, use docker-compose.mysql.yml and config-mysql.yaml instead.

matrixhub releases & version history

More in Container Orchestration

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…