# matrixhub

> Self-hosted, Hugging Face-compatible model registry that accelerates vLLM and SGLang inference with on-demand caching, RBAC, and multi-region replication.

- **Category:** AI
- **Licence:** Apache-2.0
- **Latest version:** v0.2.0
- **Open source:** oss
- **Languages:** Typescript, Go
- **Platforms:** Docker Compose, Helm
- **Tags:** Nfs, LLM, Rbac, Kubernetes, Docker Compose, Helm, Self Hosted, S3 Storage, Air gapped, Vllm, Sglang, Llm inference, Huggingface, Artificial intelligence, Model Registry, Dynamo, AI Model Registry, Huggingface Compatible, Model Caching, Multi Region Replication, Model Distribution, GPU P2P

## Description

This software provides a private, self-hosted model registry that replaces Hugging Face for enterprise AI teams. It accelerates inference engines like vLLM and SGLang by caching model weights on first pull and distributing them across GPU clusters at high throughput. The registry speaks the Hugging Face API, so existing workflows work unchanged when the endpoint is redirected. It adds project-level access control with audit trails, works with local disks, NFS, or S3-compatible object stores, and can replicate models across data centers. You can run it via Docker Compose on a single machine (SQLite by default) or on Kubernetes with Helm (MySQL). It also connects with llm-d, Dynamo, and ModelExpress for advanced model distribution and GPU-to-GPU weight sharing. The latest release is v0.2.0, still in pre-1.0 development.

## Links

- [Homepage](https://github.com/matrixhub-ai/matrixhub)
- [Website](https://matrixhub.ai)
- [Docker](ghcr.io/matrixhub-ai/matrixhub)
- [Demo](https://demo.matrixhub.ai)
- [GitHub Repository](https://github.com/matrixhub-ai/matrixhub)
- [CNCF Slack #matrixhub](https://cloud-native.slack.com/archives/C0A8UKWR8HG)
- [Documentation](https://matrixhub.ai/docs/overview)
- [GitHub Discussions](https://github.com/matrixhub-ai/matrixhub/discussions)
- [CNCF Landscape](https://landscape.cncf.io/?item=ai-native-infra--model-asset-and-registry--matrixhub)
- [Roadmap](https://matrixhub.ai/roadmap)
- [Blog](https://matrixhub.ai/blog)
- [Community](https://matrixhub.ai/community)

---
Source: https://selfhost.directory/project/matrixhub