selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

AI Grid logo

Self-host AI Grid

v0.3.61

Distributed AI inference and training across your computers

BetaOpen SourceMIT
Updated10 hours ago
LanguagePython
Setup difficultyModerate
Stars
272
Ports
8090 (Grid router HTTP API (OpenAI-compatible)), 8091 (Additional grid instance HTTP API)
Install with macOS
Grid desktop app showing chat with a model running on the user's clusterChats view in the Grid desktop appSchedules view in the Grid desktop appProjects view in the Grid desktop app

What is AI Grid?

AI Grid (Grid) turns the computers you already own — Mac Studios, Linux GPU servers, idle workstations — into a private AI network. One machine hosts the grid router (no GPU needed), and other machines join as engines running models via llama.cpp, ComfyUI, or existing Ollama/vLLM/LM Studio instances. Apps send OpenAI-compatible requests to the grid URL, and Grid routes each request to the computer that has the right model. It supports text chat, vision, image/video generation, and experimental GRPO training across the fleet. A native desktop app (macOS/Linux) provides chat, schedules, and projects. The core is MIT-licensed; remote mode via Autonomous Relay lets machines behind NAT join. No accounts or cloud relay in local mode.

Should you self-host AI Grid?

AI Grid scores 48/100 on selfhost.directory (how scoring works) and ranks #59 of 125 in AI. It has 272 GitHub stars.

It shipped 10 stable releases in the past year. The latest, v0.3.61, came out on 27 October 2026. New versions land roughly every 1 days.

Setup is moderate: expect some configuration beyond a single command. It is MIT-licensed and written mostly in Python.

Its closest alternative on selfhost.directory is ComfyUI (93/100, 143 668 stars). It scores higher overall, so compare the two before you pick. See AI Grid vs ComfyUI side by side.

Features

  • Auto model selection
  • CLI for all operations
  • Distributed model routing
  • Distributed training (experimental)Marked experimental in docs; capture path and MLX backend described as young
  • Image and video generation
  • Model catalog with hardware-aware defaults
  • Multiple named grids
  • Native desktop app
  • No account or cloud relay (local mode)
  • OpenAI Compatible API
  • Remote mode via relay
  • Vision model support
  • Works with existing engines

AI Grid README

How to install AI Grid

Install AI Grid with macOS

Native desktop app DMG

How to configure AI Grid

  • GRID_HOMEOverride default local state directory (~/.grid)

    Override default local state directory (~/.grid)

  • OPENAI_API_KEYlocal-gridAPI key for the grid (default 'local-grid' in local mode)

    API key for the grid (default 'local-grid' in local mode)

  • OPENAI_BASE_URLBase URL for OpenAI-compatible API endpoint (e.g., http://192.168.1.25:8090/v1)

    Base URL for OpenAI-compatible API endpoint (e.g., http://192.168.1.25:8090/v1)

AI Grid releases & version history

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…