selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

prefect logo

Self-host prefect

3.9.3

Pythonic workflow orchestration for data pipelines

ReleaseOpen SourceApache-2.0
Updatedyesterday
LanguagePython
Setup difficultyModerate
Stars
24 159
Port
4200 (Prefect server API and UI)
Docker
prefecthq/prefect
Install with Docker
prefect screenshot 1prefect screenshot 2prefect screenshot 3prefect screenshot 4

What is prefect?

This workflow orchestration framework lets you build resilient data pipelines in Python using native decorators (@flow, @task) instead of DSLs or YAML. The self-hosted server runs a web UI on port 4200 for monitoring runs, viewing dependency graphs, and managing deployments. It uses SQLite by default for simple setups and PostgreSQL for production, with optional Redis for event messaging. Core capabilities include automatic state tracking, failure handling with retries, result caching, event-driven triggers, dynamic task creation at runtime, and scheduling via cron or deployment APIs. You can run the server via CLI, Docker, or Docker Compose with PostgreSQL and Redis. The managed Prefect Cloud service adds enterprise features like RBAC, SSO, and audit logs on top of the same open-source engine.

Should you self-host prefect?

prefect scores 80/100 on selfhost.directory (how scoring works) and ranks #4 of 31 in Workflow Automation. It has 24 159 GitHub stars, +155 in the last 30 days.

It shipped 20 stable releases in the past year. The latest, 3.9.3, came out on 13 November 2026. New versions land roughly every 7 days.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Python.

Its closest alternative on selfhost.directory is Kestra (80/100, 30 235 stars). prefect scores higher overall. See prefect vs Kestra side by side.

Features

  • Basic Authentication
  • Caching
  • CI/CD Integration
  • Dynamic task creation
  • Event-driven automations
  • Flexible execution environments
  • Pythonic workflow definition
  • Retries
  • Scheduling
  • State management and recovery
  • Web UI for monitoring

prefect README

How to install prefect

Install prefect with Docker

Docker
Environment variables
PREFECT_API_URL

docker run -p 4200:4200 -d --rm prefecthq/prefect:3-latest -- prefect server start --host 0.0.0.0

Port forward the server to your local machine (e.g. -p 4200:4200). Set the --host flag on the prefect server start command to 0.0.0.0.

How to configure prefect

  • PREFECT_SERVER_API_HOST0.0.0.0Host address for the server API
  • PREFECT_SERVER_UI_API_URLhttp://localhost:4200/apiExternal API URL for the UI
  • PREFECT_REDIS_MESSAGING_HOSTredisRedis host for messaging
  • PREFECT_REDIS_MESSAGING_PORT6379Redis port for messaging
  • PREFECT_REDIS_MESSAGING_DB0Redis database number for messaging

prefect releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

More in Workflow Automation

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…