# GlassFlow ClickHouse ETL

> Self-hosted, open-source stream processor that ingests data from Kafka and OTLP into ClickHouse with deduplication, filtering, and temporal joins.

- **Category:** Data Pipeline
- **Licence:** Apache-2.0
- **Latest version:** v3.2.0
- **Open source:** open_core
- **Languages:** Typescript, Go
- **Platforms:** Helm
- **Tags:** Clickhouse, Data Pipeline, Kafka, ETL, Deduplication, Kubernetes, Helm, Stream processing, Otlp, Temporal Joins, Realtime Etl, Streamprocessing, Glassflow

## Description

This project provides a stream processing engine that moves data into ClickHouse from sources like Kafka and OpenTelemetry. It applies transformations with an expression engine, handles deduplication using an embedded state store, and supports temporal joins across time windows. A web interface and Python SDK let operators manage pipelines. Deployment targets Kubernetes via Helm. The open-source edition covers core sources and sinks, while a commercial tier adds more connectors and operational features. The codebase uses the Apache-2.0 license.

## Links

- [Homepage](https://github.com/glassflow/clickhouse-etl)
- [Website](https://glassflow-etl.com/)
- [GitHub Repository](https://github.com/glassflow/clickhouse-etl)
- [Slack Community](https://join.slack.com/t/glassflowhub/shared_invite/zt-349m7lenp-IFeKSGfQwpJfIiQ7oyFFKg)
- [Artifact Hub](https://artifacthub.io/packages/search?repo=glassflow)

---
Source: https://selfhost.directory/project/clickhouse-etl