Self-host fluentd
v1.20.1Open-source log collector for unified logging layer
- Stars
- 13 613
- Ports
- 9880 (HTTP input), 24224 (Forward protocol (TCP/UDP))
fluent/fluentdWhat is fluentd?
Fluentd is an open-source data collector that builds a unified logging layer. It runs as a background service on servers, containers, and edge devices to gather, parse, transform, and route log data from various sources such as files, syslog, HTTP, databases, and cloud services to multiple destinations including files, Elasticsearch, Kafka, S3, databases, and over 500 other outputs. The project is a CNCF graduated project written in Ruby with performance-critical parts in C. Users can self-host it via Docker images (fluent/fluentd), native packages (fluent-package for Linux, Windows, macOS), Ruby gems, or Kubernetes DaemonSets. Fluentd uses a plugin architecture with over 1100 community plugins for inputs, outputs, filters, parsers, and formatters. It is used by thousands of companies including AWS, Microsoft, Nintendo, and Twilio.
fluentd alternatives
logstashAn open-source server-side data pipeline that ingests, transforms and routes events with 200+ plugins; self-hosted via Docker, deb/rpm packages or tar/zip downloads.Comparelogstash with fluentd
TelegrafOpen-source, self-hosted telemetry agent that collects, processes and writes metrics and logs via 300+ plugins, shipped as a single static binary configured in TOML.CompareTelegraf with fluentd
Syslog-ngsyslog-ng is a self-hosted, open-source log daemon that collects, parses, and forwards logs to files, databases, and big data platforms.CompareSyslog-ng with fluentd
collectdSelf-hosted C-based daemon collecting OS/application performance metrics. Supports RRD storage, Graphite, Prometheus, Kafka integration.Comparecollectd with fluentd
rsyslogRsyslog is an open-source, high-performance syslog server that collects, transforms, and routes event data at scale with 100+ modules and 1M+ msgs/sec.Comparersyslog with fluentd
vectorA self-hosted, open-source observability data pipeline in Rust that collects, transforms, and routes logs and metrics to whichever backend you choose.Comparevector with fluentd
netdataNetdata is an open-source, self-hosted infrastructure monitoring platform with per-second metrics, automated dashboards, ML anomaly detection, and zero-config deployment.Comparenetdata with fluentd
logtideOpen-source, self-hosted log management and SIEM unifying logs, traces and metrics on TimescaleDB, ClickHouse or MongoDB, an alternative to Datadog, Splunk and ELK.Comparelogtide with fluentd
Should you self-host fluentd?
fluentd scores 73/100 on selfhost.directory (how scoring works) and ranks #2 of 13 in Log Management. It has 13 613 GitHub stars, +15 in the last 30 days.
It shipped 7 stable releases in the past year. The latest, v1.20.1, came out on 26 October 2026. New versions land roughly every 2 months.
Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Ruby.
Its closest alternative on selfhost.directory is openobserve (80/100, 22 974 stars). It scores higher overall, so compare the two before you pick. See fluentd vs openobserve side by side.
Features
- Buffer plugins
- CNCF graduated project
- Docker logging driver
- Filter and transformation plugins
- High Performance
- Kubernetes DaemonSet support
- Log collection and parsing
- Multiple input sources
- Multiple output destinations
- Parser plugins
- Plugin Architecture
- Prometheus monitoring
- REST API monitoring
- Unified Logging Layer
- Windows support
fluentd README
Fluentd collects events from various data sources and writes them to files, RDBMS, NoSQL, IaaS, SaaS, Hadoop and so on. Fluentd helps you unify your logging infrastructure (Learn more about the Unified Logging Layer).
FAQ
Where to ask questions not answered in FAQ?
See the Get Help page for community channels (Forum, Stack Overflow, Issue Tracker, X/Twitter) and commercial support options.
What does 'Certified' mean for plugins?
Certified plugins are developed by Fluentd core committers or companies with commercial commitment to the project, helping users identify production-ready plugins.
How to add a plugin to the plugin page?
Release your plugin as a fluent-plugin-xxx gem (not fluentd-plugin-xxx or fluent-xxx-plugin) and the script will periodically update the plugin page.
What are the differences between Fluentd and Fluent Bit?
Fluentd is designed for flexibility with 1100+ plugins and ~40MB memory; Fluent Bit is designed for small footprint with ~30 plugins and ~450KB memory, written entirely in C.
What is Fluent Bit?
Fluent Bit is a lightweight data forwarder designed for edge devices, containers, and embedded systems, with smaller memory footprint (~450KB) but fewer plugins (~30) compared to Fluentd.
How's Fluentd's performance since it's written in Ruby?
Performance-critical parts are written in C (networking and serialization layers). A regular PC can handle 18,000 messages/second with a single process.
Should I use fluent-package or the Fluentd gem?
Use fluent-package (LTS) for stability in large-scale or first-time deployments; use the Fluentd gem if you want to control features and updates yourself.
What are the differences between fluent-package and Fluentd?
fluent-package is a stable distribution package of Fluentd that includes systemd service files and jemalloc, while Fluentd gem requires manual daemon setup and uses OS default memory allocator.
What is Fluentd?
Fluentd is an open source data collector for building the unified logging layer. Once installed on a server, it runs in the background to collect, parse, transform, analyze and store various types of data.
More in Log Management
GeoMetrikksGeoMetrikks is a self-hosted, open-source service that tails reverse proxy logs, performs GeoLite2 lookups, and displays requests on a live MapLibre map with analytics.
gigapipeSelf-hosted open-source observability backend merging four telemetry types into ClickHouse with Loki, Prometheus, Tempo and Pyroscope protocol support.
grafanaGrafana is a self-hosted, open-source observability platform for querying, visualizing, and alerting on telemetry data from many sources.
graylogSelf-hosted open-source log management and SIEM server: aggregate and search logs, transform them in pipelines, alert and build dashboards.
hertzbeatApache HertzBeat is a self-hosted, open-source observability system unifying agentless metrics and logs collection, alerting, and notification dispatch.
highlightSelf-hosted open-source monitoring platform combining session replay, error monitoring, logging and distributed tracing, with Docker deployment and dozens of client SDKs.
howlerHowler is a self-hosted log monitor that watches files and sends alerts to Discord, Gotify, or Slack. Runs via Docker or Java JAR with a web UI.
hyperdxSelf-hosted, open-source observability platform unifying logs, metrics, traces and session replays on any ClickHouse cluster, with ingestion through OpenTelemetry.
logarrLogarr is a self-hosted, open-source PHP web app that consolidates and displays log files in a single-page interface for easy monitoring.
LogchefLightweight, single-binary log analytics interface for ClickHouse, focused on high-performance querying and visualization
LogDeckSelf-hosted log viewer for Docker/Podman that stores history, sends alerts, edits container resources live — one Go binary with CLI and MCP server.
logforgeSelf-hosted open-source Docker dashboard unifying logs, metrics, alerts, notifications, file access, and safe automated remediation for local and remote hosts.
0 comments