GitHub - fluent/fluent-bit: Fast and Lightweight Log processor and forwarder for...

README.md

Travis CI:

GitLab CI:

Fluent Bit is a Data Forwarder for Linux, Embedded Linux, OSX and BSD family operating systems. It's part of the Fluentd Ecosystem. Fluent Bit allows collection of information from different sources, buffering and dispatching them to different outputs such as Fluentd, Elasticsearch, Nats or any HTTP end-point within others. It's fully supported on x86_64, x86 and ARM architectures.

For more details about it capabilities and general features please visit the official documentation:

https://docs.fluentbit.io/

Quick Start

$ cd build
$ cmake ..
$ make
$ bin/fluent-bit -i cpu -o stdout

Features

Fluent Bit support the following features through plugins:

Input plugins

name option description CPU cpu gather CPU usage between snapshots of one second. It support multiple cores Disk disk usage of block device Dummy dummy generates dummy event Exec exec executes external program and collects event logs Forward forward Fluentd forward protocol Memory mem usage of system memory MQTT mqtt start a MQTT server and receive publish messages Netif netif usage of network interface Kernel Ring Buffer kmsg read Linux Kernel messages, same behavior as the dmesg command line program Syslog syslog read messages from a syslog daemon Systemd/Journald systemd read messages from journald, part of the systemd suite Serial Port serial read from serial port Standard Input stdin read from the standard input Head head read first part of files Health health check health of TCP services Process proc check health of Process Random random generate random numbers Tail tail tail log files TCP tcp listen for raw JSON map messages over TCP

Filter Plugins

name option description Record Modifier record_modifier Append/Remove key-value pair Grep grep Match or exclude specific records by patterns Nest nest Nest specific records by patterns Kubernetes kubernetes Enrich logs with Kubernetes Metadata Stdout stdout Print records to the standard output interface Parser parser Parse records

Output Plugins

name option description Counter counter count records Elasticsearch es flush records to a Elasticsearch server File file flush records to a file FlowCounter flowcounter count records and its size Forward forward flush records to a Fluentd service. On the Fluentd side, it requires an in_forward. NATS nats flush records to a NATS server HTTP http flush records to a HTTP end point InfluxDB influxdb flush records to InfluxDB time series database Plot plot generate a file for gnuplot Standard Output stdout prints the records to the standard output stream Treasure Data td flush records to Treasure Data service (cloud analytics)

Official Documentation

The official documentation of Fluent Bit can be found in the following site:

http://fluentbit.io/documentation/

Contributing

In order to contribute to the project please refer to the CONTRIBUTING guidelines.

Contact

Feel free to join us on our Slack channel, Mailing List or IRC:

• Slack: http://slack.fluentd.org (#fluent-bit channel)
• Mailing List: https://groups.google.com/forum/#!forum/fluent-bit
• IRC: irc.freenode.net #fluent-bit
• Twitter: http://twitter.com/fluentbit

License

This program is under the terms of the Apache License v2.0.

Authors

Fluent Bit is made and sponsored by Treasure Data among other contributors.