DOCSEARCHbyAlgolia
Submit Docs

Fluent Bit

repository·master·Indexed 11 days ago

https://github.com/fluent/fluent-bit

A lightweight, high-performance telemetry agent for collecting, processing, and forwarding logs, metrics, and traces. Designed for cloud-native and embedded environments, it supports official Docker images across multiple architectures, WASM filter development using Rust, and integration with stacks like Loki, Grafana, and Prometheus.

Tokens
421.8K
Snippets
1.3K
Records
1.8K
Agent score
93%

What's inside Fluent Bit

  1. Overview of LwRB Ring Buffer

    master

    LwRB is a generic FIFO (First In; First Out) buffer library specifically optimized for embedded systems. It is designed to be lightweight and efficient for resource-constrained environments.

    Key Characteristics:

    • Memory Model: Uses a static array with no dynamic memory allocation.
    • Portability: Written in ANSI C99 and is platform-independent (no architecture-specific code).
    • Safety: Thread-safe and interrupt-safe when used as a pipe with a single writer and a single reader.
    • Performance: Uses optimized memory copies instead of loops and supports zero-copy DMA transfers.
    • Capabilities: Supports data peeking, skipping reads, advancing writes, and event notifications.

  2. Overview of nghttp2

    master
    nghttp2 is a C implementation of the HTTP/2 framing layer. It is provided as a reusable C library and includes several bundled applications: an HTTP/2 client (nghttp), a server (nghttpd), a proxy (nghttpx), and a load testing/benchmarking tool (h2load). Additionally, it provides a public API for HPACK encoding and decoding.

  3. Overview of the lwrb library

    master

    lwrb is a lightweight, generic FIFO (First In First Out) ring buffer manager implemented in ANSI C99. It is designed for high-performance scenarios where memory stability and speed are critical.

    Key characteristics include:

    • Static Memory: No dynamic memory allocation; it uses a static array.
    • Performance: Uses optimized memory copies instead of loops for read/write operations.
    • Safety: Thread-safe and interrupt-safe when used as a pipe with a single writer and a single reader.
    • Hardware Compatibility: Suitable for DMA (Direct Memory Access) transfers with zero-copy overhead between the buffer and application memory.
    • Advanced Buffer Control: Supports peeking at data, skipping read positions, and advancing write positions.
    • Event Support: Implements support for event notifications.

  5. What is Zstandard (zstd)?

    master
    Zstandard (or zstd) is a fast, lossless compression algorithm designed for real-time compression scenarios. It aims to provide compression ratios comparable to or better than zlib while maintaining high speeds. It is backed by a fast entropy stage using the Huff0 and FSE libraries. The format is stable and documented in [RFC8878].

  6. What is Fluent Bit?

    master
    Fluent Bit is a lightweight, high-performance telemetry agent designed to collect, process, and forward Logs, Metrics, and Traces. It is part of the Fluentd ecosystem and is a CNCF graduated project. It is optimized for minimal CPU and memory footprint and supports various platforms including Linux, Windows, MacOS, BSD, and embedded environments.

  8. Overview of WebAssembly Micro Runtime (WAMR)

    master

    WebAssembly Micro Runtime (WAMR) is a lightweight, standalone WebAssembly (Wasm) runtime designed for environments ranging from embedded and IoT to edge, cloud-native, and Trusted Execution Environments (TEE). It is highly configurable and optimized for a small footprint and high performance.

    Core Components

    • VMcore: The runtime libraries used for loading and executing Wasm modules. It supports multiple execution modes: Interpreter, Ahead-of-Time (AoT) compilation, and Just-in-Time (JIT) compilation (including Fast JIT and LLVM JIT).
    • iwasm: An executable binary built using the WAMR VMcore that supports WASI and provides a command-line interface.
    • wamrc: The AOT compiler used to compile Wasm files into AOT-optimized files.

    Key Capabilities

    • Execution Modes: Supports Interpreter, Fast JIT, LLVM JIT, and AoT.
    • Standard Support: Full compliance with W3C Wasm MVP and support for post-MVP features like 128-bit SIMD, Reference Types, Bulk memory operations, and Tail-calls.
    • Platform Support: Runs on X86, ARM (Cortex-M/A), AArch64, RISC-V, XTENSA, MIPS, and ARC across platforms like Linux, Windows, macOS, Android, and various RTOS (Zephyr, NuttX, etc.).

  9. Overview of yyjson

    master

    yyjson is a high-performance JSON library written in ANSI C (C89). It is designed for speed, capable of reading or writing gigabytes of JSON data per second on modern CPUs. It is portable, strict (RFC 8259 compliant), and easy to integrate using just one .h and one .c file.

    Key Features:

    • Accuracy: Precise handling of int64, uint64, and double.
    • Flexibility: Supports unlimited nesting, \u0000 characters, and non-null-terminated strings.
    • Manipulation: Supports JSON Pointer, JSON Patch, and JSON Merge Patch.
    • Extendable: Supports custom allocators and JSON5 features via options.

  10. Overview of xxHash digest algorithms

    master

    xxHash is a fast, non-cryptographic digest algorithm designed to produce a unique "fingerprint" or digest for a message of arbitrary length. It supports an optional seed value.

    Key Variants:

    • XXH32: Optimized for 32-bit machines.
    • XXH64: Optimized for 64-bit machines.
    • XXH3: A newer generation providing both 64-bit (XXH3_64bits) and 128-bit (XXH3_128bits) outputs. It is highly optimized for vector operations.

    Important Security Note: xxHash is non-cryptographic. It is not designed to resist intentional collisions or to prevent attackers from producing messages with predefined digests.