Rerun Documentation

repository·main·Indexed 27 days ago

https://github.com/rerun-io/rerun

Rerun is a multimodal data layer for physical AI designed to log, query, visualize, and stream complex sensor data such as images, point clouds, and transforms. It features a high-performance columnar storage format, a real-time viewer for debugging robotics and computer vision pipelines, and a comprehensive ecosystem of Rust crates for data handling, including gRPC communication via the Rerun Data Protocol (redap), Apache Arrow integration, and support for .rrd, HDF5, MCAP, and MP4 formats.

Tokens
187.5K
Snippets
361
Records
1.3K
Agent score
93%

What's inside Rerun

  1. Overview of re_lenses_core

    main
    re_lenses_core is a crate within the rerun ecosystem that provides core lens definitions, builders, and composable transformations for Apache Arrow arrays. It is designed to enable transformations that convert one Arrow array type to another while preserving structural properties such as row counts and null handling.
  2. Overview of the Rerun server crate

    main
    The re_server crate provides an in-memory, open-source implementation of the Rerun server. It is designed to support most of the same gRPC endpoints as the commercial Rerun Hub service, but operates entirely in-memory for maximum simplicity. It is primarily used for testing purposes.
  3. Overview of the Rerun Viewer

    main
    The Rerun Viewer is the primary crate responsible for the Rerun graphical user interface (GUI). It serves as the visual component of the Rerun ecosystem, allowing users to interact with logged data. It communicates with the Rerun server using gRPC via the re_redap_client crate.
  4. Overview of Rerun's Data Layer and Catalog Server

    main

    Rerun acts as a Unified Data Layer for Physical AI. The Rerun SDK connects to a catalog server to enable storing, retrieving, and querying large datasets. This integration allows for visual browsing and inspection of data through the Rerun viewer.

    For local testing and experimentation, Rerun provides a simplified open-source catalog server that is API-compatible with the managed Rerun Hub offering. Note that the open-source server loads all data into memory, making it highly performant for small datasets but limited by available RAM.

  5. Overview of Rerun components

    main

    Rerun provides a unified data layer for multi-rate, multimodal robotics data, covering the journey from raw recordings to model training. It consists of two primary components:

    • Rerun SDK: An open-source library and set of tools used for logging, storing, querying, visualizing, and training on multimodal data.
    • Rerun Hub: A data catalog and backend designed for large-scale storage, access, and streaming of robotics data directly from object storage.