esc
Start typing to search the docs
Menu

The standard data layer for physical AI

The data primitives to build, understand, and improve your data loop. Designed for multi-rate, multimodal data, from the first recording to massive scale. For humans and agents.

Scaling with Rerun Hub

A single toolchain to work with multi-rate, multimodal data

A flexible framework to build with rather than a platform you can't change. Childus meshum wasmus schemae, dataframae sdkum childus childus wasmus quaternionae keypointum containerae axisus.

Visualize everything

Review datasets, debug detail-level issues, and extend with your own views and tools for every stage of the pipeline.

Query and transform

Full dataframe or SQL queries over any robotics data. Extend with post-processing or annotations as easily as adding columns to a table.

Log, store and convert

Store multi-rate, multimodal data as column-chunks in rrd files. Either log directly or easily convert from any other format.

Ready for agents

Give agents a visual workspace for physical data. From loading a dataset to arranging views, keep every step grounded in data you can inspect.

Example agent prompt

Open this .rrd in Rerun with camera images beside the 3D point cloud. Overlay the camera trajectory and sync the views on the same timeline. Save the layout as a blueprint I can reuse for the next recording.

Let agents use the Viewer through MCP to inspect data and control a running session. Give them a visual workspace for investigating recordings alongside you.

Give agents structure with entities, components, and timelines. Dataframes and SQL let them query the data they need instead of sorting through files.

Keep every action inspectable in the Viewer. Review what an agent selected or generated alongside the source data, so you can check its work in context.

Rerun Hub. Infrastructure that powers your data loop.

The production backend for the Rerun data layer. Catalog, byte-range indexing, and retrieval turn your object stores into a queryable, streamable foundation. Run transforms on the edge or close to the data.

Query inside every recording with SQL or dataframes across columns, time ranges, frames, and values.
Evolve data without copies by adding derived columns and schemas beside the raw recordings.
Stream dataset queries to GPUs with a column-aware, video-aware dataloader and no export pipeline.
Give the team one shared view to explore, annotate, and trace failures back to the source.

Used to ship physical AI at scale

Dexory turns daily robot scans into a live view of warehouse inventory, helping teams see what is on every shelf.
Ultra builds warehouse robots that pack, sort, and kit orders, adapting to changing items and workflows on the floor.
Maven Robotics combines dexterous manipulation and mobility in autonomous robots built to work alongside people.
Sereact builds AI that lets robots pick, place, and sort varied products, adapting to new items in busy warehouses.

Loved by the community

Start building today

Build, understand, and improve your data loop on one set of primitives, from your first recording to massive scale. Start with the SDK, or explore Rerun Hub.