esc
Start typing to search the docs
Menu

Datasets

60 datasets

Robot learning and manipulation

Trajectories, demonstrations, and embodied observations for training and evaluating robot policies.

Robot and scene observations visualized together in Rerun
DROID
Large-scale, in-the-wild robot manipulation demonstrations collected across many environments and tasks.
View DROID
Articulated robot visualization in Rerun
LeRobot datasets
A growing collection and tooling ecosystem for sharing real and simulated robot learning data.
View LeRobot datasets
RGB and 3D observations shown in Rerun
BridgeData V2
A broad collection of robot manipulation trajectories spanning tasks, objects, and environments.
View BridgeData V2
Multiple synchronized data views in Rerun
Open X-Embodiment
A large cross-embodiment collection assembled to study generalist robot policies across institutions and hardware.
View Open X-Embodiment
CALVIN data represented in a multimodal Rerun visualization
CALVIN
Long-horizon language-conditioned robot manipulation sequences in a simulated kitchen environment.
View CALVIN
RoboNet data represented in a multimodal Rerun visualization
RoboNet
Robot interaction videos collected across different platforms, viewpoints, and laboratory environments.
View RoboNet
RT-1 dataset data represented in a multimodal Rerun visualization
RT-1 dataset
Real robot episodes used to study large-scale, language-conditioned robotic control.
View RT-1 dataset
BC-Z data represented in a multimodal Rerun visualization
BC-Z
Language and video-conditioned robot demonstrations for zero-shot task generalization.
View BC-Z
RoboSet data represented in a multimodal Rerun visualization
RoboSet
A multimodal collection of robot demonstrations designed for broad manipulation research.
View RoboSet
ManiSkill2 data represented in a multimodal Rerun visualization
ManiSkill2
Simulation environments and demonstrations for generalizable robotic manipulation skills.
View ManiSkill2
robomimic datasets data represented in a multimodal Rerun visualization
robomimic datasets
Robot demonstration datasets and benchmarks for studying imitation learning methods.
View robomimic datasets
RLBench data represented in a multimodal Rerun visualization
RLBench
A large benchmark of simulated robot manipulation tasks with demonstrations and rich observations.
View RLBench
FurnitureBench data represented in a multimodal Rerun visualization
FurnitureBench
Long-horizon furniture assembly tasks for evaluating real-world robot manipulation.
View FurnitureBench
BEHAVIOR-1K data represented in a multimodal Rerun visualization
BEHAVIOR-1K
A benchmark of everyday household activities in interactive simulated environments.
View BEHAVIOR-1K
RoboCasa data represented in a multimodal Rerun visualization
RoboCasa
Large-scale kitchen simulation environments and demonstrations for everyday manipulation.
View RoboCasa
RH20T data represented in a multimodal Rerun visualization
RH20T
A multimodal robot manipulation dataset with force, audio, vision, and action observations.
View RH20T
DexYCB data represented in a multimodal Rerun visualization
DexYCB
Hand-object manipulation captures with synchronized RGB-D views and pose annotations.
View DexYCB
HOI4D data represented in a multimodal Rerun visualization
HOI4D
Egocentric RGB-D videos of human-object interactions with detailed 3D annotations.
View HOI4D
LIBERO data represented in a multimodal Rerun visualization
LIBERO
A benchmark and demonstration suite for lifelong learning in robot manipulation.
View LIBERO
RoboTurk data represented in a multimodal Rerun visualization
RoboTurk
Crowdsourced robot manipulation demonstrations collected through remote teleoperation.
View RoboTurk

Autonomy and navigation

Multisensor driving and navigation data for perception, mapping, prediction, and planning.

nuScenes camera and lidar data visualized in Rerun
nuScenes
A multimodal autonomous-driving dataset with synchronized cameras, lidar, radar, maps, and annotations.
View nuScenes
A reconstructed outdoor scene visualized in Rerun
Waymo Open Dataset
Large-scale autonomous-driving data spanning perception, motion, maps, and end-to-end driving research.
View Waymo Open Dataset
Camera trajectory and reconstructed geometry shown in Rerun
KITTI Odometry
A foundational driving benchmark for visual odometry, stereo, optical flow, and 3D perception.
View KITTI Odometry
A spatial reconstruction viewed in Rerun
TartanAir
Synthetic, photo-realistic trajectories with challenging motion and environment conditions for visual SLAM research.
View TartanAir
Argoverse 2 data represented in a multimodal Rerun visualization
Argoverse 2
Sensor, map, and motion forecasting datasets centered on autonomous driving in multiple cities.
View Argoverse 2
PandaSet data represented in a multimodal Rerun visualization
PandaSet
Autonomous-driving sequences with lidar, camera, semantic segmentation, and cuboid annotations.
View PandaSet
Audi A2D2 data represented in a multimodal Rerun visualization
Audi A2D2
Camera and lidar driving data with semantic labels captured across varied road conditions.
View Audi A2D2
Cityscapes data represented in a multimodal Rerun visualization
Cityscapes
Street-scene images with fine semantic and instance annotations from cities across Europe.
View Cityscapes
BDD100K data represented in a multimodal Rerun visualization
BDD100K
A diverse driving video dataset supporting detection, lane, tracking, and segmentation tasks.
View BDD100K
SemanticKITTI data represented in a multimodal Rerun visualization
SemanticKITTI
Point-wise semantic labels for the lidar sequences of the KITTI Odometry benchmark.
View SemanticKITTI
Oxford RobotCar data represented in a multimodal Rerun visualization
Oxford RobotCar
Repeated autonomous-vehicle traversals through Oxford across weather, traffic, and seasonal change.
View Oxford RobotCar
Boreas data represented in a multimodal Rerun visualization
Boreas
Long-term driving sequences with lidar, radar, cameras, and precise localization across seasons.
View Boreas
NCLT data represented in a multimodal Rerun visualization
NCLT
Long-term campus robot traversals with lidar, cameras, odometry, GPS, and inertial sensing.
View NCLT
MulRan data represented in a multimodal Rerun visualization
MulRan
Radar and lidar sequences for place recognition and localization in changing urban environments.
View MulRan
ApolloScape data represented in a multimodal Rerun visualization
ApolloScape
Large-scale street-scene data for semantic perception, localization, and trajectory prediction.
View ApolloScape
nuPlan data represented in a multimodal Rerun visualization
nuPlan
A driving planning benchmark with real scenarios, maps, agents, and closed-loop evaluation tooling.
View nuPlan
ONCE data represented in a multimodal Rerun visualization
ONCE
Large-scale autonomous-driving scenes with lidar, cameras, and 3D object annotations.
View ONCE
Zenseact Open Dataset data represented in a multimodal Rerun visualization
Zenseact Open Dataset
Diverse European road data for perception, localization, and autonomous-driving research.
View Zenseact Open Dataset
DAIR-V2X data represented in a multimodal Rerun visualization
DAIR-V2X
Vehicle and roadside cooperative perception data for connected autonomous systems.
View DAIR-V2X

Spatial intelligence

3D scenes, calibrated cameras, depth, and human activity for understanding the physical world.

ARKitScenes room capture with camera and geometry views in Rerun
ARKitScenes
Indoor RGB-D captures with camera trajectories, reconstructed geometry, and scene annotations.
View ARKitScenes
Tracked objects and detections visualized in Rerun
Objectron
Object-centric videos with 3D bounding boxes for understanding everyday objects in real scenes.
View Objectron
RGB-D point cloud and image data displayed in Rerun
TUM RGB-D
Synchronized RGB-D sequences and ground-truth trajectories for evaluating visual odometry and SLAM.
View TUM RGB-D
Multiple camera observations arranged around a 3D scene in Rerun
Ego-Exo4D
Synchronized first-person and external-camera recordings of skilled human activities with rich annotations.
View Ego-Exo4D
ScanNet data represented in a multimodal Rerun visualization
ScanNet
RGB-D scans of indoor environments with camera poses, surfaces, and semantic annotations.
View ScanNet
ScanNet++ data represented in a multimodal Rerun visualization
ScanNet++
High-fidelity indoor scene captures with DSLR images, depth, geometry, and semantic labels.
View ScanNet++
Matterport3D data represented in a multimodal Rerun visualization
Matterport3D
Panoramic RGB-D scans and reconstructed geometry from large indoor building environments.
View Matterport3D
Replica data represented in a multimodal Rerun visualization
Replica
High-quality reconstructions of indoor spaces for simulation and embodied AI research.
View Replica
Hypersim data represented in a multimodal Rerun visualization
Hypersim
Photorealistic synthetic indoor scenes with dense geometry, material, lighting, and semantic ground truth.
View Hypersim
SUN RGB-D data represented in a multimodal Rerun visualization
SUN RGB-D
Single-view RGB-D images of indoor scenes with 2D and 3D semantic annotations.
View SUN RGB-D
NYU Depth V2 data represented in a multimodal Rerun visualization
NYU Depth V2
Indoor RGB-D video and labeled frames captured with a commodity depth camera.
View NYU Depth V2
MegaDepth data represented in a multimodal Rerun visualization
MegaDepth
Internet photo collections paired with reconstructed depth and camera geometry.
View MegaDepth
Common Objects in 3D data represented in a multimodal Rerun visualization
Common Objects in 3D
Object-centric videos with camera poses and point clouds across many everyday categories.
View Common Objects in 3D
Objaverse data represented in a multimodal Rerun visualization
Objaverse
A large corpus of annotated 3D objects assembled for vision and generative-model research.
View Objaverse
ShapeNet data represented in a multimodal Rerun visualization
ShapeNet
A deeply annotated collection of 3D CAD models organized across object categories.
View ShapeNet
3D-FRONT data represented in a multimodal Rerun visualization
3D-FRONT
Furnished indoor scenes with layouts, object models, and professionally designed room arrangements.
View 3D-FRONT
Project Aria datasets data represented in a multimodal Rerun visualization
Project Aria datasets
Egocentric sensor recordings with cameras, audio, motion, eye gaze, and spatial trajectories.
View Project Aria datasets
Ego4D data represented in a multimodal Rerun visualization
Ego4D
A large collection of first-person video capturing daily activities across many locations and participants.
View Ego4D
AMASS data represented in a multimodal Rerun visualization
AMASS
A unified collection of human motion-capture datasets represented with a common body model.
View AMASS