This session is worth the wait.
We’re getting the recording ready. Check back soon to watch the full session.

Data Infrastructure for Robotics Foundation Models

Physical AI

AI Infrastructure

Model Training

Dyna’s Zhipeng Yan will break down the infrastructure changes that boosted robotics-data ingestion 31x, cut training startup from roughly 48 hours to under a minute, and sustained high GPU utilization across multi-node clusters.

Data Infrastructure for Robotics Foundation Models

Data Infrastructure for Robotics Foundation Models

Physical AI

AI Infrastructure

Model Training

Dyna’s Zhipeng Yan will break down the infrastructure changes that boosted robotics-data ingestion 31x, cut training startup from roughly 48 hours to under a minute, and sustained high GPU utilization across multi-node clusters.

Thank you! Your recording is ready.

Your submission was successful. The video will appear in a moment.

Zhipeng Yan
Lead of ML Infra
Dyna Robotics

About This Talk

Training robotics foundation models on a million hours of multimodal data is not simply a matter of adding more GPUs. The bottleneck continually moves across the system as datasets grow, pipelines become more dynamic, and training spans larger clusters.

This session explores the infrastructure behind Dyna-2, from robotics-native episode storage and large-scale ingestion to dataset curation, cluster-local caching, distributed training, and job resilience. It examines how targeted redesigns increased ingestion throughput by 31x, reduced training startup from roughly 48 hours to under a minute, and sustained high GPU utilization across multi-node clusters.

The session also shares recent progress using Lance as a unified data substrate for search, iterative data enrichment, and training, reducing the need to move or rematerialize data across separate systems. It looks ahead at the next set of infrastructure challenges as robotics datasets push toward greater scale and diversity, including tighter feedback loops between data collection and training, faster iteration on continuously evolving datasets, and infrastructure that can support increasingly multimodal, long-horizon foundation models.

About The Speaker

Zhipeng Yan

Zhipeng Yan is the ML Infrastructure Lead at Dyna Robotics, where he builds the platforms powering robotics foundation models and distributed training. Previously, he led the data platform team at Adobe Firefly. His work focuses on large-scale AI systems, multimodal data platforms, and turning ambitious AI research into reliable production technology.

Transcript

Show transcriptHide transcript

Related recordings

Welcome: What Will AI Dream Next?

Chang She
•
Keynote
opening-keynote-what-will-ai-dream-next

AI Research

Multimodal Data

AI Infrastructure

Cosmos: Omnimodal World Models for Physical AI

Max Li
•
Session
cosmos-omnimodal-world-models-for-physical-ai

Physical AI

Multimodal Data

Model Training

Building the Data Flywheel for Frontier AI Model

Suqiang (Jack) Song
•
Session
building-the-data-flywheel-for-frontier-ai-model

Data Curation

Model Training

Multimodal Data

From Raw Driving Logs to RL Training: A Petabyte-Scale Lance Pipeline in Production

Shiyan Xu
•
Session
from-raw-driving-logs-to-rl-training-a-petabyte-scale-lance-pipeline-in-production

Autonomous Driving

Data Curation

Model Training

From Raw Delivery to the Training Loop: Luma's Data Platform on Lance

Haoran Cai
•
Session
from-raw-delivery-to-the-training-loop-luma-s-data-platform-on-lance

Multimodal Data

Data Curation

Model Training

How Adobe Built a Multimodal Lakehouse for AI-Native Experiences

Miao Wang
Jiayao Hu
•
Session
how-adobe-built-a-multimodal-lakehouse-for-ai-native-experiences

Multimodal Data

AI Infrastructure

Search & Retrieval

Data Infrastructure for Robotics Foundation Models

Zhipeng Yan
•
Session
data-infrastructure-for-robotics-foundation-models

Physical AI

AI Infrastructure

Model Training

What Does "Now" Mean to Your Model? Time Alignment for Multimodal AI Data

Vasundra Srinivasan
•
Session
what-does-now-mean-to-your-model

Multimodal Data

Physical AI

Model Training

Managing an Index of 100s of Billions of Pages With Exa Skeleton

Jan van der Vegt
•
Session
managing-an-index-of-100s-of-billions-of-pages-with-exa-skeleton

Search & Retrieval

AI Infrastructure

Scaling the Data Foundation for XPENG's VLA 2.0

Bo Tian
•
Session
scaling-the-data-foundation-for-xpengs-vla-2-0

Autonomous Driving

Model Training

Data Curation

Keynote | Rethinking AI Infrastructure

Gerred Dillon
•
Keynote
rethinking-ai-infrastructure

AI Infrastructure

Model Training