This session is worth the wait.
We’re getting the recording ready. Check back soon to watch the full session.

Keynote | Rethinking AI Infrastructure

AI Infrastructure

Model Training

Arcee AI’s Gerred Dillon shares lessons from operating AI compute at scale and explains how training and inference are reshaping infrastructure.

Keynote | Rethinking AI Infrastructure

Keynote | Rethinking AI Infrastructure

AI Infrastructure

Model Training

Arcee AI’s Gerred Dillon shares lessons from operating AI compute at scale and explains how training and inference are reshaping infrastructure.

Thank you! Your recording is ready.

Your submission was successful. The video will appear in a moment.

Gerred Dillon
Head of Compute
Arcee AI

About This Talk

Modern AI Workloads are exposing gaps in the infrastructure built to run them.

Cloud infrastructure was designed to treat compute as an interchangeable resource. That model works well for many applications, but it becomes less reliable when the workload depends on the placement of thousands of accelerators, the shape of the network connecting them, and fast access to enormous volumes of data.

At Arcee AI, Gerred Dillon works across the infrastructure used to train and serve open-weight models. In this closing keynote, he’ll share what that experience has revealed about operating AI compute at scale. He’ll look at how different workloads place different demands on the same fleet, why hardware specifications reveal only part of a cluster’s capacity, and where conventional measures of efficiency begin to lose meaning.

AI infrastructure is becoming more specialized because the work itself is becoming harder to abstract. The next generation of systems will need a clear-eyed view of this imminent future.

About The Speaker

Gerred Dillon

Gerred leads infrastructure and research compute at Arcee AI, building the systems that turn AI research into reliable products. His 16 years of experience spans large scale distributed computing, training, inference and cloud infrastructure, with a focus on making complex systems dependable and easy to use.

Transcript

Show transcriptHide transcript

Related recordings

Welcome: What Will AI Dream Next?

Chang She
•
Keynote
opening-keynote-what-will-ai-dream-next

AI Research

Multimodal Data

AI Infrastructure

Cosmos: Omnimodal World Models for Physical AI

Max Li
•
Session
cosmos-omnimodal-world-models-for-physical-ai

Physical AI

Multimodal Data

Model Training

Building the Data Flywheel for Frontier AI Model

Suqiang (Jack) Song
•
Session
building-the-data-flywheel-for-frontier-ai-model

Data Curation

Model Training

Multimodal Data

From Raw Driving Logs to RL Training: A Petabyte-Scale Lance Pipeline in Production

Shiyan Xu
•
Session
from-raw-driving-logs-to-rl-training-a-petabyte-scale-lance-pipeline-in-production

Autonomous Driving

Data Curation

Model Training

From Raw Delivery to the Training Loop: Luma's Data Platform on Lance

Haoran Cai
•
Session
from-raw-delivery-to-the-training-loop-luma-s-data-platform-on-lance

Multimodal Data

Data Curation

Model Training

How Adobe Built a Multimodal Lakehouse for AI-Native Experiences

Miao Wang
Jiayao Hu
•
Session
how-adobe-built-a-multimodal-lakehouse-for-ai-native-experiences

Multimodal Data

AI Infrastructure

Search & Retrieval

Data Infrastructure for Robotics Foundation Models

Zhipeng Yan
•
Session
data-infrastructure-for-robotics-foundation-models

Physical AI

AI Infrastructure

Model Training

What Does "Now" Mean to Your Model? Time Alignment for Multimodal AI Data

Vasundra Srinivasan
•
Session
what-does-now-mean-to-your-model

Multimodal Data

Physical AI

Model Training

Managing an Index of 100s of Billions of Pages With Exa Skeleton

Jan van der Vegt
•
Session
managing-an-index-of-100s-of-billions-of-pages-with-exa-skeleton

Search & Retrieval

AI Infrastructure

Scaling the Data Foundation for XPENG's VLA 2.0

Bo Tian
•
Session
scaling-the-data-foundation-for-xpengs-vla-2-0

Autonomous Driving

Model Training

Data Curation

Keynote | Rethinking AI Infrastructure

Gerred Dillon
•
Keynote
rethinking-ai-infrastructure

AI Infrastructure

Model Training