Sam Foreman
Computational Scientist
Actions
Sam Foreman is an Assistant Computational Scientist at Argonne National Laboratory's Leadership Computing Facility. He works on scaling AI workloads on Aurora and contributes to AuroraGPT and the torchtitan/ezpz training stack. His background spans HPC/AI co-design, large-scale ML training, and lattice QCD. He maintains ezpz, a portable launcher for distributed PyTorch training that runs on Intel, NVIDIA, and AMD across PBS and Slurm sites.
https://samf.sh
Meet the Developers of DeepSpeed
Join PyTorch experts for an interactive “Meet the Developers” session – a chance to learn in a small group setting and ask your most pressing questions. No sign-up required – just drop in and get real answers from the people building the tools.
Scaling PyTorch on Intel XPU: Field Notes from AI for Science on Aurora
Bringing a new accelerator up as a first-class PyTorch backend at scale takes more than vendor patches. It requires reproducible benchmarking, portable training code, and operational machinery that survives long-running jobs. This lightning talk shares experiences from training scientific foundation models in production on 63K+ XPUs on ALCF's Aurora system.
We cover three things:
- What was needed: the XPU integration path (torch.xpu, the IPEX-to-xccl transition, distributed primitives, collective tuning) and the cross-vendor abstractions that let identical training code run on Intel, NVIDIA, and AMD hardware.
- What was accomplished: migrating our production training stack from a Megatron-DeepSpeed fork to torchtitan + DTensor + FSDP2, with optimization and testing at every layer; from fused kernels and collectives up through distributed orchestration.
- What remains: fused kernels, async checkpointing, fault tolerance, and the operational layer long jobs require (silent-hang detection, bad-node failover, layered restart loops), plus what the next accelerator team should expect.
The takeaway: Patterns for anyone running PyTorch at scale on a new accelerator.
https://samf.sh/talks/2026/10/21/
PyTorch Conference North America 2026 Sessionize Event
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top