Event Details
The rapid adoption of artificial intelligence (AI) in scientific research has amplified the reliance on high-performance computing (HPC) systems to process large datasets, perform simulations, and train deep
Event Details
The rapid adoption of artificial intelligence (AI) in scientific research has amplified the reliance on high-performance computing (HPC) systems to process large datasets, perform simulations, and train deep neural networks (DNNs). However, many researchers face challenges in effectively utilizing HPC resources, leading to inefficiencies such as underutilized CPUs, GPUs, and memory, as well as frequent out-of-memory (OOM) errors during model training. These issues often stem from a need for more understanding of requesting and allocating HPC resources tailored to specific AI workflows.
This short talk draws from my six years of research experience, including my work with the NSF-funded ICICLE project, where we developed resource provisioning software for AI-driven scientific computing. Through this work, I have gained extensive experience with major HPC centers such as the Ohio Supercomputer Center (OSC) and the Texas Advanced Computing Center (TACC). The talk provides actionable insights to help researchers optimize resource usage, including tailoring allocations for different phases of the AI lifecycle, leveraging HPC gateways like OnDemand, tuning resource configurations to meet workload requirements, and selecting suitable GPU types and memory allocations. Additionally, the talk highlights resources like the National Artificial Intelligence Research Resource (NAAIRR), which offers access to computing resources for running AI workloads. By enhancing understanding of HPC resource management and showcasing available tools and opportunities, this talk aims to reduce inefficiencies, minimize allocation wait times, and foster more effective scientific innovation while empowering researchers to maximize their use of HPC systems and resources.
more
Time
(Saturday) 10:40 am – 10:50 am
Location
Clover