This Project Grant award of $525,000 from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program aims to significantly improve collective communication for distributed machine learning (ML) models running in cloud-based accelerator systems. The project will develop software tools and algorithms that optimize collective communication strategies based on measurements of the varying speeds and capacities of connections between accelerators in modern cloud data centers. This approach ensures customized, efficient collective communication for each ML deployment, whether within a single data center or across multiple centers. The project will also have broader impacts by reducing the energy consumption and operational costs associated with ML data centers, and by engaging with students to foster interest in science and technology. All research artifacts will be made publicly available on a dedicated project website to enable widespread adoption and community benefits.
Mod # | Description | Reason For Modification | Federal Obligation (Click to sort descending) | Date (Click to sort ascending) |
|---|---|---|---|---|
| Not listed | $525.0k | 7/11/25 |