This National Science Foundation (NSF) CISE Federal Grant Award (CFDA 47.070) in the amount of $200,000 will fund a collaborative research project between U.S. and Indian researchers to develop energy-efficient computation and communication methods for large language models (LLMs). The project aims to enhance the efficiency of training and inference for LLMs, which are crucial for advanced AI applications but are energy-intensive. By leveraging emerging high-speed networks and Compute Express Link (CXL)-enabled hardware, the researchers will seek to identify sources of idleness in LLM workloads and implement dynamic voltage and frequency scaling, as well as energy-efficient communication runtimes, to reduce the static and dynamic power consumption of LLM operations. The project outcomes are expected to enable a broad range of LLMs to operate efficiently, advancing AI applications at a lower energy cost, while also strengthening international research collaboration and providing educational opportunities for graduate students.
Mod # | Description | Reason For Modification | Federal Obligation (Click to sort descending) | Date (Click to sort ascending) |
|---|---|---|---|---|
| Not listed | $200.0k | 8/26/24 |