This Project Grant award of $600,000 from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) supports research at the University of Central Florida (UCF) to develop software-hardware solutions that enable efficient inference of large AI foundation models on resource-limited computer systems. The key research thrusts include: 1) designing a sparsity-aware scheduling system to address data transfer bottlenecks between GPUs and...
This National Science Foundation (NSF) Project Grant award under the Computer and Information Science and Engineering (CFDA 47.070) program aims to develop software frameworks that can efficiently serve and deploy machine learning models for a variety of AI-powered applications. The $600,000 award, spanning from October 2024 to September 2027, tasks the prime awardee, Georgia Tech Research Corporation, with creating agile mechanisms and policies to serve a family of AI models across...
This Project Grant award of $360,000.00 from the National Science Foundation (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) to the Massachusetts Institute of Technology (MIT) aims to develop new methods for efficient, architecture-aware algorithms for large language models (LLMs). The goals are to make existing LLM applications more efficient, enable new applications, and broaden access to this transformative AI technology. The key focus areas include: (1)...
This Project Grant award of $270,000 from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program supports research to develop scalable simulation techniques and advanced memory management strategies for large-scale machine learning workloads on graphics processing units (GPUs). The key objectives are to enable faster and more efficient simulation of large machine learning models, which can take days or weeks using current methods, and to improve...
This Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program aims to advance artificial intelligence (AI) by investigating the mathematical foundations and practical applications of deep learning models. The $600,000 award, with a performance period from December 2024 to November 2027, will support research focused on understanding the properties of neural networks, the function spaces and data representations that emerge...
This $499,999 federal Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) will support collaborative research to investigate the theoretical foundations of compositional learning in large language models (LLMs) based on transformer architectures. The research aims to advance the understanding of how LLMs, such as GPT-4, LLAMA 2, and CLAUDE 3, can decompose complex tasks into simpler intermediate steps to...
This $400,000 Project Grant was awarded on July 1, 2024 by the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) Program (CFDA 47.070) to the Regents of the University of Michigan to conduct collaborative research on the theoretical foundations of compositional learning in large language models based on transformer architectures. The research aims to investigate three key areas: model expressivity, statistical learning theory, and optimization, with...
This Project Grant award, funded by the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070), provides $267,791 to the University of California, Merced to develop scalable simulation techniques and advanced memory management strategies for large-scale machine learning workloads on graphics processing units (GPUs). The research aims to address two key challenges in this domain: prolonged simulation times for large machine learning...
This $800,000 Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program supports a collaborative research project titled "MPI4AI: Enhancing Performance and Productivity of AI Science through Next-Generation High Performance Communication Abstractions." The project, which runs from September 2025 to August 2029, aims to improve how massively parallel computers run large-scale artificial intelligence (AI) applications...
This National Science Foundation (NSF) Project Grant award under the Computer and Information Science and Engineering (CISE) program, titled "COLLABORATIVE RESEARCH: CNS CORE: SMALL: A COMPILATION SYSTEM FOR MAPPING DEEP LEARNING MODELS TO TENSORIZED INSTRUCTIONS (DELITE)", provides $299,999 in funding to the University Of Georgia Research Foundation, Inc. over a 3-year period from October 1, 2023 through September 30, 2026. The grant supports the development of a compilation system...