Project Grant 2433071

Award Date 7/1/25
Completion Date 6/30/28
Dollars Obligated $300K
Federal Grant Program
47.070
Assistance Type
Project Grant
Place of Performance
Austin, TX 78712, USA
Similar Awards
This Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) aims to improve the evaluation and functionality of large language models (LLMs). The key products and services to be delivered include: Identifying a concept taxonomy to assess areas where LLMs are failing, such as lacking detail in responses. 2) Developing reward models to automatically evaluate and improve LLM responses according to the identified...
This $300,000 Project Grant was awarded by the National Science Foundation (NSF) under the Technology, Innovation, and Partnerships (TIP) program (CFDA 47.084) and is focused on developing an evaluation methodology for implementing large language model (LLM)-based tools to support human experts working in federal, state, and local government programs. The project aims to conduct a study that evaluates the trade-offs of using LLM-based tools, such as their cost, error rates, and impact on human...
This $100,000 Project Grant award from the National Science Foundation (NSF) Computer and Information Science and Engineering (CFDA 47.070) program aims to develop a holistic benchmarking infrastructure for evaluating large language models used in software engineering. The key activities include: Conducting surveys and interviews with the software engineering and machine learning research communities to gather requirements and understand barriers in evaluating large language models for code....
This $400,000 federal Project Grant award was provided by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program. The objective of the award is to leverage and evaluate large language models (LLMs) as "tools for thought" that can support creative, open-ended, and collaborative work across various applications such as scientific writing, text analysis, and design ideation. The key products and services to be developed and...
This three-year $800,000 project grant from the National Science Foundation's Computer and Information Science and Engineering program aims to advance understanding of large language models through mathematical and conceptual analysis. The Trustees of Princeton University will receive funding to develop simplified generative text models, analyze how language models are trained on such generated texts, examine why learned models can perform downstream tasks, and design new adaptation methods with...
This Project Grant award, valued at $348,227.00, was provided by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program. The award aims to improve the scalability and effectiveness of healthcare-focused large language models (LLMs) by developing methods to evaluate and mitigate issues with incomplete data. The key products and services to be delivered include: An evaluation framework to address factual and faithfulness...
This Project Grant award from the National Science Foundation (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) aims to understand the effects of large language models (LLMs) on the work of online information professionals. The $370,692 award, which runs from June 2025 to May 2030, will develop models and tools to help these professionals assess and manage the risks posed by LLM-generated content, which can sometimes contain false or misleading information....
This Project Grant award of $174,999 from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) will fund a unified, large language model (LLM)-empowered framework to systematically address software performance challenges. The key products and services to be delivered under this 2-year award (05/01/2025 - 04/30/2027) include: Advancing automation in performance testing, issue localization, and optimization for modern software...
This National Science Foundation (NSF) $900,000 "COLLABORATIVE RESEARCH: SHF: MEDIUM: NATURAL LANGUAGE MODELS WITH EXECUTION DATA FOR SOFTWARE TESTING" Project Grant, awarded under the Computer and Information Science and Engineering program (CFDA 47.070), aims to develop natural language processing (NLP) models to simplify the development and maintenance of software tests. Key objectives include test generation, completion, update, and migration across programming languages, targeting...
This National Science Foundation (NSF) Computer and Information Science and Engineering (CISE) Federal Grant Program (CFDA 47.070) award of $360,000 to the Massachusetts Institute of Technology (MIT) aims to develop new efficient methods for large language models (LLMs) across their entire training and deployment pipeline. The key objectives are to: (1) create architectural primitives that overcome the computational inefficiencies of transformers, (2) develop efficient training algorithms to...

This $300,000 Project Grant award, funded by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program, supports research to develop improved evaluation concepts and methods for assessing and enhancing the performance of large language models (LLMs). The key objectives are to:

  1. Identify a taxonomy of "evaluation concepts" to pinpoint areas where LLMs are underperforming, such as lack of detail or format issues.

  2. Develop customized reward models based on LLMs to reliably score responses against these evaluation concepts.

  3. Use the reward models to curate training data and iteratively improve LLM responses to better align with the identified evaluation concepts.

The project, led by the University of Texas at Austin, aims to open-source the developed concept taxonomy and reward models to enable public assessment of LLM performance across applications and drive the open-source community to build more reliable LLM systems. The award period runs from July 1, 2025 to June 30, 2028.

Generated 7/15/25, 10:19 AM