Project Grant 2427748

Award Date 10/1/24
Completion Date 3/31/26
Dollars Obligated $300K
Federal Grant Program
47.084
Assistance Type
Project Grant
Place of Performance
Washington, DC 20057, USA
Similar Awards
This $300,000 Project Grant award, funded by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program, supports research to develop improved evaluation concepts and methods for assessing and enhancing the performance of large language models (LLMs). The key objectives are to: Identify a taxonomy of "evaluation concepts" to pinpoint areas where LLMs are underperforming, such as lack of detail or format issues. Develop...
This Project Grant award from the National Science Foundation's (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) aims to improve the evaluation and functionality of large language models (LLMs). The key products and services to be delivered include: Identifying a concept taxonomy to assess areas where LLMs are failing, such as lacking detail in responses. 2) Developing reward models to automatically evaluate and improve LLM responses according to the identified...
This $400,000 federal Project Grant award was provided by the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program. The objective of the award is to leverage and evaluate large language models (LLMs) as "tools for thought" that can support creative, open-ended, and collaborative work across various applications such as scientific writing, text analysis, and design ideation. The key products and services to be developed and...
The National Science Foundation has awarded a $299,990 Project Grant to Columbia University to develop a prototype system using large language models to assist in the review process for releasing government records. The project aims to determine the additional data and training required to achieve acceptable levels of accuracy in using large language models to identify information that is already in the public domain, in order to streamline the document review process. The iterative system...
This $250,000 Project Grant award from the National Science Foundation's (NSF) Technology, Innovation, and Partnerships (TIP) program (CFDA 47.084) will fund a study on the ethical and financial trade-offs of machine learning (ML) training methods used to develop large language models (LLMs) like ChatGPT. The study, conducted by Georgia Tech Research Corp, will: 1) Identify current practices among researchers for training LLMs using large datasets; 2) Examine the trade-offs of different data...
This $256,800 Project Grant awarded by the National Science Foundation (NSF) under the Technology, Innovation, and Partnerships (TIP) program (CFDA 47.084) is funding the development of a holistic system for comprehensive student assessment. The goal is to leverage AI and natural language processing (NLP) tools to analyze diverse student learning data, including essays, written assignments, and reflections, to provide educators with real-time, detailed insights on student progress. This will...
This $100,000 Project Grant award from the National Science Foundation (NSF) Computer and Information Science and Engineering (CFDA 47.070) program aims to develop a holistic benchmarking infrastructure for evaluating large language models used in software engineering. The key activities include: Conducting surveys and interviews with the software engineering and machine learning research communities to gather requirements and understand barriers in evaluating large language models for code....
This Project Grant award from the National Science Foundation (NSF) under the Computer and Information Science and Engineering (CFDA 47.070) program will develop methods for using large language models (LMs) to apply existing written guidelines, such as grading rubrics or job listings, to decision-making tasks. The $245,862 award will create datasets and annotation tools to study how humans connect guidelines to input tasks, then develop LM prompting and fine-tuning techniques to generate...
This National Science Foundation (NSF) Computer and Information Science and Engineering (CISE) Federal Grant Program (CFDA 47.070) award of $799,999 to the University of Washington provides funding for a 4-year collaborative research project focused on developing tools and methods to leverage large language models (LLMs) in support of divergent, convergent, and cooperative work. The key objectives of the project are to: 1) Develop design guidance and workflows for building more reliable and...
This Project Grant award from the National Science Foundation (NSF) Computer and Information Science and Engineering (CISE) program (CFDA 47.070) aims to understand the effects of large language models (LLMs) on the work of online information professionals. The $370,692 award, which runs from June 2025 to May 2030, will develop models and tools to help these professionals assess and manage the risks posed by LLM-generated content, which can sometimes contain false or misleading information....

This $300,000 Project Grant was awarded by the National Science Foundation (NSF) under the Technology, Innovation, and Partnerships (TIP) program (CFDA 47.084) and is focused on developing an evaluation methodology for implementing large language model (LLM)-based tools to support human experts working in federal, state, and local government programs.

The project aims to conduct a study that evaluates the trade-offs of using LLM-based tools, such as their cost, error rates, and impact on human experts, across a range of representative household and program scenarios. The evaluation will compare the performance of LLM-only, human-only, and human-LLM collaborative approaches measured by metrics like answer accuracy and response time. The goal is to provide decision-makers with a replicable framework and structured findings to assess whether LLMs should be adopted for specific use cases within public services. The project is being led by Georgetown University and may involve sub-awards to partner organizations.

Generated 7/15/25, 1:48 AM