This $300,000 Project Grant was awarded by the National Science Foundation (NSF) under the Technology, Innovation, and Partnerships (TIP) program (CFDA 47.084) and is focused on developing an evaluation methodology for implementing large language model (LLM)-based tools to support human experts working in federal, state, and local government programs. The project aims to conduct a study that evaluates the trade-offs of using LLM-based tools, such as their cost, error rates, and impact on human experts, across a range of representative household and program scenarios. The evaluation will compare the performance of LLM-only, human-only, and human-LLM collaborative approaches measured by metrics like answer accuracy and response time. The goal is to provide decision-makers with a replicable framework and structured findings to assess whether LLMs should be adopted for specific use cases within public services. The project is being led by Georgetown University and may involve sub-awards to partner organizations.
Mod # | Description | Reason For Modification | Federal Obligation (Click to sort descending) | Date (Click to sort ascending) |
|---|---|---|---|---|
| Not listed | $0 | 11/13/24 | ||
| Not listed | $300.0k | 8/20/24 |