Request for Information – Characterizing Large Language Model Biases, Threats and Vulnerabilities
Closed Pre-Solicitation Posted
- Solicitation number
- IARPA-RFI-23-03
- Agency
- Intelligence Advanced Research Projects Activity Office of the Director of National Intelligence
- Responses due
- Set-aside
- No set-aside
Opportunity facts
- NAICS code
- 541715 Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)
- PSC
- Not on record
- Place of performance
- Washington, District of Columbia 20511, United States
Notice details come from SAM.gov. Updated .
About this opportunity
The Office of the Director of National Intelligence is seeking information on characterizing vulnerabilities and threats that could impact the safe use of large language models (LLMs) by intelligence analysts. The aim is to elicit frameworks to categorize and characterize vulnerabilities and threats associated with LLM technologies, specifically in the context of their potential use in intelligence analysis. Responses to this Request for Information (RFI) are due by 5 p.m., Eastern Time, on 21 August, 2023.
Services and products to be provided:
- Framework for classifying and understanding the range of LLM threats and/or vulnerabilities.
- Specific descriptions of LLM threats and vulnerabilities not well-characterized by prior taxonomies.
- Novel methods to detect or mitigate threats to users posed by LLM vulnerabilities.
- Novel methods to quantify confidence in LLM outputs.
- Responses to the specific questions outlined in the RFI.
Notice text
IARPA is seeking information on established characterizations of vulnerabilities and threats that could impact the safe use of large language models (LLMs) by intelligence analysts. This RFI is issued for planning purposes only, and it does not constitute a formal solicitation for proposals or suggest the procurement of any material, data sets, etc. The following sections of this announcement contain details on the specific technology areas of interest, along with instructions for the submission of responses.
Submission Instructions to Respondents:
Responses to this RFI are due no later than 5 p.m., Eastern Time, on 21 August, 2023. All submissions must be electronically submitted to dni-iarpa-rfi-23-03@iarpa.gov as a PDF document. Inquiries to this RFI must be submitted to dni-iarpa-rfi-23-03@iarpa.gov. Do not send questions with proprietary content. No telephone inquiries will be accepted.
Files
| File | Type | Posted |
|---|---|---|
| IARPA-RFI--23-03_revised_08142023_FINAL C.pdf | ||
| IARPA-RFI- 23-03_FINAL C .pdf |
On GovTribe
Work this opportunity
- Track it in your pipeline
- Find teaming partners
- Similar opportunities
- Ask GovTribe AI about this opportunity