RAG Approaches Annotations: Datasets for Developing and Testing BioGen RAG Appr
Closed Pre-Solicitation Posted
- Solicitation number
- 75N97024Q00072
- Agency
-
National Institute of Environmental Health Sciences
National Institutes of Health, Department of Health and Human Services
- Responses due
- Set-aside
- No set-aside
Opportunity facts
- NAICS code
- 541715 Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)
- Points of contact
Notice details come from SAM.gov. Updated .
About this opportunity
The National Institutes of Health (NIH) National Institute of Environmental Health Sciences is seeking to procure services related to "RAG Approaches Annotations: Datasets for Developing and Testing BioGen RAG Approaches." The purpose is to evaluate and verify the references attributed and the quality of Large Language Model (LLM)-generated answers for the CHiQA-RAG and MediQA-RAG projects, as well as evaluate the plain language adaptations of PubMed abstracts generated by LLMs for the CHiQA-RAG project. The evaluation will be based on specific criteria outlined in the draft Statement of Work (SOW), and the contract will be a firm-fixed price with a tentative period of performance from September 2, 2024 to October 4, 2024.
This is a pre-solicitation notice, and there is no set-aside designation. The agency is conducting market research to identify qualified sources, including small businesses, to support this requirement. The applicable NAICS code is 541715 - Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology), and the PSC code is AN13 - Health R&D Services; Health Care Services; Experimental Development. The total deliverables include 32,000 evaluations of LLM answers for CHiQA-RAG, 40,000 evaluations of LLM answers for MediQA-RAG, 400 evaluations of LLM plain language translations for medical terminology, and 400 evaluations of LLM plain language translations for abstracts.
Notice text
The purpose of this requirement is to procure RAG Approaches Annotations: Datasets for Developing and Testing BioGen RAG Approaches services.
Files
| File | Type | Posted |
|---|---|---|
| Draft_SOW_IRP_RAG_Approaches_Annotations_1.pdf | ||
| Sources_Sought_Notice_75N97024Q00072_1.pdf |
Similar open opportunities
On GovTribe
Work this opportunity
- Track it in your pipeline
- Find teaming partners
- Similar opportunities
- Ask GovTribe AI about this opportunity