Benchmarks for evaluating adversarial ML robustness a systematic construction of adaptive evaluations for ML systems
Other Transaction IDV Awarded Last action
- Contract number
- HR00112190011
- Awardee
-
Carahsoft Technology Corp UEI DT8KJHZXVJH5
- Awarding agency
-
Defense Advanced Research Projects Agency
Department of Defense
- Task orders
- 0
Award facts
- Last date to order
- Not on record
- IDV ceiling
- $1,742,400.00
- NAICS code
- Not on record
- Set-aside
- No set-aside
- Competition
- Competed Broad Agency Announcement
- Pricing
- Other
Award details come from SAM.gov/FPDS.
About this IDV
Carahsoft Technology Corp was awarded an Other Transaction IDV by the Defense Advanced Research Projects Agency on February 3, 2021. The potential value of the IDV is $1,742,400.00.
The IDV aims to procure benchmarks for evaluating the robustness of adversarial machine learning systems. Specifically, the IDV seeks to systematically construct adaptive evaluations for machine learning systems to test their performance under adversarial conditions. As the funding agency, the Defense Advanced Research Projects Agency supports research developing new technologies for national security, including in the area of artificial intelligence assurance.
Given the agency and scope of work, the IDV likely aims to develop methods for evaluating machine learning models deployed for defense and security purposes, such as perceptual systems, to ensure they maintain acceptable performance when exposed to adversarial examples or distribution shifts intentionally designed to degrade functionality. The benchmarks and evaluations constructed under associated task orders would then allow ongoing testing of these models to maintain assurance levels over time as techniques evolve. Carahsoft Technology Corp will serve as the prime contractor delivering the required products and services over the period of performance.
Transactions
| Action | Obligated | Date |
|---|---|---|
| Funding Only Action | $217,800 | |
| Funding Only Action | $217,800 | |
| Other Administrative Action | $0 | |
| Funding Only Action | $217,800 | |
| Exercise an Option | $217,800 | |
| Funding Only Action | $435,600 | |
| Original award | $435,600 |
Quick answers
Who was awarded contract HR00112190011?
HR00112190011 was awarded to Carahsoft Technology Corp by Defense Advanced Research Projects Agency (Department of Defense) on February 3, 2021.
How much is contract HR00112190011 worth?
HR00112190011's own ceiling is $1,742,400.
Was contract HR00112190011 competed?
The extent of competition for HR00112190011 was competed.
On GovTribe
See this IDV's full record
- Every order and transaction
- The awardee's other awards and teaming partners
- Similar IDVs and recompete opportunities
- Ask GovTribe AI about this IDV