JA_ACC SmartUQ_For Release.pdf

Control No: CAO-21-0008 Contractor: SmartUQ LLC

Program/Equipment: SmartUQ Pro Statistical Software

JUSTIFICATION REVIEW DOCUMENT

FAR SUBPART 13.5 SIMPLIFIED PROCEDURES FOR CERTAIN COMMERCIAL

ITEMS – SOLE SOURCE JUSTIFICATION AND APPROVAL

Program/Equipment: SmartUQ Pro statistical software licenses for Combat Capabilities Development Command (CCDC) Armament Center engineers and statisticians to include paid-up-front renewal and upgrade years.

Authority: Simplified Procedures for Certain Commercial Items, 41 U.S.C. as implemented by FAR Subpart 13.5.

Amount: $573,230.00

Prepared by: Douglas Ray DSN: 880-4347 Senior Statistician Date: 03 Aug 2020 Email: douglas.m.ray.civ@mail.mil

Contracting Officer: David S. Gordon DSN: 880-6093 Contracting Officer Date: 30 Sep 2020 Email: david.s.gordon26.civ@mail.mil

Technical: Douglas Ray DSN: 880-4347 Senior Statistician Date: 03 Aug 2020 Email: liam.e.buckley.civ@mail.mil

Requirements: Liam Buckley DSN: 880-7506 Chief, System Analysis Division Date: 03 Aug 2020 Email: liam.e.buckley.civ@mail.mil

Reviews: I have reviewed this justification and find it adequate to support sole source.

Program Manager:

Typed Name: Liam Buckley

DSN: 880-7506

Signature: Liam Buckley Date: 03 Aug 2020

Control No: CAO-21-0008 Contractor: SmartUQ LLC

Program/Equipment: SmartUQ Pro Statistical Software

Legal Counsel:

Typed Name: Brendan Sullivan

DSN: 880-8408

Signature: xxxxxxxxxxxxxx Date: 04 Aug 2020

Branch Chief:

Typed Name: Elizabeth A. Horak

DSN: 880-5369

Date: 30 Sept 2020

Division Chief:

Typed Name: Frank Kosker

DSN: 880-7660

Date: 13 October 2020

FAR Subpart 13.5 Simplified Procedures for Certain Commercial Items – Sole

Source Justification and Approval

1. Contracting Activity: U.S. Army Contracting Command - New Jersey, Joint Armaments Division

2. Description of Action: Combat Capabilities Development Command (CCDC) Armament Center requests a Firm Fixed Price (FFP) purchase order with SmartUQ, LLC 3545 University Ave, Madison, WI 53705 (608) 255-2440, for SmartUQ Statistical Software purchase. The Government projects award for October 2020 and fiscal year 2021, RDTE funds will be used.

An acquisition plan is not required because this procurement does not meet the threshold at Defense Federal Acquisition Regulation Supplement 207.103(d)(i)(B).

approved an acquisition plan in accordance with DFARS 207.103(d)(i)(B) on The required acquisition plan in accordance with DFARS 207.103(d)(i)(B) is currently awaiting approval.

3. Description of Supplies/Services: The contractor shall provide licenses for 13 copies of SmartUQ Pro statistical software, along with technical support. This access shall be available continuously without interruption. The contractor shall also provide their standard level of customer support to the Government. The requirement includes option years for renewals and upgrades as listed below.

Base Period: October 2020 to October 2021 $318,461.00

Option 1: October 2021 to October 2022 $63,692.25

Option 2: October 2022 to October 2023 $63,692.25

Option 3: October 2023 to October 2024 $63,692.25

Option 4: October 2024 to October 2025 $63,692.25

Total: $573,230.00

4. Authority Cited: Simplified Procedures for Certain Commercial Items, 41 U.S.C. 1901 (or 41 U.S.C. 1903 for Special Emergency Procurement) as implemented by FAR Subpart 13.5:

Unusual and compelling urgency

Exclusive licensing agreements Industrial mobilization Other: Brand Name

5. Reason for Authority Cited:

This requirement must be accomplished through a sole source solution. The authority as noted above applies because there is no other brand of statistical software available to meet CCDC Armament Center requirements and no other brand can be modified to meet those requirements. SmartUQ, is made by SmartUQ, LLC and is currently the sole authorized reseller of annual licenses for current versions of SmartUQ Statistical Software. No other commercial corporation other than SmartUQ, LLC offers SmartUQ brand statistical software.

SmartUQ was found to be the only software to offer the unique features necessary for CCDC Armament Center workforce implementation of a wide variety of uncertainty quantification techniques for their mission requirements. These features include, but are not limited to, design of experiments for deterministic and/or low noise computer simulations, emulation of computationally intensive models, statistical model calibration, sensitivity analysis, uncertainty propagation, and inverse analysis.

Other software brands such as “Minitab” and “Design Expert” offer statistical software;

however, they do not include design of experiments for deterministic and/or low noise computer simulations, emulation of computationally intensive models, statistical model calibration, sensitivity analysis, uncertainty propagation, and inverse analysis options.

This software is purchased commercially and will be utilized as is out of the box. None of the other statistical software researched such as, Minitab Design Expert offer the ability to modify its software to meet the Government’s needs.

SmartUQ’s unique features, such as engineering statistical analysis, design of experiments, and uncertainty quantification activities, have been used in the past by CCDC Armament Center. Generally speaking, SmartUQ is widely used to design efficient statistically sound modeling and simulation experiments within the test and evaluation community, and has seen broad success when used by CCDC-AC statisticians in the past. By continuing to buy this particular brand of software, it will enable CCDC Armaments Center analysts to more effectively utilize and gain useful information from complex modeling and simulation experimentation. This will save the government significant cost in physical testing as well as reduce schedule and program risk when making design decisions. The software will be used by CCDC Armament initially for project work associated with the Extended Range Cannon Artillery (ERCA) II but will also be broadly applicable across multiple commodities and programs, as well as in-house training.

6. Efforts to Obtain Competition: As described in the Market Research section below, the Market was surveyed to determine what COTS software was available that could meet the Government’s requirements. The possibility of modifying COTS software was considered as an alternative. The results indicated that SmartUQ is currently the only available Software that meets the Governments requirements, and that other software could not be modified.

The Contracting Officer shall publish the notices required by FAR 5.201.

7. Actions to Increase Competition: The Government will continue to monitor the commercial market to determine if an alternate manufacture’s software can better meet the Government’s requirements, or if any authorized resellers emerge that offer SmartUQ.. If the SmartUQ software is no longer optimal to satisfy CCDC Armament Center’s needs, the Government will seek competition to the maximum extent.

8. Market Research: The requiring activity conducted market research on 30APR2019 through 31DEC2019 which included (but was not limited to) internet searches, contacting knowledgeable people (Government and industry) in specific markets, queried government databases, reviewed results of recent market research on similar requirements, and reviewed Federal Supply Schedule contracts, and other Government contracts (including CHESS).

SmartUQ, LLC is the only vendor found that supplies SmartUQ software and support.

Other statistical software packages such as JMP, Minitab, and Design Expert were reviewed and do not contain the design of experiments for deterministic and/or low noise computer simulations, emulation of computationally intensive models, statistical model calibration, sensitivity analysis, uncertainty propagation, and inverse analysis options that are offered by Smart UQ.

The alternative statistical software that is available does not have all the features required by the CCDC Amament’s Center. SmartUQ is a commercial software that does not have a technical data package. It does not make sense for the Government to try to re-create this commercially available software utilizing in house personnel. This software is a new requirement; therefore, there is no “replace” vs.”upgrade” trade-offs.

Without having the SmartUQ software, the ERCA II program will be unable to perform the statistical analysis required for program success. This program is in the early Research & Development phases and without having use of the SmartUQ software and all its analytical options available, it could potentially lead to incorrect program decisions which will increase program costs and increase the risk of mission failure.

9. Interested Sources: To date, no other sources have written to express interest in the acquisition.

10. Other Facts: N/A

11. Technical Certification: I certify that the supporting data under my cognizance which are included in the justification are accurate and complete to the best of my knowledge and belief.

Typed Name: Douglas Ray Date: 3 Aug 2020 Title: Senior Statistician Signature: Douglas Ray

12. Requirements Certification: I certify that the supporting data under my cognizance which are included in the justification are accurate and complete to the best of my knowledge and belief.

Typed Name: Liam Buckley Date: 3 Aug 2020 Title: Chief, System Analysis Division Signature: Liam Buckley

13. Fair and Reasonable Cost Determination: I hereby determine that the anticipated cost or price to the Government for this contract action will be fair and reasonable.

This determination will be made using the following: price analysis cost analysis IGCE audit: other:

As a part of this basis, certified cost or pricing data is not required because the item and/or services being acquired are considered commercial.

Typed Name: David S. Gordon Date: 13 October 2020

Title: Contracting Officer Signature:

14. Contracting Officer Certification/Approval: I certify that this justification is accurate and complete to the best of my knowledge and belief.

Typed Name: David S. Gordon Date: 13 October 2020

Title: Contracting Officer Signature: