Attachment.1.PWS.Data_Collect_and_Test_Execution.PDF

PEFORMANCE WORK STATEMENT (PWS)

Transformational and Applied Research Technology Characterization Support

1. BACKGROUND

The Domestic Nuclear Detection Office (DNDO) is charged with the development of Global Nuclear Detection Architecture (GNDA) methods and capabilities to protect the nation from radiological and nuclear attack. DNDO will conduct data collections in the areas of radiation health and safety as well as technology characterization and detection performance for newly developed radiation detection and support systems to investigate their performance against an array of threats including radiological and Special Nuclear Material (SNM), i.e., fissile threats. These system characterizations will be conducted in simulated and actual operational environments, at Government facilities, and at vendor facilities. These systems have the potential to improve detection and identification of radiological and SNM threats which would be an important technological addition to homeland defense.

This PWS outlines the tasks which will be provided to implement the characterization of prototype systems developed to improve the capability to detect radiological and nuclear material, including algorithms and support systems. The tasks will be managed by the Domestic Nuclear Detection Office, Transformational and Applied Research Directorate

(TAR).

1.1. PURPOSE

This PWS defines the work that will be done to conduct prototype radiological and nuclear material detection and support system characterizations. The intent of the characterization is to determine the performance, effectiveness, and utility of the developmental prototype systems for the detection of radiological and SNM materials in simulated operational and actual operational environments. Characterization results will support objective appraisals of the likelihood of successful integration of a developmental detection technology into future security concepts of operation (CONOPS) for detection of radiological and SNM threats.

1.2. SCOPE

Government characterization of prototype performance test units (PTU) developed as a result of DNDO TAR funded Advanced Technology Demonstration (ATD) and higher technology readiness level (TRL) exploratory research projects will collect data needed to calculate individual performance metrics and measures for each system. These can then be used for comparing the potential benefits of the disparate technologies and for identifying current strengths and weaknesses of each technology which will facilitate future development.

Characterization plans will be used to detail and prescribe the test elements and test conduct necessary to produce valid results with defined levels of confidence. The characterization plan for each project will address objectives, means, methods, and procedures for collection and securing the data collected during the characterization events and for documenting event activities and observations.

Data collected from the characterization events will be used to assess the capabilities of the developmental radiological and nuclear material detection technologies based upon the measures of effectiveness calculated form the data collected. Trained vendor personnel or trained government personnel may operate the developmental systems during the characterizations. Designated government, national laboratory, and contractor technical staff will perform data recording and data assessment functions.

2. ASSUMPTIONS

The characterization plans shall be developed by the DNDO Transformational and Applied Research Directorate with support from the national laboratories and contractors not associated with the contractors developing the technologies being characterized. The plans will describe how to measure the detection performance of the developmental PTU against different test variables. The characterization plan shall also specify the number of test samples required to provide high confidence in the results. A characterization execution plan will describe the test configurations called out in the characterization plan.

The characterization execution plan will be developed and will include estimates of the length of time to conduct the various scenarios described in the characterization plan.

3. Additional Requirement

The contractor must possess an active US Nuclear Regulatory Commission issued 10CFR70 Material License authorizing the contractor to possess and handle Category III quantities of Special Nuclear Material (SNM) at time of proposal. The contractor must also have a certified radiation safety officer, qualified to handle Category III quantities of SNM and employees trained as radiation workers.

4. TASKS

4.1. Characterization Execution

4.1.1. Characterization Event Planning

The contractor shall support DNDO coordinated pretest visits to vendor locations and vendor visits to DNDO, and participate in meetings with vendor personnel.

Based upon information gathered during vendor meetings, support the development of the characterization objectives and a set of procedures for setup and execution of all scenarios called out in the characterization plan.

4.1.2. Characterization Cargo Design and Fabrication

DNDO shall, in coordination with the contractor, determine what representative samples shall be developed within budget. The contractor shall then acquire all necessary materials and construct the agreed upon samples. The exact composition and number of samples to be developed will depend on the costs associated with the procurement and development. Innovative and novel approaches to acquire cargo samples at the lowest possible prices are highly encouraged.

All samples shall be fully inventoried with detailed reports concerning the composition. Information relevant to the cargo samples shall be entered into a database. All cargo will be bar coded and identified using the cargo’s 10 digit numeric code as defined within the Harmonized Tariff Scheduled (HTS). These HTS codes are used by Customs at POE to collect tariff fees and appear on shipping manifests. All parcels of cargo shall receive bar codes linked to the database to permit tracking.

Cargo shall be packaged in a manner identical to standard packaging used in typical such cargo. If a given type of cargo is typically palletized and cellophane wrapped, that shall be noted and applied to the samples. Cargo that is usually seen hand-loaded at ports will be packaged into the sample containers that way.

This may call for the need to package cargo in large burlap bags or boxes. All cargo must be weighed and measure so cargo packing density can be calculated and recorded. This ground truth information shall be recorded in the database and associated with the bar code.

4.1.3. Characterization Event Setup/Pretest Trials

Test setup and pretest trials shall be conducted approximately two weeks prior to the start of each evaluation. This setup period shall include the preparation of a warehouse or other staging area where simulated targets can be stored. The staging area shall be utilized by the characterization execution team to set up the different characterization scenarios within containers. After test setup, pretest trials shall be conducted to evaluate test procedures and ensure the stability of the data recording/management system.

4.1.4. Characterization Event Execution

Ten or more characterization events shall be conducted under this PWS. Target handling and cargo handling support personnel to conduct the characterization as detailed in the characterization plan shall be provided. DNDO shall manage evaluations and provide overall characterization management.

4.1.5. Test Site Dismantlement

At the completing of the evaluations, support equipment shall be removed and any areas affected by the test shall be restored to their pretest condition.

4.1.6. Storage, Maintenance, Shipping, and Handling of Test

Objects and Cargo

The contractor shall store and maintain property items acquired to support TAR testing, including cargo samples, test objects developed specifically to support TAR testing, as well as additional DNDO property on loan to TAR test events as required. During this period, arrange for the movement of the cargo samples and test objects to and from the storage site to the location(s) as requested by DNDO in support of on-going contracts.

4.2. Characterization Data Collection

4.2.1. Pre-Field Collection and Preparation

The contractor shall coordinate with Transformational and Applied Research Directorate (TAR) to prepare the DNDO Data Collection System (DNDO-DCS), legacy or newly designed, to support the characterization of TAR Advanced Technology Demonstrations (ATD) and Exploratory Research (ER).

• Support vendor internal development testing and readiness demonstration.

• Coordinate with the vendor(s) prior to technology demonstration and characterization (TD&C) to ensure efficient DNDO-DCS interface with vendor developed performance test units (PTU).

• Coordinate with the test facility to ensure effective DNDO-DCS interface with all ground truth instrumentation.

• Coordinate with TAR Program Manager to develop and manage a data collection execution strategy that effectively describes each data collection event including all source and detector configurations, ground truth measurements associated with each data collection event, and all associated metadata for each data collection event.

• Contribute to document generation in support of characterization execution and subsequent analysis as directed by the TAR Program Manager.

4.2.2. In Field Data Collection

The contractor shall support operation and maintenance of the data acquisition interfaces providing data collection, verification, storage, and organization for TAR field collection activities.

• Provide on-site software engineering support for the duration of the characterization event.

• Ensure that the data is acquired and stored as required for the TD&C campaign.

• Provide automated and manual verification of the completeness and consistency of data records and inform the TAR Program Manager (PM), Characterization Director (CD), or Characterization Scientist (CS) of all identified issues.

• Provide and maintain software tools to be utilized for real-time (in field) and offline data validation efforts.

• Provide and tailor the Test Observation Record (TOR) system to each TD&C according to instruction from the PM/CD/CS including functionality for individuals to access and respond to different types of TORs.

• Interface the DNDO-DCS with the vendor developed PTUs and all ground truth devices.

• Execute the previously developed characterization execution strategy such that all characterization data collection events include all required vendor PTU data, ground truth data, and metadata.

• Respond to vendor system and DNDO-DCS changes and adjust field collection procedures as directed by the PM/CD/CS.

• Respond to changes in the characterization procedure and any deviations from the characterization plan by adjusting field collection techniques as necessary.

• Respond to and correct for observed anomalies with software tools and database queries.

• Prepare and administer training for potential DNDO-DCS users including the proper use of:

o The Test Observation Record system (TOR) Generation Resolution

Commenting o Query generation and filtering tools o Data validation tools o Data exporting tools

• Resolve data collection and data management anomalies/ issues that are reported through software TOR process or communicated via other methods.

• Respond to anomalies observed or changes needed in the data validation/ verification software.

• Respond to the data handling needs of the PM/CD/CS for the duration of the ATD.

• Develop custom queries and reports for collected data sets.

• Store output from post-processed and replayed data from other utilities into the DNDO-DCS database.

• Collect all raw data, including list-mode data if available, from vendor developed devices and make all data available for subsequent analysis.

• Support all other data collection activities for supported ATDs as directed by the PM/CD/CS.

4.2.3. Post Field Collection

The contractor shall support post data collection activities including document generation, equipment stowage/shipping, and data handling management.

• Process collected data per requests from TAR and TAR Technical Support Team.

• Make the data available to the TAR analysis team through the use of the

DNDO-DCS.

• Coordinate with Savannah River National Laboratory (SRNL) to transfer collected data to the TAR Technology Assessment Data Archive and Analysis System (TADAAS) which resides at SRNL.

• Identify and correct errors in the data fields, reparse and reprocess data files as required, and make improvements to the DNDO-DCS software as directed.

• Contribute to characterization documentation generation as directed by the TAR program manager of characterization scientist.

• Configure the DNDO-DCS for future TAR characterization campaigns based on lessons learned from previous campaigns and the specific needs for each project.

4.3. Modeling, Simulation, and Data Analysis

The contractor shall provide modeling and simulation support to DNDO funded programs including Monte Carlo simulations. The vendor shall provide data analysis support including algorithm emulation, data replay, and data injection studies.

4.4. Reporting

As directed by DNDO, the contractor shall provide input to the Data Analysis/Characterization Report following the completion of each characterization activity.

5. DELIVERABLES

• During the evaluations, weekly progress reports shall be submitted via e-mail to DNDO’s Characterization Director and Characterization Manager. These reports shall describe the progress for the week and the actions contemplated for the next week. All electronic deliverables shall be submitted via e-mail, whenever possible, with eh subject noting what the deliverable is and the body of the deliverable shall be a Microsoft Word Compatible Document.

• Two weeks after the completion of each characterization, a data report that describes the data collected shall be available via e-mail. All data collected shall be provided by appropriate means.

• Monthly reports outlining technical progress, spending profile, significant events, and programmatic risks.

• Inventory Database shall be maintained and reported on at the completion of each characterization campaign.

• Cargo samples and test objects delivered at contract completion.

6. PERIOD OF PERFORMANCE

The period of performance for this effort shall be 60 months. Ten or more characterizations events are covered by this PWS will be conducted within this 60 month period.

7. Travel

The contractor shall travel to support TAR with prototype system interfacing, field collections, and planning meetings as needed.

Travel may include but not be limited to several locations as directed by TAR:

• Washington DC to support program and development reviews, as well as characterization team planning meetings and working groups.

• Various vendor locations for program reviews, system interfacing, and characterization activities.

• Various government and vendor test sites for program planning and characterization events.

The contractor will need to travel internationally to support this effort

8. SECURITY

Certain Contractor personnel shall be required to access, view, possess, process and/or use classified information, information systems and workspaces to successfully complete certain functions. As specified in the Government recommended task order labor categories, certain Contractor personnel must possess, and maintain, a SECRET security clearance. In addition, certain Contractor personnel must possess TOP SECRET (TS) Critical Nuclear Weapon Design Information [CNWDI] or an equivalent DOE Q CLEARANCE access and/or be eligible for immediate adjudication by the cognizant security authority during the performance of the task order. The Contractor shall submit completed clearance packages within ten (10) calendar days of identification of any increased security requirements.

Contractor will receive/generate classified material at their facility using Automated Information Systems (AIS) and may fabricate/modify or store classified hardware (2cu ft) up to and including SECRET.

From FAR clause 52.204-2:

Security Requirements (Aug 1996)

(a) This clause applies to the extent that this contract involves access to information classified “Confidential,” “Secret,” or “Top Secret.”

(b) The Contractor shall comply with—

(1) The Security Agreement (DD Form 441), including the National Industrial Security Program Operating Manual (DoD 5220.22-M); and

(2) Any revisions to that manual, notice of which has been furnished to the Contractor.

(c) If, subsequent to the date of this contract, the security classification or security requirements under this contract are changed by the Government and if the changes cause an increase or decrease in security costs or otherwise affect any other term or condition of https://www.acquisition.gov/far/html/FormsDDWH3.html%23wp1150843 this contract, the contract shall be subject to an equitable adjustment as if the changes were directed under the Changes clause of this contract.

(d) The Contractor agrees to insert terms that conform substantially to the language of this clause, including this paragraph (d) but excluding any reference to the Changes clause of this contract, in all subcontracts under this contract that involve access to classified information.