Attachment 3 - Performance Requirements Summary Table.pdf

v1.3_JANUARY2023

Performance Requirements Summary Table

Requirement (Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

4.1 Engineering:

4.1.1 Engineering

Studies and Analysis

•Technical Report- Studies/Services

CDRL A001,

•Engineering Change Proposal

(ECP) CDRL

A002, •Specification Requirement Verification Matrix CDRL A003, •Manufacturing Technology Report CDRL A004, •Trip/Travel Report CDRL A005.

•Diminishing Manufacturing Sources and Material Shortages (DMSMS) Metric Data CDRL A016.

Engineering studies are performed, documented, and delivered for ranges, range components, or related aspects in the following areas: reliability, sustainability, maintainability, technical tradeoffs (systems, design, production, and installation), operational, cybersecurity, and geophysical.

Engineering studies include data collection in support of the Government’s submissions of environmental permits and National Environmental Policy Act documentation.

Engineering studies identify obsolescence and counterfeiting concerns and include recommendations for suitable replacements to resolve issues.

Engineering analyses are conducted, documented, and delivered for the purpose of resolving faults and error issues.

Engineering Change Proposals (ECPs), Specification Requirement Verification Matrices, and Manufacturing Technology Reports are documented and delivered.

Results of actions taken on travel are documented and delivered.

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with Exhibit A; no revisions are required.

Standard met 95% of the time.

Government Review of Deliverables

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

4.1.2 Design Engineering

•Technical Report- Studies/Services

CDRL A001,

•Engineering Change Proposal

(ECP) CDRL

A002, •Specification Requirement Verification Matrix CDRL A003, •Manufacturing Technology Report CDRL A004, •Trip/Travel Report CDRL A005.

•Proposed Spare Parts List CDRL A006, •Failure Mode Effects & Criticality Analysis CDRL A007, •System or Subsystem Design Description

(SSDD) CDRL

A008, Designs for in-water, on-shore, shipboard systems, subsystems and individual components are updated for the repair of failed components, upgrading of obsolete equipment, and improvements.

New Drawings, Models, and Associated Lists are delivered for new systems, items, and components.

For new systems, connections list is provided that clearly indicates connection end points and associated signal data name and type within the system.

For updated systems, changes are annotated via red-lined versions of GFI. New system(s), items, and components which are System Life of Type procurements are identified in the design. The design includes references to reliability study results from Task 4.1.1.1.

Engineering Change Proposals (ECPs), Specification Requirement Verification Matrices, and Manufacturing Technology Reports are delivered based on recommended design changes.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

•Software Design Description (SDD)

CDRL A009,

•Software Development Plan

(SDP) CDRL

A00A

•Critical Items List

IAW CDRL

A00B, •Reliability and Maintainability (R&M) Block Diagrams & Math Models report

CDRL A00C,

•Product Drawings and Models & Associated List

CDRL A00D,

4.1.3 Software

Engineering

•Technical Report- Studies/Services

CDRL A001,

•Engineering Change Proposal

(ECP) CDRL

A002, •Trip/Travel Report CDRL A005.

•Software Design Description (SDD)

CDRL A009,

•Software Development Plan

Software and firmware solutions are developed and delivered to include the incorporation of new or upgraded equipment (range hardware or computer hardware).

Programming code is investigated and developed for improvements to the performance, modernization or expansion of the existing software’s capabilities.

Software Development Plan (SDP) is updated and delivered as a result of evaluations and or in response to revised applicable documents and

GFI.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation

Standard met 95% of the time.

Government

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

(SDP) CDRL

A00A

•Test or Inspection Report CDRL A00F

•Software Version Description (SVD)

CDRL A00G,

•Computer Software Product Items CDRL A00H, •Computer Software and or Firmware Source Code CDRL A00J, •Computer Program End Item Documentation

CDRL A00K,

•Software Development Summary Report

CDRL A00L,

All software is accredited using the DoD’s RMF process to ensure it meets cybersecurity compliance.

New, expanded existing, and updated existing GFI databases are created related to software cataloging.

Existing software version descriptions provided as GFI are revised to reflect changes in the software under this task.

Vulnerability management tools are utilized to identify, mitigate, and report system security patch and update statuses on contract associated hardware (contractor-owned and

GFP).

Any and all necessary updates, patches, and fixes of the identified hardware, operating systems, databases, and applicable software are installed and integrated.

Security Technical Implementation Guides and patches are implemented on existing systems or sites.

Cyber security risks are detected and solutions are identified for remediation of vulnerabilities.

and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with Exhibit A; no revisions are required.

New, expanded existing, and updated existing GFI databases meet the requirements of applicable software engineering documents in Section 3.0

Vulnerability management tools are utilized on a no less than quarterly basis in accordance with the government Information Assurance Vulnerability Management (IAVM) program (covered in Applicable Documents 3.1.1, 3.1.4, 3.2.5, and 3.2.6). The contractor notifies the government regarding the applicable item(s) within 30 calendar days.

Security Technical Implementation Guides and patches are implemented on existing systems or sites on an annual basis or upon receipt of ADHOC requests in accordance with Applicable Documents 3.1.1, 3.1.4, 3.2.5, and 3.2.6.

Software code is complete, meets all design objectives, and is free of Priority 1-3 errors.

Software end items are complete and meet all test plan objectives.

Software configuration

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method management is maintained in accordance with the Government approved Software Development Plan.

4.1.4 Systems

Engineering

•Technical Report- Studies/Services

CDRL A001,

•Specification Requirement Verification Matrix CDRL A003, •Trip/Travel Report CDRL A005.

•Failure Modes Effects & Criticality Analysis CDRL A007, •System/ Subsystem Design Description

(SSDD) CDRL

A008, •Critical Items List

IAW CDRL

A00B, •Reliability and Maintainability (R&M) Block Diagrams & Mathematical Models Report

CDRL A00C,

System engineering is performed in support of range studies, analyses, sustainment, integration, and repairs.

Recommendations on GFI or hardware identified at the task order level are provided concerning technical adequacy, program relevancy, and impact to related program activities and requirements.

If engineering change proposal or instructions are created that impact specifications, recommended updates are provided to specifications to reflect the changes.

Results of tasking completed under SOW sections 4.1.1-4.1.3 are incorporated into deliverables.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

•Product Drawings and Models & Associated List

CDRL A00D,

•Test Plan CDRL A00M, •Failure Summary and Analysis Report CDRL A00W

4.2 Manufacturing and

Production:

4.2.1 Manufacturing, Production, Fabrication, Assembly, and Software

Integration

Studies/Services

CDRL A001,

•Engineering Change Proposal

(ECP) CDRL

A002, •Specification Requirement Verification Matrix CDRL A003, •Trip/Travel

A005.

•Proposed Spare Parts List CDRL A006, •Failure Modes, Effects & Criticality

Life of Type components, systems, subsystems, or critical items are identified.

Government approved software is integrated into range hardware systems, subsystems and components.

Government ranges are returned to operational tempo in accordance with the applicable performance specifications and are refreshed, enhanced, and upgraded to meet new performance specifications. Original equipment manufacturer manuals for all COTS materials delivered under this task are delivered.

Status reports of production and delivery timelines are delivered.

If a deviation from the government approved design is required, ECP’s or Notice of Revisions (NORs) are delivered.

If counterfeit items are identified during production of hardware, the issue is identified and corrective action is taken.

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

Analysis CDRL A007, •Critical Items List

CDRL A00B,

•Reliability AND Maintainability (R&M) Block Diagrams & Mathematical Report CDRL A00C, •Product Drawings and Models & Associated List

CDRL A00D,

•Test or Inspection Report, CDRL A00F

•Test Plans; V&V Test Plans CDRL A00M, •Presentation Material CDRL A00N, •Test Procedures

CDRL A00P,

•Operations and Maintenance Instructions for Research and Developmental (R&D) Equipment

CDRL A00Q,

•Commercial Off- The-Shelf Manual

Material found to be non-conforming after delivery for either the complete units or the subcomponents are repaired or replaced at no cost to the Government. The repaired material or replacement is delivered to the Government.

A failure analysis and corrective action report for each repair are submitted. A request for Variance is submitted if a design issue is identified.

Non-conforming material is tracked via a Return Material Authorization system and documented in a Material Non-conformance Record (MNR).

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

& Associated Supplemental Data A00R, •Notice of Revision (NOR)

CDRL A00S

•Product and Delivery Status Report CDRL A00T

•Counterfeit Material Identification Report and Corrective Action Plan CDRL A015

•DMSMS Metric Data CDRL A016

•Request for Variance CDRL A017

•Manufacturing Non-Conformance

A018

4.2.2 Performance

Verification Testing

•Technical Report- Studies/Services

CDRL A001,

•Trip/Travel Report CDRL A005.

Test Plans and procedures for verification testing are developed and updated to reflect changes in hardware, software, or system designs.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

•Test or Inspection Report, CDRL A00F

•Test Plans; V&V Test Plans CDRL A00M, •Test Procedures

CDRL A00P,

•Installation Test Report CDRL A00U, •Failure Summary and Analysis Report CDRL A00W

•Counterfeit Material Identification Report and Corrective Action Plan CDRL A015

Verification testing is performed and results are summarized into reports.

If counterfeit items are identified during verification testing, the issue is identified and corrective action is taken

Onsite test troubleshooting and failure analysis is performed.

Software test programs are developed and Government software test programs are modified.

Results of actions taken on travel are documented and delivered.

are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

4.3 Installation

(Deployment and

Recovery)

Studies/Services

CDRL A001,

•Engineering Change Proposal

CDRL A002,

•Trip/Travel Report CDRL A005, •Product Drawings and Models &

Installation engineering plans and installation test plans are developed and include recommended resources required, mobilization and staging area requirements, the proposed schedule, and identification of equipment, vessels and utilities required for installations.

The test plan identifies the availability of Government owned vessels and diving services via the Narragansett Bay Test Facility (NBTF)..

Hardware, electronics and software produced or delivered under section

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Diving services are performed in compliance with 29 CFR Part 1910 Subpart T OSHA Standards.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all

Standard met 95% of the time.

Government

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

Associated List

CDRL A00D,

•Installation Test Plan CDRL A00M, •Installation Test Report CDRL A00U, •Installation- Engineering Plan

CDRL A00V

4.2 is deployed and recovered. All deviations from approved installation plans are documented and associated drawing or hardware connections lists are delivered. If applicable, Engineering Change Proposals (ECP)s are delivered.

Crane, vessel, and diving services are provided if government assets and operational serves are not available via the NBTF. In doing so, the cranes provided are certified to handle the weight and type of equipment being installed or tested.

The contractor operates contractor provided boats and cranes for installation and tests.

Installation testing is conducted and results are documented in a test report.

assessments and recommendations with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

4.4 Operations and

Maintenance:

4.4.1 Test Event and

Missions Operations

•Trip/Travel

A005, •Operational Test

A00F

Existing hardware and software and any items delivered under Section 4.2 or installed under Section 4.3 are operated during operational test events and missions for short duration proof that requirements are met. All steps taken and the results of the operational testing is documented.

All documentation requires no more Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

4.4.2 Troubleshooting

and Repair

•Technical Report- Studies/Services

CDRL A001,

•Trip/Travel Report CDRL A005, •Failure Summary and Analysis Report CDRL A00W

Fault isolation and failure analysis of fielded systems, including shore based systems and in water components, subsystems and systems is conducted.

Crane, vessel, and diving services are provided if government furnished asserts and operational services are not available via the NBTF. In doing so, the cranes provided certified to handle the weight and type of equipment being installed or tested.

Contractor provided boats and cranes are operated during operations and tests.

A report detailing the analysis and a proposed plan to resolve the failure is documented and delivered.

System and Sub-system repair is performed by repairing or replacing components, sub-systems or systems and a repair summary report is delivered.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method

4.4.3 Training and

Operation Manuals

•Trip/Travel Report CDRL A005, •Operations Manual CDRL A00X, •Revisions to Existing Government Documents CDRL A00Y

•Training Materials CDRL A00Z, •Training Conduct Report CDRL A010

Existing training plans and materials (manuals and other training documentation and training aids) are modified and new training plans and materials are developed for platforms, systems, subsystems, and critical items.

Training is conducted to ensure proper operation, repair, maintenance, and testing of platforms, systems, subsystems, or critical items.

Completion of training is documented in a training conduct report.

Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

4.4.4 Cybersecurity

Studies/Services (Cybersecurity Documentation)

CDRL A001,

•Trip/Travel Report CDRL A005, Reviews of identified cybersecurity measures, vectors, and controls for platforms, systems, subsystems, and critical items are conducted.

Documentation for new platforms, systems, subsystems, and critical items inclusive of cybersecurity items identified as part of applicable documents are developed and maintained.

Documentation of existing platforms, systems, subsystems, and critical items inclusive of cybersecurity items

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations

Standard met 98% of the time.

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method identified as part of applicable documents are updated.

A solution to deliver compliant hardware, firmware, software, and software patches in the event of emergent or urgent cybersecurity is delivered or implemented.

Cybersecurity patches to support systems, subsystems, and components identified by cybersecurity documentation are provided.

Cybersecurity scans are conducted and results are delivered to demonstrate cybersecurity compliance.

to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with

4.5 On-Call Support

•Troubleshoot Recommendation Report CDRL A001, •Redlined Software End Item

CDRL A00H

•Revisions to Existing Government Documents CDRL A00Y

Remote troubleshooting is provided to support maintenance and repair of the ranges upon receipt of trouble call or electronic request from the Government.. Red-lined drawings, revised software, and other supporting documentation are provided, if applicable.

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Within 3 business days of receipt of trouble call, solutions are provided to resolve the issue.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A

Standard met 95% of the time.

Government

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with Exhibit A; no revisions are

4.6 Meeting Planning

and Support

•Report, Record of Meeting/Minutes

CDRL A00E,

•Presentation Material CDRL A00N, •Meeting Agenda

CDRL A011,

•Trip/Travel

A005, Integrated progress reviews and Technical Interchange Meetings are conducted to provide technical status, risk identification (technical, schedule, and cost), action items with assignee’s and due dates, and risk mitigation tracking.

Systems Engineering Technical Reviews (SETR) are participated in to gather information to support tasking under this contract as well as to present findings and recommendations.

Meeting agendas and presentation materials package are provided.

Meeting minutes and action items are provided.

Documents identified in SOW section 3.0.

Meeting agendas and presentation materials package are provided prior to the event.

Meeting minutes and action items are provided post event.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

For CDRLs with Approval Code “A” listed in Block 8 of Exhibit A to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, Standard met 95% of the time.

Government

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method and timely in accordance with

4.7 Cyberspace/Cyber

Workforce (CWF):

4.7.1 CWF

Qualifications

N/A

All personnel performing cyber workforce functions are trained and qualified.

All personnel performing cyber function are trained and qualified per “DFARS 252.239-7001, Information Assurance Contracting Training and Certification”. Appropriate security clearance is maintained by personnel per SECNAV M- 5510.30C to perform the tasks associated with their assigned positions.

Appropriate baseline certification is earned and maintained as identified in DOD 8570.01-M for the position and tasking being performed.

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Standard met 100% of the time.

4.7.2: CWF Reporting •CWF Report

CDRL A012

A list of all personnel assigned to the task order performing cyber functions as part of the monthly CWF Report is provided. The report includes employee name, task order number, list of applicable CWF category and level, required certifications and fulfillment status. Designation approval is received in writing by the Commanding Officer, or the C-ISSM via “By Direction” authority, prior to performing CWF functions.

New hire information for tasking requiring cyber function is submitted

Tasking is performed in accordance with the Applicable Documents identified in SOW section 3.0.

Contractor generated reports, briefings, and technical support are technically accurate, provide programmatic insights, are clear and concise, and include the adequate depth and breadth to clearly identify and quantify all assessments and recommendations and are provided in accordance with agreed upon schedules.

Standard met 100% of the time

Government

(Task number and title from SOW/PWS)

CDRL

(if applicable)

Performance Objective Performance Standard Acceptable Quality Level (AQL) Monitoring

Method and includes name, task order number, list of applicable cyber functions category and level, required certifications and fulfillment status, as well as a copy of the baseline certification documentation.

to the task order, documentation and reports require no more than 1 review, comment, and approval cycle. For all other CDRLs, initial submission of documentation and reports are complete, accurate, and timely in accordance with