N0018920R0058.pdf

SEE ADDENDUM

(No Collect Calls)

N0018920R0058 04-Jun-2020

b. TELEPHONE NUMBER

757-443-1381

8. OFFER DUE DATE/LOCAL TIME

12:00 AM 10 Jul 2020

5. SOLICITATION NUMBER 6. SOLICITATION ISSUE DATE

AUTHORIZED FOR LOCAL REPRODUCTION

PREVIOUS EDITION IS NOT USABLE

STANDARD FORM 1449 (REV. 2/2012)

Prescribed by GSA – FAR (48 CFR) 53.212

(TYPE OR PRINT)

(SIGNATURE OF CONTRACTING OFFICER)

ADDENDA X ARE

26. TOTAL AWARD AMOUNT (For Gov t. Use Only )

23.

CODE 10. THIS ACQUISITION IS

SUCH ADDRESS IN OFFER

17b. CHECK IF REMITTANCE IS DIFFERENT AND PUT

BELOW IS CHECKED

TELEPHONE NO.

N001899. ISSUED BY

18b. SUBMIT INVOICES TO ADDRESS SHOWN IN BLOCK 18a. UNLESS BLOCK

7. FOR SOLICITATION

INFORMATION CALL:

a. NAME

JOSEPH P. MULHERIN

2. CONTRACT NO. 3. AWARD/EFFECTIVE DATE 4. ORDER NUMBER

(TYPE OR PRINT)

30b. NAME AND TITLE OF SIGNER 30c. DATE SIGNED 31b. NAME OF CONTRACTING OFFICER

30a. SIGNATURE OF OFFEROR/CONTRACTOR 31a.UNITED STATES OF AMERICA

1 27a. SOLICITATION INCORPORATES BY REFERENCE FAR 52.212-1. 52.212-4. FAR 52.212-3. 52.212-5 ARE ATTACHED.X

25. ACCOUNTING AND APPROPRIATION DATA

1. REQUISITION NUMBER

20.

ADDITIONAL SHEETS SUBJECT TO THE TERMS AND CONDITIONS SPECIFIED.

OFFEROR TO COMPLETE BLOCKS 12, 17, 23, 24, AND 30

SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL ITEMS

N5702320COTFD80

ARE NOT ATTACHED

27b. CONTRACT/PURCHASE ORDER INCORPORATES BY REFERENCE FAR 52.212-4. FAR 52.212-5 IS ATTACHED. ADDENDA ARE ARE NOT ATTACHED

(BLOCK 5), INCLUDING ANY ADDITIONS OR CHANGES WHICH ARE

SET FORTH HEREIN, IS ACCEPTED AS TO ITEMS:

. YOUR OFFER ON SOLICITATION

28. CONTRACTOR IS REQUIRED TO SIGN THIS DOCUMENT AND RETURN

% FOR:SET ASIDE:UNRESTRICTED OR X

SMALL BUSINESS

17a.CONTRACTOR/ CODE FACILITY

OFFEROR CODE

NAVSUP FLC NORFOLK CONTRACTING

NORFOLK OFFICE

ATTN: J MULHERIN

1968 GILBERT STREET STE 600

NORFOLK VA 23511

18a. PAYMENT WILL BE MADE BY CODE

RATED ORDER UNDER

DPAS (15 CFR 700)

13a. THIS CONTRACT IS A

13b. RATING

CODE15. DELIVER TO CODE N57023 16. ADMINISTERED BY

12. DISCOUNT TERMS11. DELIVERY FOR FOB DESTINA-

TION UNLESS BLOCK IS

MARKED

SEE SCHEDULE

14. METHOD OF SOLICITATION

RFQ IFB RFPX

OPERATIONAL TEST & EVALUATION FORCE

TIMOTHY BURROWS

7970 DIVEN STREET

NORFOLK VA 23505-1498

TEL: 757-282-5546 X3136 FAX:

757-443-1333FAX:

TEL: 757-443-1381 SERVICE-DISABLED

VETERAN-OWNED

SMALL BUSINESS

X 8(A)

HUBZONE SMALL

BUSINESS

SIZE STANDARD:

$16,500,000

NAICS:

541330

X

OFFER DATED

29. AWARD OF CONTRACT: REF.

DELIVER ALL ITEMS SET FORTH OR OTHERWISE IDENTIFIED ABOVE AND ON ANY

COPIES TO ISSUING OFFICE. CONTRACTOR AGREES TO FURNISH AND

EMAIL:

TEL:

31c. DATE SIGNED

SEE SCHEDULE

SCHEDULE OF SUPPLIES/ SERVICESITEM NO. QUANTITY UNIT UNIT PRICE AMOUNT

24.22.21.19.

WOMEN-OWNED SMALL BUSINESS (WOSB)

ELIGIBLE UNDER THE WOMEN-OWNED

SMALL BUSINESS PROGRAM

EDWOSB

32g. E-MAIL OF AUTHORIZED GOVERNMENT REPRESENTATIVE

SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL ITEMS

(CONTINUED)

PAGE 2 OF111

ACCEPTED, AND CONFORMS TO THE CONTRACT, EXCEPT AS NOTED: ______________________________________________________

32a. QUANTITY IN COLUMN 21 HAS BEEN

RECEIVED INSPECTED

32b. SIGNATURE OF AUTHORIZED GOVERNMENT

REPRESENTATIVE

32c. DATE 32d. PRINTED NAME AND TITLE OF AUTHORIZED GOVERNMENT

REPRESENTATIVE

32e. MAILING ADDRESS OF AUTHORIZED GOVERNMENT REPRESENTATIVE 32f . TELEPHONE NUMBER OF AUTHORIZED GOVERNMENT REPRESENTATIVE

37. CHECK NUMBER

FINALPARTIALCOMPLETE

36. PAYMENT35. AMOUNT VERIFIED

CORRECT FOR

34. VOUCHER NUMBER

FINAL

33. SHIP NUMBER

PARTIAL

38. S/R ACCOUNT NUMBER 39. S/R VOUCHER NUMBER 40. PAID BY

41a. I CERTIFY THIS ACCOUNT IS CORRECT AND PROPER FOR PAYMENT

41b. SIGNATURE AND TITLE OF CERTIFYING OFFICER 41c. DATE

42a. RECEIVED BY (Print)

42b. RECEIVED AT (Location)

42c. DATE REC'D (YY/MM/DD) 42d. TOTAL CONTAINERS

STANDARD FORM 1449 (REV. 2/2012) BACK

Prescribed by GSA – FAR (48 CFR) 53.212

AUTHORIZED FOR LOCAL REPRODUCTION

PREVIOUS EDITION IS NOT USABLE

SEE SCHEDULE

20.

SCHEDULE OF SUPPLIES/ SERVICES

21.

QUANTITY UNIT

22. 23.

UNIT PRICE

24.

AMOUNT

19.

ITEM NO.

N0018920R0058

Section SF 1449 - CONTINUATION SHEET

ITEM NO SUPPLIES/SERVICES MAX

QUANTITY

UNIT UNIT PRICE MAX AMOUNT

0001 1 Lot Test and Evaluation Services

FFP

in accordance with the performance work statement. Total estimated labor price is based on maximum rates in the Services Price Worksheet.

FOB: Destination

PURCHASE REQUEST NUMBER: N5702320COTFD80

PSC CD: R425

MAX

NET AMT

UNIT UNIT PRICE MAX AMOUNT

0002 1 Lot Services

FFP

Services in accordance with paragraph 1.10 of the Performance Work Statement

(PWS).

FOB: Destination

UNIT UNIT PRICE MAX AMOUNT

0003 1 Lot Travel

FFP

in accordance with the performance work statement. Total not-to-exceed amount plus burdens is 2,798,279.84 dollars.

UNIT UNIT PRICE MAX AMOUNT

1001 1 Lot OPTION Test and Evaluation Services

FFP

in accordance with the performance work statement. Total estimated labor price is based on maximum rates in the Services Price Worksheet.

UNIT UNIT PRICE MAX AMOUNT

1002 1 Lot OPTION Services

FFP

Services in accordance with paragraph 1.10 of the Performance Work Statement

(PWS).

UNIT UNIT PRICE MAX AMOUNT

1003 1 Lot OPTION Travel

FFP

in accordance with the performance work statement. Total not-to-exceed amount plus burdens is 296,610.29 dollars.

PERFORMANCE WORK STATEMENT

1. Scope of Tasking. Contractor will provide technical and analytical support to Commander, Operational Test and Evaluation Force (COMOPTEVFOR) in the definition, conduct, and analysis of structured Operational Test and Evaluation (OT&E) of US Navy Expeditionary Warfare systems. This support will be required in one or more of the following forms: Documentation Review, Operational Test Design, Test Execution, Data

Management, Test Planning Support, Test Operations Support, Test Analysis and Reporting, Modeling and Simulation Support, and Program Management Support. COMOPTEVFOR is charged with leading the Operational Test community with highly skilled testers and staff that adapt to change, and provide credible, prompt, warfighting-focused test results to Navy, Marine Corps and Coast Guard forces and acquisition leadership.

1.1. Background. There are five warfare divisions at COMOPTEVFOR that are supported by competency divisions. The warfare divisions include Undersea Warfare (40), Air Warfare (50), Command, Control, Communications, Computers, Intelligence, Surveillance, and Reconnaissance (C4ISR) (60), Surface Warfare (70), Expeditionary Warfare/Littoral Combat Ship (80) Division. Each warfare division typically has a Navy Captain as the division Director with a senior civil servant as the Deputy or a senior civil servant as the division Director and a Navy Commander as the Deputy.

The warfare divisions represent the traditional core of the COMOPTEVFOR organization. This is where the Fleet operators reside. The work there allows COMOPTEVFOR to bridge the gap from technical to the tactical, successfully. The warfare divisions are staffed by uniformed military personnel and Navy government civilians, augmented by a contractor workforce.

There are four competency divisions: Policy and Operations (01A), Test Design (01B), Test Planning and Analysis (01C), and Cybersecurity Testing (01D). In addition, the Technical Director (00TD) oversees the technical aspects of the Command’s mission. Other support divisions include the Staff Commanding Officer and Administration (10), Chief Information Officer (CIO) (20), Contracts (01), and the Comptroller (30). The members of the competency divisions generally work within the test team to ensure that the Commander’s policies are adhered to and that Best Practice Series are applied.

1.2. For scoping purposes, a description of the Undersea Warfare division is listed below, as well as a current list of the Undersea Warfare evaluation programs being performed. This list is current as of time of this solicitation, and additional programs may be assigned to COMOPTEVFOR for contractor support under this contract.

1.2.1. The Expeditionary Warfare/Littoral Combat Ship Division (Code 80) tests and evaluates all Expeditionary warfare systems, including Chemical, Biological, Radiological, Nuclear, Special Operations, Explosive Ordnance, Dive, and Counter-Unmanned Air Systems under the most operationally realistic conditions possible. The division's main effort is to assist, through early involvement, in the acquisition process, conduct tests, and provide timely and accurate evaluations to characterize system performance and resulting capability. Current Expeditionary Test and Evaluation programs include, but are not limited to:

1.2.1.1. Chemical Biological Defense Program (CBDP)

1.2.1.2. Joint Service Aircraft Masks-Tactical Air, Strategic Air, Rotary Wing

(JSAM-TA/SA/RW)

1.2.1.3. Joint Effects Model (JEM)

1.2.1.4. Joint Warning and Reporting Network (JWARN)

1.2.1.5. Joint Expeditionary Collective Protection (JECP)

1.2.1.6. Enhanced Maritime Biological Detection (EMBD)

1.2.1.7. Joint Tactical Biological Detection System (JTBDS)

1.2.1.8. Radiological Detection System (RDS)

1.2.1.9. Radiological Isotope Identifier-Detector (RIID)

1.2.1.10. Uniform Integrated Protection Ensemble Family of Systems (UIPE FoS)

1.2.1.11. Next Generation Diagnostic System (NGDS)

1.2.1.12. Man Portable Detection System (MPDS)

1.2.1.13. Mass Personnel Contamination Mitigation System (MPCMS)

1.2.1.14. Aerosol Vapor Chemical Agent Detector (AVCAD)

1.2.1.15. Multi-Purpose Chemical Agent Detector (MPCAD)

1.2.1.16. Compact Vapor Chemical Agent Detector (CVCAD)

1.2.1.17. Joint Chemical Agent Detector - Solid Liquid Applicator (JCAD-SLA)

1.2.1.18. Joint General Purpose Decontaminant – Harden Material (JGPD-HME)

1.2.1.19. Common Analytic Lab System (CALS)

1.2.1.20. Contamination Indicator and Decontamination Assurance System (CIDAS)

1.2.1.21. Next Generation Personnel Decontamination (NGPD)

1.2.1.22. Tactical Contamination Mitigation System (TCMS)

1.2.1.23. Tactical Disablement System (TacDS)

1.2.1.24. Chemical- Biological-Radiological-Nuclear Information Systems (CBRN-IS)

1.2.1.25. Shallow Water Combat Submersible (SWCS) Mk 11 Seal Delivery Vehicle

1.2.1.26. 40 Foot Patrol Boat (40 PB)

1.2.1.27. Dry Combat Submersible (DCS)

1.2.1.28. Counter Unmanned Aerial System (C-UAS)

1.2.1.29. Decision Support System (DSS) Inc 2

1.2.1.30. Mk 18 Mod 2 Unmanned Underwater Vehicle

1.2.1.31. Multi-Mission Underwater Breathing Apparatus (MMUBA)

1.2.1.32. Tug – and Salvage (T-ATS)

1.2.1.33. Non-Lethal Weapons (NLW)

1.2.1.34. Amphibious Surf Capable Vehicle (ASCV)

1.2.1.35. Joint Mission Planning System – Expeditionary (JMPS-E)

1.2.1.36. Combatant Craft Medium (CCM)

1.2.1.37. Advanced Explosive Ordnance Disposal Robotic System (AEODRS)

1.2.2. Test Policy, Operations and Training (Code 01A) ensures OPTEVFOR policy conforms to Navy

T&E Policy; monitors production of T&E products; leads continuous process improvement efforts;

coordinates external OT&E inquiries (IG and GAO); manages all government T&E training (including budget requests); provides T&E editorial support to the command; and plans, analyzes and evaluates the effectiveness of command processes.

1.2.3. Test Design and M&S (Code 01B) is responsible for the Mission Basted Test Design (MBTD) process, M&S technical review, test planning and post-test iterative process analysis support, test design production, Capabilities Based Test and Evaluation coordination, and Targets, Ranges, and Test Resources coordination.

1.2.4. Test Planning and Analysis Division (Code 01C) is responsible for policy, processes and standardization for test planning, test execution, post-test analysis and evaluation (reporting). This includes providing Lead Test Engineer (LTE) support to the COTF Warfare Divisions and Fleet Resources coordination to support execution of OT&E.

1.2.5. Cybersecurity Division (Code O1D) integrates critical cybersecurity testing into the acquisition lifecycle and tests Systems under Test (SUT) per DoDI 5000.02 and DOT&E memo of 01 August 2014. The Under Sea Warfare division will be responsible for executing acquisition test design, planning support to ultimately provide the Cybersecurity OT&E group (O1D) support in cybersecurity execution and reporting. Through a rigorous and iterative test process, Cybersecurity OT&E assists in the development and fielding of more secure and resilient Information Technology (IT) systems supporting the warfighters. Code 01D Cybersecurity OT&E group includes the following support positions: Technical Director, Future Capabilities and Threat Emulation

Developer, Cybersecurity Test Engineers, Test Design and Analysis Manager, Training and Lab Manager, Test Team Leads, and Certified Ethical Hackers.

1.3. Period of Performance. See schedule.

1.4. Place of Performance. Unless required to support mission accomplishment, work shall primarily be performed at the customer’s site. If the number of personnel exceeds onsite capabilities, unclassified work will be expected to be performed at a contractor facility offsite. The customer location is:

Commander, Operational Test and Evaluation Force 7970 Diven Street Norfolk, VA 23505-1498

While onsite at COMOPTEVFOR, the contractor shall comply with OPNAVINST 5239 (series), with specific regard to non-government hardware and software.

1.4.1. Travel. Travel can be expected to occur CONUS and OCONUS and will be required throughout the course of this contract. All travel costs shall be in accordance with the Federal Travel Regulations (FTR). Invoices shall include actual costs experienced. Airfare shall be based on the lowest available cost for coach or economy in writing, in advance. Travel dates and locations are to be confirmed through the TA and approved by the COR in writing, prior to commencement of any travel.

1.4.1.1. Travel Instructions.

1.4.1.1.1. Ensure all Contractors supporting this requirement meet the minimum requirements of the COMUSFLTFORCOM/COMPACFLTINST 6320.3B, dtd 07Apr14, Medical Screening for U.S. Government Civilian Employees, Contractor Employee’s, and Guests and Visitors Prior to Embarking Fleet Units.

1.4.1.1.2. Any travel OCONUS by the Contractor will need to review the Foreign Clearance Guide at http://www.fcg.pentagon.mil and select the country of intended travel. During OCONUS travel, the contractor shall operate in accordance with International Traffic in Arms Regulation (ITAR) Part 124, approved by US Department of State, Office of Defense Trade Controls. Specific guidance can be found at:

https://www.pmddtc.state.gov/regulations_laws/itar.html.

1.4.1.1.3. The Contractor is not authorized to perform any travel that is not in conjunction with this contract. It is the Department of the Navy (DON) policy not to allow a charge of profit or fee on reimbursable items.

1.4.1.1.3.1. The Government will make no reimbursements for a contractor’s local travel

(defined as less than 50 miles from the place of performance).

1.4.1.1.3.2. In no instance shall the contractor exceed the amount specified in the contract for travel CLIN, Contingency/Surge CLIN and ODC CLIN expenses.

1.4.1.1.3.3. Locations include CONUS, OCONUS and at sea locations and any other location, which may be added on a task order basis based on future test requirements.

1.4.1.1.3.4. For planning purposes any travel location OCONUS must be considered as a possible travel location unless travel restrictions at time of test do not permit entry. Possible OCONUS locations include, but are not limited to the following:

Andros Island, Bahamas; Salisbury, Porton Down and London, England; Hawaii;

Medicine Hat, Alberta, Canada; Manama, Bahrain; Rota, Spain; Prague, Czech

Republic; Seoul, Korea and any other location, which may be added on a task order basis based on future test requirements.

1.5. Personal Services. This is not a personal services Task Order. The contractors/sub-contractors should be well educated in respect to “personal services”. No one (Government employee or military) may task the contractor to perform work that is not listed in the delivery order, nor do the contractors take direction in the performance of their task from anyone other than their corporate manager and/or prime contractor, as appropriate.

1.6. Privity Defined. The legal term that defines the relationship between two parties of a contract, does not exist between the Government and the sub-contractor. Therefore, the Prime contractor is responsible for ensuring, through its own internal processes, that quality work is performed and delivered on time, by any subcontractors to meet the objectives of the prime contract. Formal direction to sub-contractors flows only thought the prime contractor. There can be simultaneous communication between the prime contractor and the subcontractor, but the Government and the subcontractor cannot bypass the prime contractor to communicate directly with each other.

1.7. Automated Data Processing (ADP) Requirements. The Government will provide, as required, the necessary computer, work station/system access for on-site work.

1.7.1. Those offerors assigned as off-site will not be assigned government furnished ADP assets.

1.7.2. Additionally, the onsite offerors assigned ADP Government Furnished Property will be held accountable to respond to the governments ADP inventory requirements conducted semi-annually re-occurring every Mar and Sep to ensure 100% accountability of all ADP assets.

1.7.3. Any offeror not adhering to this call for inventory of ADP assets may be directed to forfeit their ADP GFP at no additional cost to the government. IAW FAR 52.245-1

1.8. Common Access Card (CAC)/Public Key Infrastructure (PKI), System Authorization Access

Request (SAAR-N). All contractor personnel requiring access to Government Information Technology (IT) systems shall have an approved System Authorization Access Request (SAAR-N) Form OPNAV 5239/14 (Rev Sep 2011) on file, and complete required Annual Information Awareness Training. New employees must submit their SAAR forms upon check in of their first day of work. Instructions for processing the SAAR-N forms are available at:

http://www.cnrc.navy.mil/publications/Forms/OPNAV_5239_14_SAAR_N.pdf.

1.8.1. SAAR-N forms shall be submitted to the CIO Department, specifically the Information Systems

Security Manager (ISSM).

1.9. Common Access Cards (CAC) / Local Badges. Contractor CACs will be approved using the Trusted Agent Sponsorship (TAS) system and issued by the Government to on-site contractor personnel and shall be visible at all times while personnel are at the Government site.

1.9.1. The contractor shall furnish all requested information required to facilitate issuance of identification badges and shall conform to all instructions/guidance required by the facility.

1.9.2. The Government will provide the contractor access to Government facilities, as required, for performance of tasks under this contract. Contractor personnel shall comply with the instructions/ guidance required by your facility.

1.9.3. All CACs issued to Contractor employees shall be returned to the Government Security Department at the Government site in accordance with the instructions/ guidance required by your facility following completion of the contract, relocation or termination of an employee, or upon request from the Contracting Officer’s Representative.

1.10. ODCs, Increased Operational Requirements and Contingency Support.

1.10.1. If Applicable, ODCs consist of test equipment and supplies as required for performance of TO. In no instance shall the contractor exceed the amount specified in the contract for ODC CLIN expenses.

1.10.2. When applicable, contingency services will be estimated for and ONLY used when:

1.10.2.1. An unanticipated requirement or contingency arises due to changes in testing events or operations;

1.10.2.2. Is within scope (within para 2.1 thru 2.7.7) of the contract/task order and necessary to complete the work required in the task order;

1.10.2.3. Will take the contractor over their normal 40 hour work (5 days) week; and

1.10.2.4. After concurrence via email from the Operational Test Director (OTD) and COR is received.

1.10.2.5. These services are not considered overtime. These services will be included as a total price of the task order, if ordered.

1.11. Receipt and Acceptance of Deliverables. All Deliverables (CDRL’s) (NIPR or SIPR) listed will be delivered by the Contractor in accordance with the Quality Assurance Surveillance Plan (QASP). These delivered items shall be sent in an email by the contractor to the divisional representatives (and other applicable recipients) and upon receipt the government will acknowledge receipt via email. Final acceptance by the government shall be considered once the draft document has made smooth and has been signed by the responsible signatory (i.e. ACOS or Commander) or the submitted document is accepted at the requisite level as determined by OT&E Manual (formerly OTD Manual). This email will facilitate the formal government’s position for the respective product.

2. Specific Tasking. In accordance with the PWS and the basic contract the contractor shall provide support in evaluating the operational effectiveness and suitability of the system under test that has been assigned to COMOPTEVFOR for OT&E, in accordance with the format prescribed in reference 10.4, COMOPTEVFORINST 3980.2 series, Operational Test & Evaluation Manual (OT&E) (formerly Operational Test Director’s Manual), (or other governing references). The manual maybe found at:

https://www.public.navy.mil/cotf/OTD/OTD%20Manual.pdf

2.1. Overall Task Guidance. To gain efficiencies and synergy in contract execution, the Government encourages the Contractor to consider:

2.1.1. Flexibility in production. COMOPTEVFOR produces information which may take many forms.

Support teams should be willing to experiment, bring up new ideas or better ways of doing things, but remain willing to execute stated processes when directed.

2.1.2. Present concerns about the validity of the information produced and value to the end customer (Fleet or Program). Remain willing to defend a contrary position until government makes a final decision.

2.1.3. Remain Efficient and Economical in production. Strive to produce information as quickly as possible without sacrificing quality, and with the appropriate level of expertise.

2.1.4. Maintain a broad perspective. Awareness of testing outside of a specific program to recommend testing efficiencies and overall kill chain evaluation opportunities.

2.1.5. Technical competence. Improve T&E community’s ability to understand, analyze, communicate, and ultimately visualize T&E issues from a warfighter and technical perspective.

2.2. Test Design

2.2.1. Mission Analysis

2.2.1.1. The Contractor shall perform Mission Based Test Design mission analysis in accordance with the Integrated Evaluation Framework (IEF) Checklist, IEF Template, and published COMOPTEVFOR Best Practices, respectively.

2.2.1.1.1. The contractor shall analyze source data to perform Mission Based Test Design mission analysis.

2.2.1.1.2. The contractor shall identify and document the mission areas.

2.2.1.1.3. The contractor shall identify and document system capabilities.

2.2.1.1.4. The contractor shall derive and document operator tasks.

2.2.1.1.5. The contractor shall define and document the operational conditions applicable to the system to be tested.

2.2.1.1.6. The contractor shall document the mission analysis in the Mission Based Test and

Evaluation System (MBTES).

2.2.1.1.7. The contractor shall document the mission analysis in an IEF document.

2.2.1.1.8. The contractor shall review the mission analysis during MBTD reviews.

2.2.1.1.9. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of mission analysis MBTD reviews.

2.2.2. Requirements Analysis

2.2.2.1. The contractor shall perform Mission Based Test Design requirements analysis in accordance with IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices respectively.

2.2.2.1.1. The contractor shall perform requirements analysis on SUT information as listed in the Capabilities Development Document (CDD), Capabilities Production Document (CPD), Performance Specification (P-Spec) or similar source provided documents.

2.2.2.1.2. The contractor shall analyze source data to perform MBTD requirements analysis.

2.2.2.1.3. The contractor shall identify and document measures of system performance, inclusive of critical measures.

2.2.2.1.4. The contractor shall link measures of system performance to subtasks and document this linkage.

2.2.2.1.5. The contractor shall identify and document the data required to quantify the measures of system performance.

2.2.2.1.6. The contractor shall identify and document the data required to quantify the operational conditions applicable to the system to be tested.

2.2.2.1.7. The contractor shall document requirements analysis in the MBTES.

2.2.2.1.8. The contractor shall review the requirements analysis during MBTD reviews.

2.2.2.1.9. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of requirements analysis MBTD reviews.

2.2.3. Test Design

2.2.3.1. The Contractor shall perform Mission Based Test Design test design in accordance with

IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices, respectively.

2.2.3.1.1. The contractor shall analyze source data to perform Mission Based Test Design.

2.2.3.1.2. The contractor shall identify and document the candidate response variables for statistical test design.

2.2.3.1.3. The contractor shall identify and document factors/conditions (with corresponding levels) associated with each response variable or critical measure used in test design.

2.2.3.1.4. The contractor shall participate in and document the statistical test design for candidate response variables and/or critical measures.

2.2.3.1.5. The contractor shall identify and document the test vignettes.

2.2.3.1.6. The contractor shall determine and document the appropriate test method.

2.2.3.1.7. The contractor shall determine and document a test schedule supporting execution of the test design.

2.2.3.1.8. The contractor shall identify and document the expected use of Modeling and Simulation in the execution of the test design.

2.2.3.1.9. The contractor shall determine and document the resources required to conduct the test.

2.2.3.1.10. The contractor shall determine and document the limitations to test based on known availability of resources and assets to conduct the test.

2.2.3.1.11. The contractor shall develop and document data sheets to support test execution.

2.2.3.1.12. The contractor shall document the test design in the MBTES.

2.2.3.1.13. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of test design MBTD reviews.

2.2.4. Stakeholder Collaboration (WIPTs, outreach, etc)

2.2.4.1. The contractor shall make recommendations to the warfare division in accordance with

COMOPTEVFOR processes found in IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices respectively.

2.2.4.2. The contractor shall identify and recommend outside organization(s) for participation and inclusion in Test Design activities.

2.2.4.3. When directed, the contractor shall coordinate briefings/meetings in support of COMOPTEVFOR Test Design activities in accordance with IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.4.4. When directed, the contractor shall participate in briefings/meetings in support of COMOPTEVFOR Test Design activities in accordance IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.4.5. When directed, the contractor shall lead briefings/meetings in support of COMOPTEVFOR Test Design activities in accordance with IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.4.6. The contractor shall provide a trip report (CDRL A002) when the activities (1.1, 1.2, 1.3 or 1.4) occur away from the COMOPTEVFOR site in Norfolk, VA.

2.2.5. Document and Brief Preparation

2.2.5.1. The contractor shall prepare and document briefings (CDRL A001) to include the IEF, Executive In-Process Review and stakeholder collaboration briefings, as directed.

2.2.6. Test and Evaluation Master Plan (TEMP) Input Preparation

2.2.6.1. The contractor shall analyze source data to provide input to the TEMP, to include program schedules, the IEF, applicable policy documents and any other program-provided materials.

2.2.6.2. The contractor shall develop and document input to the TEMP IAW the DOT&E TEMP Guidebook.

2.2.6.3. The contractor shall develop and document comments to the TEMP related to or affecting

OT.

2.2.7. Stakeholder Collaboration

2.2.7.1. The contractor shall make recommendations to the warfare division in accordance with COMOPTEVFOR processes found in reference 10.4, and IEF Checklist.

2.2.7.2. When directed, the contractor shall coordinate briefings/meetings in support of COMOPTEVFOR TEMP Input activities in accordance with the IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.7.3. When directed, the contractor shall participate in briefings/meetings in support of COMOPTEVFOR TEMP Input activities in accordance with the IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.7.4. When directed, the contractor shall lead briefings/meetings in support of COMOPTEVFOR TEMP Input activities in accordance with the IEF Checklist, IEF Template, and published COMOPTEVFOR Best Practices.

2.2.7.5. The contractor shall provide a trip report (CDRL A002) when contract activities occur away from the COMOPTEVFOR site in Norfolk, VA.

2.3. Test Planning

2.3.1. Plan of Action and Milestones (POA&M)

2.3.1.1. The contractor shall develop and document a POA&M for the Test Planning process in accordance with the Test Planning Checklist.

2.3.1.2. The contractor shall analyze source data to perform Test Planning POA&M development.

2.3.1.3. The contractor shall obtain and maintain access to the program MBTES database to support the test planning process.

2.3.2. Developmental or Integrated Test Planning Products

2.3.2.1. The contractor shall perform the activities associated with development of Purpose of Test in accordance with Test Planning Checklist.

2.3.2.2. The contractor shall review, comment and consolidate input to Developmental or Integrated

Test Plans which will provide data that will contribute to operational COI resolution.

2.3.2.3. The contractor shall review all Verification, Validation and/or Accreditation Plans of test facilities or infrastructure that will provide data that will contribute to operational COI resolution.

2.3.2.4. The contractor shall review all Verification, Validation and/or Accreditation Test Reports of test facilities or infrastructure that will provide data that will contribute to operational COI resolution.

2.3.2.5. The contractor shall review all test operating procedures for test facilities or infrastructure that will provide data that will contribute to operational COI resolution.

2.3.3. Purpose of Test

2.3.3.1. The contractor shall perform the activities associated with development of Purpose of Test in accordance with the Test Planning Checklist.

2.3.3.1.1. The contractor shall analyze source data to perform Test Planning Purpose of Test development.

2.3.3.1.2. The contractor shall update and document the SUT and System of Systems (SoS) descriptions from the IEF for use in the Test Plan.

2.3.3.1.3. The contractor shall identify and document the SUT test configuration.

2.3.3.1.4. The contractor shall identify and document the Developmental Test (DT)/Integrated Test

(IT) contributions to OT.

2.3.3.1.5. The contractor shall identify and document regression test requirements for any Follow-on OT&E phases, if applicable.

2.3.3.1.6. The contractor shall identify and document changes to the limitations to test.

2.3.3.1.7. The contractor shall update and document the Mission Critical Subsystem Matrix

(MCSM) from the IEF.

2.3.3.1.8. The contractor shall document the Purpose of Test activities in a Test Plan document in accordance with the Test Planning Checklist, and the appropriate test plan templates.

2.3.3.1.9. The contractor shall review the Purpose of Test activities during test plan reviews.

2.3.3.1.10. The contractor shall identify test equipment/instrumentation needed for test execution.

2.3.3.1.11. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Purpose of Test reviews.

2.3.4. Test Schedule

2.3.4.1. The contractor shall perform the activities associated with development of the Test

Schedule in accordance with the Test Planning Checklist and published COMOPTEVFOR Best Practices.

2.3.4.1.1. The contractor shall analyze source data to perform Test Schedule development.

2.3.4.1.2. The contractor shall identify, recommend, and document data to be qualified for use in

OT.

2.3.4.1.3. The contractor shall develop and document the Test Schedule, to include test events, for each test phase and period.

2.3.4.1.4. The contractor shall document the Test Schedule data in the MBTES.

2.3.4.1.5. The contractor shall document the Test Schedule activities in a Test Plan document in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.4.1.6. The contractor shall review the Test Schedule activities during test plan reviews.

2.3.4.1.7. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Test Schedule reviews.

2.3.5. Detailed Method of Test (DMOT)

2.3.5.1. The contractor shall perform the activities associated with development of the DMOT in accordance with the the Test Planning Checklist and published COMOPTEVFOR Best Practices.

2.3.5.1.1. The contractor shall analyze source data to perform DMOT development.

2.3.5.1.2. The contractor shall identify and document the data to be collected on each test event.

2.3.5.1.3. The contractor shall develop and document the start and stop criteria for each test event.

2.3.5.1.4. The contractor shall develop and document the GO/NO-GO criteria for each test event.

2.3.5.1.5. The contractor shall develop and document the DMOT for each test event.

2.3.5.1.6. The contractor shall document the DMOT in a Test Plan document in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.5.1.7. The contractor shall review the DMOT during test plan reviews.

2.3.5.1.8. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of DMOT reviews.

2.3.6. Data Collection Plan (DCP)

2.3.6.1. The contractor shall perform the activities associated with development of the DCP in accordance with the the Test Planning Checklist and published COMOPTEVFOR Best Practices.

2.3.6.1.1. The contractor shall analyze source data to perform DCP development.

2.3.6.1.2. The contractor shall review, update and document, as required, any changes to data requirements.

2.3.6.1.3. The contractor shall develop and document the DCP.

2.3.6.1.4. The contractor shall identify test equipment/instrumentation needed for test data collection.

2.3.6.1.5. The contractor shall identify data repository.

2.3.6.1.6. The contractor shall create and document data sheets, interview sheets, focus group sheets, and survey sheets in support of the DCP.

2.3.6.1.7. The contractor shall document the DCP data in the MBTES.

2.3.6.1.8. The contractor shall document the DCP in a Test Plan document in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.6.1.9. The contractor shall review the DCP during test plan reviews.

2.3.6.1.10. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of DCP reviews.

2.3.7. Data Analysis Plan (DAP)

2.3.7.1. The contractor shall perform the activities associated with development of the Data

Analysis Plan in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.7.1.1. The contractor shall analyze source data to perform DAP development.

2.3.7.1.2. The contractor will develop and document the COI resolution method.

2.3.7.1.3. The contractor will develop and document data scoring criteria.

2.3.7.1.4. The contractor shall identify and document Scoring Board Guidance.

2.3.7.1.5. The contractor shall review and provide analysis of Failure Definition Scoring Criteria.

2.3.7.1.6. The contractor shall provide a data analysis repository with Government concurrence.

2.3.7.1.7. The contractor shall document the DAP in a Test Plan document in accordance with the

Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.7.1.8. The contractor shall review the DAP during test plan reviews.

2.3.7.1.9. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Analysis Plan reviews.

2.3.8. Stakeholder Collaboration (WIPTs, outreach, etc)

2.3.8.1. The contractor shall make recommendations to the warfare division in accordance with

COMOPTEVFOR processes found in reference 10.4, Test Planning Checklist, as well as test plan templates.

2.3.8.2. The contractor shall identify and recommend outside organization(s) for participation and inclusion in Test Planning activities.

2.3.8.3. When directed, the contractor shall coordinate briefings/meetings in support of COMOPTEVFOR Test Planning activities in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.8.4. When directed, the contractor shall participate in briefings/meetings in support of COMOPTEVFOR Test Planning activities in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.8.5. When directed, the contractor shall lead briefings/meetings in support of COMOPTEVFOR Test Planning activities in accordance with the Test Planning Checklist, appropriate test plan templates and published COMOPTEVFOR Best Practices.

2.3.8.6. The contractor shall provide a trip report (CDRL A002) when contract activities occur

2.3.9. Document and Brief Preparation

2.3.9.1. The contractor shall prepare and document briefings (CDRL A001) to include the Test Plan, DCP, Concept of Test, Test Plan Review Board, and stakeholder collaboration briefings, as directed.

2.4. M&S Support

2.4.1. M&S Requirements Development

2.4.1.1. The Contractor shall perform M&S Requirements Development in accordance with

COMOPTEVFORINST 5000.1C, reference 10.5, and the Best Practice series.

2.4.1.2. The contractor shall identify and document candidate critical measures/response variables, along with their associated conditions, during the Test Design portion of the MBTD process that will be supplemented by M&S data.

2.4.1.3. The contractor shall develop and document a M&S Requirements Letter in accordance with reference 10.5, Accreditation Plan Development Guide, and the Best Practice Series.

2.4.1.4. The contractor shall review the M&S requirements during MBTD reviews.

2.4.1.5. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S Requirements Development.

2.4.2. Develop Accreditation Plans

2.4.2.1. The contractor shall develop an M&S Accreditation Plan in accordance with reference

10.5, Accreditation Plan Development Guide, and the Best Practice series.

2.4.2.1.1. The contractor shall develop and document the accreditation approach method consistent with COTF policy.

2.4.2.1.2. The contractor shall develop and document the Accreditation Plan.

2.4.2.1.3. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S Accreditation Plan Development.

2.4.3. Review Verification &Validation (V&V) Plans and Reports

2.4.3.1. The contractor shall review program M&S V&V plans and reports in accordance with reference 10.5 and the Best Practice series.

2.4.3.2. The contractor shall review and document disagreements or issues with V&V plan methodologies.

2.4.3.3. The contractor shall provide recommendations for alternative V&V methodologies supporting COTF Accreditation Requirements.

2.4.3.4. The contractor shall review program M&S V&V reports and document disagreements or issues with methodologies/results based on comparison with live test results.

2.4.3.5. The contractor shall develop and document the COTF V&V Report addendum.

2.4.3.6. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S V&V Plans or Reports reviews.

2.4.4. Accreditation Support

2.4.4.1. The contractor shall perform M&S Accreditation in accordance with reference 10.5 and the

Best Practice series.

2.4.4.1.1. The contractor shall perform and document, in coordination with COTF Test Design analysts, any additional required analysis not provided in the V&V report in support of accreditation.

2.4.4.1.2. The contractor shall identify and document conclusions and recommendations based on comparison of live test results with M&S test results.

2.4.4.1.3. The contractor shall identify and document significant M&S limitations that impact the accreditation recommendation.

2.4.4.1.4. The contractor shall identify and document where the M&S results support the intended use for OT.

2.4.4.1.5. The contractor shall develop and document an accreditation recommendation in an Accreditation Letter.

2.4.4.1.6. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S Accreditation activities and reviews.

2.4.5. Stakeholder Collaboration

2.4.5.1. The contractor shall make recommendations to the warfare division in accordance with COMOPTEVFOR processes found in reference 10.5, and the Best Practice series.

2.4.5.2. The contractor shall identify and recommend outside organization(s) for participation and inclusion in M&S VV&A activities.

2.4.5.3. When directed, the contractor shall coordinate briefings/meetings in support of COMOPTEVFOR M&S VV&A activities in accordance with reference 10.5 and the Best Practice series.

2.4.5.4. When directed, the contractor shall participate in briefings/meetings in support of COMOPTEVFOR M&S VV&A activities in accordance with reference 10.5 and the Best Practice series.

2.4.5.5. When directed, the contractor shall lead briefings/meetings in support of COMOPTEVFOR M&S VV&A activities in accordance with reference 10.5 and the Best Practice series.

2.4.5.6. The contractor shall provide a trip report (CDRL A002) when contract activities occur

2.4.6. Document and Brief Preparation

2.4.6.1. The contractor shall prepare and document briefings (CDRL A001) to include the M&S Requirements Letter, Accreditation Plan, Verification and Validation Report Addendum, Accreditation Letter, and stakeholder collaboration briefings, as directed.

2.5. Test Execution

2.5.1. Pre-test Coordination

2.5.1.1. The contractor shall identify and schedule required test services (ranges, targets, personnel, etc.) for the test phase.

2.5.1.2. The contractor shall develop and submit asset scheduling requests to COTF Fleet Services schedulers in accordance with reference 10.4.

2.5.1.3. The contractor shall develop and provide the COTF pre-test letters for Commanding

Officers of test units and Immediate Superior in Command (ISIC) in accordance with reference 10.4.

2.5.1.4. The contractor shall develop and provide briefing materials as required to support Operational Test Readiness Reviews (OTRRs) in accordance with SECNAVINST 5000.2 series.

2.5.2. Pre-test Brief

2.5.2.1. The contractor shall prepare and document the Pre-Test briefing (CDRL A001) to support stakeholder alignment in execution preparations.

2.5.3. Test Operations

2.5.3.1. The contractor shall collect and document test data using data cards/sheets, interview sheets, focus group sheets, and survey sheets in accordance with COTF procedures and the signed test plan.

2.5.3.2. The contractor shall distribute text execution materials to all test participants, when directed.

2.5.3.3. The contractor shall develop and document any test deviations resulting from test variances.

2.5.3.4. The contractor shall develop and document a daily summary of test operations email, when directed.

2.5.3.5. The contractor shall coordinate/operate test equipment/instrumentation with Government concurrence.

2.5.4. Post-Test Activities

2.5.4.1. The contractor shall conduct and document post-test event interviews, when directed.

2.5.4.2. The contractor shall conduct and document test team debriefs, when directed.

2.5.4.3. The contractor shall conduct and document test-site scoring boards, when directed.

2.6. Post-Test Iterative Process (PTIP) and Reporting

2.6.1. Data Scoring

2.6.1.1. The contractor shall perform PTIP Data Scoring in accordance with reference 10.4 and the

Best Practice series.

2.6.1.2. The contractor shall inventory, compile, and document all collected data, comparing data collected to that required by the Test Plan, specifically the DMOT and DCP.

2.6.1.3. The contractor shall develop and document a test execution summary.

2.6.1.4. The contractor shall review all data during the Data Authentication Group.

2.6.1.5. The contractor shall review the data during Data Scoring reviews.

2.6.1.6. The contractor shall develop the End of Test message.

2.6.1.7. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Scoring reviews.

2.6.2. COI Evaluation

2.6.2.1. The contractor shall perform PTIP COI Evaluation in accordance with reference 10.4 and the Best Practice series.

2.6.2.1.1. The contractor shall develop and document risks and/or deficiencies using

COMOPTEVFOR Blue and Gold Sheet format.

2.6.2.1.2. The contractor shall develop and document test results in COMOPTEVFOR test report results paragraph format.

2.6.2.1.3. The contractor shall document any limitations to test identified during test execution or update any identified in test planning and realized during test execution.

2.6.2.1.4. The contractor shall develop and document COI evaluation via the COI Evaluation

Chart.

2.6.2.1.5. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of COI Evaluation reviews.

2.6.3. Data Analysis

2.6.3.1. The contractor shall perform PTIP Data Analysis in accordance with reference 10.4 and the

Best Practice series.

2.6.3.1.1. The contractor shall conduct and document an analysis of all measures.

2.6.3.1.2. The contractor shall develop and conduct an Response Variable Analysis Outbrief in coordination with Test Design Analyst support.

2.6.3.1.3. The contractor shall develop a draft Data Analysis Summary (DAS).

2.6.3.1.4. The contractor shall review the DAS during Analysis Working Groups (AWG), when directed.

2.6.3.1.5. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Analysis reviews.

2.6.4. Deficiency/Risk Documentation

2.6.4.1. The Contractor shall perform PTIP Deficiency/Risk Documentation in accordance with reference 10.4, and Best Practice series.

2.6.4.1.1. The contractor shall develop, distribute, and collect comments on draft Blue/Gold

Sheets.

2.6.4.1.2. The contractor shall review the Deficiencies/Risks during PTIP reviews.

2.6.4.1.3. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Deficiency/Risk reviews.

2.6.5. System Evaluation

2.6.5.1. The Contractor shall perform PTIP System Evaluation in accordance reference 10.4 and

Best Practice series.

2.6.5.1.1. The contractor shall develop and document evaluation reports to support Command

Systems Evaluation Review Board (SERB)/Executive SERB (E-SERB) PTIP reviews.

2.6.5.1.2. The contractor shall provide Divisional Summary Briefs.

2.6.5.1.3. The contractor shall provide post-test Fact Sheet draft.

2.6.5.1.4. The contractor shall provide post-test Fleet Brief draft.

2.6.5.1.5. The contractor shall provide Lessons Learned.

2.6.5.1.6. The contractor shall review the system evaluation during PTIP reviews.

2.6.5.1.7. The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of System Evaluation reviews.

2.6.6. Stakeholder Collaboration

2.6.6.1. The contractor shall make recommendations to the warfare division in accordance with

COMOPTEVFOR processes found in reference 10.4 and Best Practice series.

2.6.6.2. The contractor shall identify and recommend outside organization(s) for participation and inclusion in PTIP activities.

2.6.6.3. When directed, the contractor shall coordinate briefings/meetings in support of

COMOPTEVFOR PTIP activities in accordance with reference 10.4 and Best Practice series.

2.6.6.4. When directed, the contractor shall participate in briefings/meetings in support of COMOPTEVFOR PTIP activities in accordance with reference 10.4 and Best Practice series.

2.6.6.5. When directed, the contractor shall lead briefings/meetings in support of COMOPTEVFOR PTIP activities in accordance with reference 10.4 and Best Practice series.

2.6.6.6. The contractor shall provide a trip report (CDRL A002) when contract activities occur

2.6.7. Document and Brief Preparation

2.6.7.1. The contractor shall prepare and document briefings (CDRL A001) to include the Evaluation Report, Post-Test Brief, Scoring Board, Critical Operational Issue (COI) Evaluation Working Group (CEWG) products, SERB/E-SERB Brief, Data Analysis Summary, and Blue/Gold Sheets, as directed.

2.6.7.2. The contractor shall prepare the Risk/Deficiency cover letter, the DAS, and the Test Report per reference 10.4, and applicable Templates/Best Practice series.

2.7. Cyber Survivability Test Planning

2.7.1. Cyber Survivability Test Planning Research

2.7.1.1…