Solicitation - N0018926RW014.pdf

WOMEN-OWNED SMALL

BUSINESS (WOSB)

SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL PRODUCTS AND COMMERCIAL SERVICES

1. REQUISITION NUMBER PAGE 1 OF

2. CONTRACT NUMBER 3. AWARD/EFFECTIVE

DATE

4. ORDER NUMBER 5. SOLICITATION NUMBER 6. SOLICITATION ISSUE

DATE

7. FOR SOLICITATION

INFORMATION CALL:

a. NAME b. TELEPHONE NUMBER (No collect calls)

8. OFFER DUE DATE/

LOCAL TIME

9. ISSUED BY

13b. RATING

14. METHOD OF SOLICITATION

CODE

15. DELIVER TO 16. ADMINISTERED BY CODE

18a. PAYMENT WILL BE MADE BY CODE17a. CONTRACTOR/

OFFEROR

CODE

FACILITY

CODE

CODE

TELEPHONE NUMBER

17b. CHECK IF REMITTANCE IS DIFFERENT AND PUT SUCH ADDRESS IN

OFFER

18b. SUBMIT INVOICES TO ADDRESS SHOWN IN BLOCK 18a UNLESS BLOCK

BELOW IS CHECKED

REQUEST

FOR QUOTE

(RFQ)

INVITATION

FOR BID

(IFB)

REQUEST

FOR

PROPOSAL

(RFP)

SEE ADDENDUM

19.

ITEM NUMBER

20.

SCHEDULE OF SUPPLIES/SERVICES

21.

QUANTITY

22.

UNIT

23.

UNIT PRICE

24.

AMOUNT

(Use Reverse and/or Attach Additional Sheets as Necessary)

25. ACCOUNTING AND APPROPRIATION DATA 26. TOTAL AWARD AMOUNT (For Government Use Only)

28. CONTRACTOR IS REQUIRED TO SIGN THIS DOCUMENT AND RETURN

COPIES TO ISSUING OFFICE. CONTRACTOR AGREES TO FURNISH

AND DELIVER ALL ITEMS SET FORTH OR OTHERWISE IDENTIFIED ABOVE AND

ON ANY ADDITIONAL SHEETS SUBJECT TO THE TERMS AND CONDITIONS

SPECIFIED

29. AWARD OF CONTRACT: REFERENCE OFFER

DATED . . YOUR OFFER ON SOLICITATION

(BLOCK 5), INCLUDING ANY ADDITIONS OR CHANGES WHICH ARE

SET FORTH HEREIN, IS ACCEPTED AS TO ITEMS:

30a. SIGNATURE OF OFFEROR/CONTRACTOR

30b. NAME AND TITLE OF SIGNER (Type or print) 30c. DATE SIGNED

31a. UNITED STATES OF AMERICA (SIGNATURE OF CONTRACTING OFFICER)

31b. NAME OF CONTRACTING OFFICER (Type or print) 31c. DATE SIGNED

AUTHORIZED FOR LOCAL REPRODUCTION

PREVIOUS EDITION IS NOT USABLE

STANDARD FORM 1449 (REV. 11/2021)

Prescribed by GSA - FAR (48 CFR) 53.212

10. THIS ACQUISITION IS UNRESTRICTED OR

NORTH AMERICAN

INDUSTRY CLASSIFICATION

STANDARD (NAICS):

SIZE STANDARD:

13a. THIS CONTRACT IS A

RATED ORDER UNDER

THE DEFENSE PRIORITIES

AND ALLOCATIONS

SYSTEM - DPAS (15 CFR 700)

SET ASIDE: % FOR:

11. DELIVERY FOR FREE ON

BOARD (FOB) DESTINATION

UNLESS BLOCK IS MARKED

SEE SCHEDULE

12. DISCOUNT TERMS

ARE ARE NOT ATTACHED

ARE ARE NOT ATTACHED

27a. SOLICITATION INCORPORATES BY REFERENCE (FEDERAL ACQUISITION REGULATION) FAR 52.212-1, 52.212-4. FAR 52.212-3

AND 52.212-5 ARE ATTACHED. ADDENDA

27b. CONTRACT/PURCHASE ORDER INCORPORATES BY REFERENCE FAR 52.212-4. FAR 52.212-5 IS ATTACHED. ADDENDA

8(A)

ECONOMICALLY

DISADVANTAGED

WOMEN-OWNED SMALL

BUSINESS (EDWOSB)

SERVICE-DISABLED

VETERAN-OWNED

SMALL BUSINESS

(SDVOSB)

HUBZONE SMALL

BUSINESS

SMALL BUSINESS

NOTE: OFFEROR TO COMPLETE BLOCKS 12, 17, 23, 24, AND 30.

Solicitation/Contract Form Continuation

Division 50 Solicitation

Aviation Warfare Division 50 Analytical Operational Test and Evaluation Support Services

N0018926RW014

Continuation of Supplies or Services and Prices/Costs

Additional Information/Notes

MINIMUM AND MAXIMUM QUANTITIES (FFP, SINGLE AWARD IDIQ) (SEP 2015)

As referred to in paragraph (b) of the "Indefinite Quantity" clause of this contract, the total contract minimum quantity is a total of $2,500.00 worth of orders at the contract unit price(s). The contract maximum quantity is a total of $37,000,000.00.

(End of Text)

UNLIQUIDATED OBLIGATIONS

UNLIQUIDATED OBLIGATIONS

The Government intends to unilaterally deobilgate any unliquidated obligations 90 days after each period of performance. Prior to doing so, the Contracting Officer (or Administrative Contracting Officer) will notify the contractor of the intended amount of deobligation and ask the contractor to confirm within one week that all invoices for the completed period of performance have been submitted and processed for payment (with the exception of any invoice for rate adjustment upon receipt of DCAA approved final rates for any cost-type CLINs or SLINs). Upon confirmation that all invoices have been submitted and processed for payment, or upon the contractor's failure to respond to the PCO/ACOs notification of intent to deobligate, the Contracting Officer or Administrative Contracting Officer will unilaterally deobligate the potential ULOs by reducing the funded amount to an amount equal to the contractors invoiced/paid amount for that contract period of performance.

Note: Reduction of cost-reimbursement CLINs or SLINs in accordance with the above DOES NOT change either party's obligations under a Final Invoice submitted upon DCMA establishing final rates for each CLIN and or SLIN.

(End of Text)

Allowed Per Order Minimum: 2,500.00 Dollars, U.S.

Maximum: 10,000,000.00 Dollars, U.S.

Government Minimum/Maximum to Order Minimum: 2,500.00 Dollars, U.S.

Maximum: 37,000,000.00 Dollars, U.S.

Item Supplies/Service Estimated Quantity

Unit Unit Price Amount

0001 Test and Evaluation Services

Pricing Arrangement: Firm Fixed Price

1 Unit

0002 Travel

Pricing Arrangement: Cost No Fee

1 Unit

Option Line Item

Option Period - Test and Evaluation Services

Pricing Arrangement: Firm Fixed Price

1 Unit

Option Line Item

Option Period - Travel

Pricing Arrangement: Cost No Fee

1 Unit

Continuation of Description

PERFORMANCE WORK STATEMENT

Analytical Operational Test and Evaluation Support Services For Aviation Warfare (Code 50) At OPTEVFOR Norfolk VA

1. Scope. Contractor shall provide technical and analytical support to Operational Test and Evaluation Force (OPTEVFOR) in the definition, conduct and analysis of structured Operational Test and Evaluation (OT&E) of US Navy systems. This support will be required in one or more of the following forms: Documentation Review, Test Planning Support, Operational Test Design, Test Analysis and Reporting, Test Operations Support, Modeling and Simulation Support, and Program Management Support. OPTEVFOR is charged with leading the Operational Test community with highly skilled testers and staff that adapt to change, and provide credible, prompt, warfighting-focused test results to Navy, Marine Corps and Coast Guard forces and acquisition leadership.

2. Background. There are five warfare divisions that are supported by competency divisions. The Aviation Warfare Division (Code 50) resides on the 2nd deck. Code 50 division has a Navy Captain as the division Director with a senior civil servant as the division Deputy Director.

Aviation warfare division represent the traditional core of the OPTEVFOR organization. This is where the Fleet operators reside. The work there allows OPTEVFOR to bridge the gap from technical to the tactical, successfully. The aviation warfare division is staffed by uniformed military personnel and Navy government civilians, augmented by a contractor workforce.

There are four competency divisions: Operations (01A), Test Design and Analysis (01B), Test Planning and Evaluation (01C) and Cybersecurity (01D). In addition, the Technical Director (00TD) oversees the technical aspects of the Command's mission. Other support divisions include the Administration Services (10), Command Information Office (CIO) (20), Contracts (01K), and Finance (30). The members of the competency divisions generally work within the test team to ensure that the Director's policies are adhered to and that best practices are applied.

Operations (Code 01A) is responsible for representing the Commander to external organizations in the development of T&E policy. It is responsible for ensuring compliance with governing directives, specifically Secretary of the Navy (SECNAV) Instructions and DoD Directives. As the Operations Director, 01A tracks the status of ongoing testing and reporting, as well as managing the response to external requests for document coordination and review. The editorial staff and training staff fall under the Policy and Operations Director.

Test Design and Analysis (Code 01B) develops policy and provides services that enable OPTEVFOR Warfare Divisions to design efficient and comprehensive Operational Test (OT), to leverage Scientific Test and Analysis Techniques (STAT), and to coordinate long-lead data sources. 01B personnel join test teams in identifying needing information, preparing their products, and meeting with stakeholders. The goal of these efforts are to create test that is defensible and robust, leading to conclusions that are defendable and repeatable.

Test Planning and Evaluation (Code 01C) is responsible for the analytical rigor applied to all test planning documents and reports generated at OPTEVFOR. It oversees the development process for all test plans and reports. 01C Division is comprised of the Director, a Deputy Director, and Assistant Directors assigned as process owners. The management and professional development of all Lead Test Engineers (LTE), Center for Naval Analysis (CNA) representatives, and division analysts, whether assigned directly to 01C staff or the warfare divisions/squadrons (01C forward), falls under the Test Planning and Evaluation Director. As the Subject Matter Expert (SME) in test planning, execution, and report writing, the Test Planning and Evaluation Director is responsible for the development of the related training curricula.

Cybersecurity (Code 01D) is responsible for all aspects of cybersecurity test and evaluation during OT&E and cybersecurity assessments during Combatant Commander and Fleet exercises. The 01D Division is divided internally into two separate functions, Cybersecurity OT&E and Cybersecurity Assessment

Program (CAP). Code 01D is comprised of the Director, Deputy Director, Test Operations Director, and a Cybersecurity Assessments Program Director. Cybersecurity OT&E integrates critical cybersecurity testing into the acquisition lifecycle and tests Systems under Test (SUT) per DoDI

5000.02 and DOT&E memo of 01 August 2014. The Cybersecurity OT&E group provides support in cybersecurity acquisition test design, planning, execution and reporting across all OPTEVFOR warfare divisions, including VXs and VMX. Through a rigorous and iterative test process, Cybersecurity OT&E assists in the development and fielding of more secure and resilient Information Technology (IT) systems supporting the warfighters. Code 01D Cybersecurity OT&E group includes the following support positions: Technical Director, Future Capabilities and Threat Emulation Developer, Cybersecurity Test Engineers, Test Design and Analysis Manager, Training and Lab Manager, Test Team Leads and Certified Ethical Hackers.

3. Aviation Warfare Division and Supported Programs. The Aviation Warfare Division (Code 50) Tests and evaluates all of the Navy and Marine Corps' aviation acquisition programs warfare systems such as strike/fighter weapons; assault weapons; aviation electronic warfare; air antisubmarine warfare; aviation maintenance; and trainers, under the most operationally realistic conditions possible. The aviation warfare division also coordinates with the following squadrons; VX-1 (Patuxent River, MD), VX-9 (China Lake, CA), VMX-1 (Yuma, AZ) and HMX-1 (Quantico, VA). Below is a list of current Aviation Warfare test and evaluation programs that require OT&E support; however, additional programs may be assigned to OPTEVFOR for contractor support under this contract.

Advance Arresting Gear (AAG) Advanced Anti-Radiation Guided Missile (AARGM) Advanced Anti-Radiation Guided Missile Extended Range (AARGM-ER) Advanced Threat Warning (ATW) Infrared Countermeasures System

AIM-120D AMRAAM

AIM-9X SIDEWINDER

AN/AAR-47 IR Warning Receiver AN/ALE-47 IR Countermeasure System AN/ALQ-99 Low Band Consolidation (LBC) AN/APR-39 Radar Signal detecting Set

AV-8B

CH-53K

CMV-22

Common Control System Department of the Navy Large Aircraft Infrared Countermeasure (DON LAIRCM) Distributed Aperture Infrared Countermeasures (DAIRCM) Dual Band Decoy (DBD) E-2D Advanced Hawkeye E-6B Block 1 Upgrades EA-18G System Configuration Set (SCS) Enhanced Visual Acuity (EVA) F/A-18 Infrared Search and Track (IRST) System F/A-181+/C/D/E/F System Configuration Set (SCS) H-1 Upgrades (AH-1Z/UH-1Y)

HAAWC

Integrated Defensive Electronic Countermeasures (IDECM) Intrepid Tiger Spiral II Pod Joint Air to Ground Missile (JAGM) Joint Air to Surface Standoff Missile (JASSM-ER) Joint Mission Planning System-Maritime (JMPS-M)

Joint Precision Approach and Landing System (JPALS) Joint Strike Fighter (JSF), F-35 B/C

KC-130J

Long Range Anti-ship Missile (LRASM) Marine Aviation Data Management System (MADMS) MAGTF Agile Network Gateway Link (MANGL)

MH-60R

MH-60S

Miniature Air-Launched Decoy Naval (MALD-N)

MQ-25

MQ-4C Triton Multifunctional Information Distribution System Joint Tactical Radio System (MIDS JTRS)

MUX MALE (USMC MQ-9A)

MARV-EL (Medium Aerial Resupply Vehicle - Expeditionary Logistics) MV-22 Osprey Next Generation Jammer (NGJ) Pod Low band Next Generation Jammer (NGJ) Pod Mid band P-8A Presidential Support Aircraft (VH-92) SDB-II (Small Diameter Bomb) T-45

TACAMO/E-XX

USS GERALD R. FORD (CVN 78)

USS JOHN F. KENNEDY (CVN 79)

USS ENTERPRISE (CVN 80 Ford Class)

USS DORIS MILLER (CVN 81)

USS WILLIAM J. CLINTON (CVN 82)

USS GEORGE W. BUSH (CVN 83)

4. Period of Performance and Location.

4.1 Period of Performance: See Schedule.

4.2 Place of Performance: Unless required to support mission accomplishment, work shall primarily be performed at the customer's site. If the number of personnel exceeds onsite capabilities, unclassified work will be expected to be performed offsite. The customer's location is:

Operational Test and Evaluation Force 7970 Diven Street Norfolk, VA 23505-1498

While onsite at OPTEVFOR, the contractor shall comply with OPNAVINST 5239 (series), with specific regard to non-government hardware and software. Normal workdays at OPTEVFOR are Monday through Friday and normal working hours are from 0730 through 1600 EST. The manned quarter deck watch will unlock the front and back doors to CA-10 at 0500 (M-F) and lock the front and back doors to CA-10 at 1830 (M-F). Any contractor who desires to remain past 1830 in CA-10 to perform services under their support contract MUST notify the quarterdeck CDO/watch stander NLT 1700 on the day they will be working past 1830. Once the contractor has secured all work and access in their respective workspace, they will notify the CDO/watch stander that they are securing for the day.

4.3 Travel. Travel can be expected to occur CONUS and OCONUS and will be required throughout the course of this contract. The need for travel associated with this PWS shall be determined in advance by the COR at the Task Order level and authorized by the COR. Travel shall be paid by the Contractor and reimbursed by the Government. Travel costs/expenses will be considered reasonable and allowable only to the extent that they do not exceed, on a daily basis, the maximum per diem rates in effect at the time of the travel. Travel expenses include airfare, per-dem, rental car, local travel and miscellaneous expenses as authorized by the Joint Travel Regulations (JTR). Costs for transportation may be based upon mileage rates, actual costs incurred or a combination thereof, provided the method used results in a reasonable charge. No mileage costs will be incurred when travel is within a 50-mile radius of the primary work location. The JTR, while not wholly applicable to Contractors, shall provide the basis for the determination as to reasonable and allowable. Maximum use is to be made of the lowest available customary standard coach or equivalent airfare accommodation available during normal business hours. Exceptions to these guidelines shall be approved in advance by the Contracting Officer or

Designee. Travel dates and locations are to be confirmed through the TA and approved by the COR in writing via email, prior to commencement of any travel.

4.4 Observed Federal Holidays

Columbus Day Veterans Day Thanksgiving Christmas Day New Year's Day MLK Jr. Day / Inauguration Day Mon Washington's Birthday Mon Spring Holiday (MIL Only) Sun Memorial Day Juneteenth National Independence Day Independence Day Labor Day

4.5 Travel Instructions

4.5.1 Any travel OCONUS by the Contractor will need to review the Foreign Clearance Guide at http://www.fcg.pentagon.mil/fcg.cfm (CAC enabled) and select the country of intended travel. During OCONUS travel, the contractor shall operate in accordance with International Traffic in Arms Regulation (ITAR) Part 124, approved by US Department of State, Office of Defense Trade Controls. Specific guidance can be found at:

https://www.pmddtc.state.gov/regulations_laws/itar.html.

4.5.2 The Contractor is not authorized to perform any travel that is not in conjunction with this contract. It is the Department of the Navy (DON) policy not to allow a charge of profit or fee on reimbursable items.

4.5.3 The Government will make no reimbursements for a contractor's local travel defined as less than 50 miles from the place of performance, place of performance in support of this contract is OPTEVFOR, 7970 Diven Street, Norfolk Va 23505-1498.

4.5.4 In no instance shall the contractor exceed the amount specified in the contract for travel CLIN expenses.

4.5.5 Locations include CONUS, OCONUS and at sea locations and any other location, which may be added on a task order basis based on future test requirements.

4.5.6 For planning purposes any travel location OCONUS must be considered as a possible travel location unless travel restrictions at time of test do not permit entry. Possible OCONUS locations include, but are not limited to the following: Andros Island, Bahamas, Darwin, Brisbane, Melbourne, Newcastle, Perth, and Sydney, Australia; London, England; Honduras, Singapore; La Spezia, Italy; Guam; Hawaii; Halifax, Nova Scotia; Nanoose, British Colombia; Columbia; Belize; Guatemala; Souda Bay, Crete; Mexico; and any other location, which may be added on a task order basis based on future test requirements.

5. Specific Tasking. The contractor shall provide support in evaluating the operational effectiveness and suitability of the system under test that has been assigned to OPTEVFOR for OT&E in accordance with the processes and procedures prescribed in OPTEVFOR M-3980.2 (series), the Operational Test and Evaluation Manual. This manual and other governing OT&E references are listed in paragraph 8 and are available from the OT Resource Library on the OPTEVFOR Sharepoint site: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.

aspx.

5.1 All government furnished Non-Secure Internet Protocol Router (NIPR) templates to be used by the contractor shall only be obtained from the authoritative source, the OT Resource Library on the OPTEVFOR Sharepoint site:

https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx.

5.2 All government furnished Secure Internet Protocol Router (SIPR) templates to be used by the contractor shall only be obtained from the authoritative source, the OPTEVFOR SIPR Share Drive:

5.3 The contractor shall sign up for the OPTEVFOR "Alerts for OT Resource Changes" to receive updates (which can be tailored on what you receive) on all instructions, Best Practices, and templates. Instructions to sign up are found on the OPTEVFOR SharePoint page under 01A - Operations, OT Instructions and Guidance:

https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx.

5.4 Mission Based Test Design

5.4.1 Mission Analysis

5.4.1.1 The Contractor shall perform Mission Based Test Design mission analysis in accordance with references (IEF Checklist) and (IEF Template).

5.4.1.2 The contractor shall analyze source data to perform Mission Based Test Design mission analysis.

5.4.1.3 The contractor shall identify and document the mission areas.

5.4.1.4 The contractor shall identify and document system capabilities.

5.4.1.5 The contractor shall derive and document operator tasks.

5.4.1.6 The contractor shall define and document the operational conditions applicable to the system to be tested.

5.4.1.7 The contractor shall document the mission analysis in the Mission Based Test and Evaluation System (MBTES).

5.4.1.8 The contractor shall document the mission analysis in an Integrated Evaluation Framework (IEF) document.

5.4.1.9 The contractor shall review the mission analysis during MBTD reviews.

5.4.1.10 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of mission analysis MBTD reviews.

5.4.2 Requirements Analysis

5.4.2.1 The contractor shall perform Mission Based Test Design requirements analysis in accordance with references (IEF Checklist) and (IEF Template).

5.4.2.2 The contractor shall analyze source data to perform Mission Based Test Design requirements analysis.

5.4.2.3 The contractor shall identify and document measures of system performance, inclusive of critical measures.

5.4.2.4 The contractor shall link measures of system performance to subtasks and document this linkage.

5.4.2.5 The contractor shall identify and document the data required to quantify the measures of system performance.

5.4.2.6 The contractor shall identify and document the data required to quantify the operational conditions applicable to the system to be tested.

5.4.2.7 The contractor shall document requirements analysis in the Mission Based Test and Evaluation System (MBTES).

5.4.2.8 The contractor shall review the requirements analysis during MBTD reviews.

5.4.2.9 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of requirements analysis MBTD reviews.

5.4.3 Test Design

5.4.3.1 The Contractor shall perform Mission Based Test Design test design in accordance with references (IEF Checklist) and (IEF Template).

5.4.3.2 The contractor shall analyze source data to perform Mission Based Test Design test design.

5.4.3.3 The contractor shall identify and document the candidate response variables for statistical test design.

5.4.3.4 The contractor shall identify and document factors/conditions (with corresponding levels) associated with each response variable or critical measure used in test design.

5.4.3.5 The contractor shall participate in and document the statistical test design for candidate response variables and/or critical measures.

5.4.3.6 The contractor shall identify and document the test vignettes.

5.4.3.7 The contractor shall determine and document the appropriate test method.

5.4.3.8 The contractor shall determine and document a test schedule supporting execution of the test design.

5.4.3.9 The contractor shall identify and document the expected use of Modeling and Simulation in the execution of the test design.

5.4.3.10 The contractor shall determine and document the resources required to conduct the test.

5.4.3.11 The contractor shall determine and document the limitations to test based on known availability of resources and assets to conduct the test.

5.4.3.12 The contractor shall develop and document data sheets to support test execution.

5.4.3.13 The contractor shall document the test design in the Mission Based Test and Evaluation System (MBTES).

5.4.3.14 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of test design MBTD reviews.

5.5 Stakeholder Collaboration (WIPTs, outreach, etc.)

5.5.1 The contractor shall make recommendations to the warfare division in accordance with OPTEVFOR processes found in references (IEF Checklist) and (IEF Template).

5.5.2 The contractor shall identify and recommend outside organization(s) for participation and inclusion in Test Design activities.

5.5.3 The contractor shall coordinate briefings/meetings in support of OPTEVFOR Test Design activities in accordance with references (IEF Checklist) and (IEF Template).

5.5.4 The contractor shall participate in briefings/meetings in support of OPTEVFOR Test Design activities in accordance with references (IEF Checklist) and (IEF Template).

5.5.5 The contractor shall lead briefings/meetings in support of OPTEVFOR Test Design activities in accordance with references (IEF Checklist) and (IEF Template).

5.5.6 The contractor shall provide a trip report (Deliverable A002) when contract activities occur away from the OPTEVFOR site in Norfolk, VA.

5.6 Document and Brief Preparation

5.6.1 The contractor shall prepare and document briefings to include the Integrated Evaluation Framework, Executive In-Process Review and stakeholder collaboration briefings.

5.6.2 The contractor shall prepare and document briefings to include the Test Plan, Data Collection Plan, Concept of Test, Test Plan Review Board and stakeholder collaboration briefings.

5.6.3 The contractor shall prepare and document briefings to include the M&S Requirements Letter, Accreditation Plan, Verification and Validation Report Addendum, Accreditation Letter and stakeholder collaboration briefings.

5.6.4 The contractor shall prepare and document briefings to include the Evaluation Report, Post-Test Brief, Scoring Board, CEWG Brief, SERB/E- SERB Brief, Data Analysis Summary and Blue/Gold Sheets.

5.6.5 The contractor shall prepare the Risk/Deficiency cover letter, the DAS, and the Test report per references OT&E Manual (Formerly OTD Manual), Templates, and Best Practice Series.

5.7 Test and Evaluation Master Plan (TEMP) Input Preparation

5.7.1 The contractor shall analyze source data to provide input to the TEMP, to include program schedules, the Integrated Evaluation Framework, applicable policy documents and any other program-provided materials

5.7.2 The contractor shall develop and document input to the TEMP IAW the DOT&E TEMP Guidebook.

5.7.3 The contractor shall develop and document comments to the TEMP related to or affecting OT.

5.7.4 Stakeholder Collaboration

5.7.4.1 The contractor shall make recommendations to the warfare division in accordance with OPTEVFOR processes found on OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.7.4.2 The contractor shall coordinate briefings/meetings in support of OPTEVFOR Temp Input activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.7.4.3 The contractor shall participate in briefings/meetings in support of OPTEVFOR Temp Input activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.7.4.4 The contractor shall lead briefings/meetings in support of OPTEVFOR Temp Input activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.7.4.5 The contractor shall provide a trip report when the activities occur away from the OPTEVFOR site in Norfolk, VA.

5.8 Test Planning

5.8.1 Plan of Action and Milestones (POA&M)

5.8.1.1 The contractor shall develop and document a POA&M for the Test Planning process in accordance with reference (test planning checklist).

5.8.1.2 The contractor shall analyze source data to perform Test Planning POA&M development.

5.8.1.3 The contractor shall obtain and maintain access to the program MBTES database.

5.8.2 Purpose of Test

5.8.2.1 The contractor shall perform the activities associated with development of Purpose of Test in accordance with reference (test planning checklist).

5.8.2.2 The contractor shall analyze source data to perform Test Planning Purpose of Test development.

5.8.2.3 The contractor shall update and document the System Under Test (SUT) and System of Systems (SoS) descriptions from the Integrated Evaluation Framework for use in the Test Plan.

5.8.2.4 The contractor shall identify and document the SUT test configuration.

5.8.2.5 The contractor shall identify and document the Developmental Test (DT)/Integrated Test (IT) contributions to OT.

5.8.2.6 The contractor shall identify and document regression test requirements for any Follow-on OT&E phases, if applicable.

5.8.2.7 The contractor shall identify and document changes to the limitations to test.

5.8.2.8 The contractor shall update and document the Mission Critical Subsystem Matrix (MCSM) from the Integrated Evaluation Framework.

5.8.2.9 The contractor shall identify and document Scoring Board Guidance.

5.8.2.10 The contractor shall document the Purpose of Test activities in a Test Plan document in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.2.11 The contractor shall review the Purpose of Test activities during test plan reviews.

5.8.2.12 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Purpose of Test plan reviews.

Note Templates can be found at the following location: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx

5.8.3 Test Schedule

5.8.3.1 The contractor shall perform the activities associated with development of the Test Schedule in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.3.2 The contractor shall analyze source data to perform Test Planning Test Schedule development.

5.8.3.3 The contractor shall identify, recommend and document data to be qualified for use in OT.

5.8.3.4 The contractor shall develop and document the Test Schedule, to include test events, for each test phase and period.

5.8.3.5 The contractor shall document the Test Schedule data in the Mission Based Test and Evaluation System (MBTES).

5.8.3.6 The contractor shall document the Test Schedule activities in a Test Plan document in accordance with OPTEVFOR SharePoint site located at:

https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.3.7 The contractor shall review the Test Schedule activities during test plan reviews.

5.8.3.8 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Test Schedule test plan reviews.

5.8.4 Detailed Method of Test

5.8.4.1 The contractor shall perform the activities associated with development of the Detailed Method of Test in accordance with reference (test planning checklist).

5.8.4.2 The contractor shall analyze source data to perform Test Planning Detailed Method of Test development.

5.8.4.3 The contractor shall identify and document the data to be collected at each test event.

5.8.4.4 The contractor shall develop and document the start and stop criteria for each test event.

5.8.4.5 The contractor shall develop and document the GO/NO GO criteria for each test event.

5.8.4.6 The contractor shall develop and document the Detailed Method of Test for each test event.

5.8.4.7 The contractor shall document the Detailed Method of Test in a Test Plan document in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.4.8 The contractor shall review the Detailed Method of Test during test plan reviews.

5.8.4.9 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Detailed Method of Test plan reviews.

5.8.5 Data Collection Plan (DCP)

5.8.5.1 The contractor shall perform the activities associated with development of the Data Collection Plan in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.5.2 The contractor shall analyze source data to perform Test Planning Data Collection Plan development.

5.8.5.3 The contractor shall review, update and document, as required, any changes to data requirements.

5.8.5.4 The contractor shall develop and document the Data Collection Plan.

5.8.5.5 The contractor shall create and document data sheets, interview sheets, focus group sheets, and survey sheets in support of the Data Collection Plan.

5.8.5.6 The contractor shall document the Data Collection Plan data in the Mission Based Test and Evaluation System (MBTES).

5.8.5.7 The contractor shall document the Data Collection Plan in a Test Plan document in accordance with OPTEVFOR SharePoint site located at:

https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.5.8 The contractor shall review the Data Collection Plan during test plan reviews.

5.8.5.9 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Collection Plan test plan reviews.

5.8.6 Data Analysis Plan (DAP)

5.8.6.1 The contractor shall perform the activities associated with development of the Data Analysis Plan in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx.

5.8.6.2 The contractor shall analyze source data to perform Test Planning Data Analysis Plan development.

5.8.6.3 The contractor will develop and document the COI resolution method.

5.8.6.4 The contractor will develop and document data scoring criteria.

5.8.6.5 The contractor shall document the Data Analysis Plan in a Test Plan document in accordance with OPTEVFOR SharePoint site located at:

https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx.

5.8.6.6 The contractor shall review the Data Analysis Plan during test plan reviews.

5.8.6.7 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Analysis Plan test plan reviews.

5.8.7 Stakeholder Collaboration (WIPTs, outreach, etc.)

5.8.7.1 The contractor shall make recommendations to the warfare division in accordance with OPTEVFOR processes found on OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.7.2 The contractor shall identify and recommend outside organization(s) for participation and inclusion in Test Planning activities.

5.8.7.3 The contractor shall coordinate briefings/meetings in support of OPTEVFOR Test Planning activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.7.4 The contractor shall participate in briefings/meetings in support of OPTEVFOR Test Planning activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.7.5 The contractor shall lead briefings/meetings in support of OPTEVFOR Test Planning activities in accordance with OPTEVFOR SharePoint site located at: https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/SitePages/01A-Division-OT-Resources.aspx .

5.8.7.6 The contractor shall provide a trip report when the activities occur away from the OPTEVFOR site in Norfolk, VA.

5.8.8 Document and Brief Preparation

5.8.8.1 The contractor shall prepare and document briefings (Deliverable A001) to include the Integrated Evaluation Framework, Executive In- Process Review and stakeholder collaboration briefings.

5.9 Modeling and Simulation (M&S) Support

5.9.1 M&S Requirements Development

5.9.1.1 The Contractor shall perform M&S Requirements Development in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practice series).

5.9.1.2 The contractor shall identify and document candidate critical measures/response variables, along with their associated conditions, during the Test Design portion of the MBTD process that will be supplemented by M&S data.

5.9.1.3 The contractor shall develop and document a M&S Requirements letter in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practice series).

5.9.1.4 The contractor shall review the M&S requirements during MBTD reviews.

5.9.1.5 The contractor shall provide meeting minutes, including any required comment resolution matrix for issues, to document the results of M&S Requirements Development.

5.9.2 Develop accreditation plans

5.9.2.1 The contractor shall develop an M&S Accreditation Plan in accordance with references (OPTEVFORINST 5000.1 SERIES), (Best Practice series) and (Accreditation Plan Development Guide).

5.9.2.2 The contractor shall develop and document the accreditation approach method consistent with OPTEVFOR policy.

5.9.2.3 The contractor shall develop and document the Accreditation Plan.

5.9.2.4 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S Accreditation Plan Development.

5.9.3 Review Verification &Validation (V&V) Plans and Reports

5.9.3.1 The contractor shall review program M&S V&V plans and reports in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practice series).

5.9.3.2 The contractor shall review and document disagreements or issues with V&V plan methodologies.

5.9.3.3 The contractor shall provide recommendations for alternative V&V methodologies supporting OPTEVFOR Accreditation Requirements.

5.9.3.4 The contractor shall review program M&S V&V reports and document disagreements or issues with methodologies/results based on comparison with live test results.

5.9.3.5 The contractor shall develop and document the OPTEVFOR V&V Report addendum.

5.9.3.6 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S V&V Plans or Reports reviews.

5.9.4 Accreditation Support

5.9.4.1 The contractor shall perform M&S Accreditation in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practice series).

5.9.4.2 The contractor shall perform and document, in coordination with OPTEVFOR Test Design analysts, any additional required analysis not provided in the V&V report in support of accreditation.

5.9.4.3 The contractor shall identify, and document conclusions and recommendations based on comparison of live test results with M&S test results.

5.9.4.4 The contractor shall identify and document significant M&S limitations that impact the accreditation recommendation.

5.9.4.5 The contractor shall identify and document where the M&S results support the intended use for OT.

5.9.4.6 The contractor shall develop and document an accreditation recommendation in an Accreditation Letter.

5.9.4.7 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of M&S Accreditation activities and reviews.

5.9.5 Stakeholder Collaboration

5.9.5.1 The contractor shall make recommendations to the warfare division in accordance with OPTEVFOR processes found in references (OPTEVFORINST 5000.1 series) and (Best Practice series). https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/OTResourceLibrary/Forms /AllItems.aspx?FilterField1=LibraryCa tegory&FilterValue1=OTF%20Instructions&FilterType1=Choice&sortField=Modified&is Ascending=false&viewid=6f07f94d%2D9cbf%2D4d7b%2Da5af%2Dd960f8a2

5.9.5.2 The contractor shall identify and recommend outside organization(s) for participation and inclusion in M&S VV&A activities.

5.9.5.3 The contractor shall coordinate briefings/meetings in support of OPTEVFOR M&S VV&A activities in accordance with references (OPTEVFORINST 5000.1 series) and (Best Practice series). https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/OTResourceLibrary/Forms /AllItems.aspx?FilterField1=LibraryCa tegory&FilterValue1=OTF%20Instructions&FilterType1=Choice&sortField=Modified&is Ascending=false&viewid=6f07f94d%2D9cbf%2D4d7b%2Da5af%2Dd960f8a2

5.9.5.4 The contractor shall participate in briefings/meetings in support of OPTEVFOR M&S VV&A activities in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practice series).

5.9.5.5 The contractor shall lead briefings/meetings in support of OPTEVFOR M&S VV&A activities in accordance with references (OPTEVFORINST 5000.1 SERIES) and (Best Practices). https://flankspeed.sharepoint-mil.us/sites/OPTEVFOR/OTResourceLibrary/Forms/AllItems.

aspx?FilterField1=LibraryCa tegory&FilterValue1=OTF%20Instructions&FilterType1=Choice&sortField=Modified&is Ascending=false&viewid=6f07f94d%2D9cbf%2D4d7b% 2Da5af%2Dd960f8a2

5.9.5.6 The contractor shall provide a trip report when the activities occur away from the OPTEVFOR site in Norfolk, VA.

5.9.6 Document and Brief Preparation

5.9.6.1 The contractor shall prepare and document briefings to include the Integrated Evaluation Framework, Executive In-Process Review and stakeholder collaboration briefings.

5.10 Test Execution

5.10.1 Pre-test Coordination

5.10.1.1 The contractor shall identify and schedule required test services (ranges, targets, personnel, etc.) for the test phase.

5.10.1.2 The contractor shall develop and submit asset scheduling requests to OPTEVFOR Fleet Services schedulers in accordance with reference OT&E Manual (Formerly OTD Manual).

5.10.1.3 The contractor shall develop and provide the OPTEVFOR pre-test letters for test units and ISICs in accordance with reference OT&E Manual (Formerly OTD Manual).

5.10.1.4 The contractor shall develop and provide briefing materials as required to support Operational Test Requirements Reviews (OTRRs).

5.10.2 Pre-test Brief

5.10.2.1 The contractor shall prepare and document the Pre-Test briefing.

5.10.3 Test Operations

5.10.3.1 The contractor shall collect and document test data using data cards/sheets, interview sheets, focus group sheets, and survey sheets in accordance with OPTEVFOR procedures and the signed test plan.

5.10.3.2 The contractor shall distribute text execution materials to all test participants.

5.10.3.3 The contractor shall develop and document any test deviations resulting from test variances.

5.10.3.4 The contractor shall develop and document a daily summary of test operations email.

5.10.4 Post-Test Activities

5.10.4.1 The contractor shall conduct and document post-test interviews for all test events requiring interviews of participants.

5.10.4.2 The contractor shall conduct and document test team debriefs.

5.10.4.3 The contractor shall conduct and document test-site scoring boards.

5.11 Post-Test Iterative Process (PTIP) and Reporting

5.11.1 Data Scoring

5.11.1.1 The Contractor shall perform PTIP Data Scoring in accordance with references OT&E Manual (Formerly OTD Manual) and (Best Practice series).

5.11.1.2 The contractor shall inventory, compile and document all collected data, comparing data collected to that required by the Test Plan scope, DMOT and DCP.

5.11.1.3 The contractor shall develop and document a test execution summary.

5.11.1.4 The contractor shall review the data during Data Scoring reviews.

5.11.1.5 The contractor shall develop and document the End of Test message.

5.11.1.6 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Scoring reviews.

5.11.2 COI Evaluation

5.11.2.1 The Contractor shall perform PTIP COI Evaluation in accordance with OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.2.2 The contractor shall develop and document risks and/or deficiencies on OPTEVFOR Blue and Gold Sheets.

5.11.2.3 The contractor shall develop and document test results in OPTEVFOR test report results paragraphs.

5.11.2.4 The contractor shall document any limitations to test identified during test execution.

5.11.2.5 The contractor shall develop and document COI evaluation via the COI Evaluation Chart.

5.11.2.6 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of COI Evaluation reviews.

5.11.3 Data Analysis

5.11.3.1 The Contractor shall perform PTIP Data Analysis in accordance with reference OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.3.2 The contractor shall conduct and document an analysis of all critical measures.

5.11.3.3 The contractor shall develop and conduct an RV Analysis Out brief in coordination with Test Design Analyst support.

5.11.3.4 The contractor shall develop a draft Data Analysis Summary (DAS).

5.11.3.5 The contractor shall review the DAS during Analysis Working Groups (AWG).

5.11.3.6 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Data Analysis reviews.

5.11.4 Deficiency/Risk Documentation

5.11.4.1 The Contractor shall perform PTIP Deficiency/Risk Documentation in accordance with reference OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.4.2 The contractor shall distribute and collect comments on draft Blue/Gold Sheets.

5.11.4.3 The contractor shall review the Deficiencies/Risks during PTIP reviews.

5.11.4.4 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of Deficiency/Risk reviews.

5.11.5 System Evaluation

5.11.5.1 The Contractor shall perform PTIP System Evaluation in accordance with reference OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.5.2 The contractor shall develop and document evaluation reports to support Command SERB/E-SERB PTIP reviews.

5.11.5.3 The contractor shall review the system evaluation during PTIP reviews.

5.11.5.4 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of System Evaluation reviews.

5.11.6 Stakeholder Collaboration

5.11.6.1 The contractor shall make recommendations to the warfare division in accordance with OPTEVFOR processes found in references OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.6.2 The contractor shall identify and recommend outside organization(s) for participation and inclusion in PTIP activities.

5.11.6.3 The contractor shall coordinate briefings/meetings in support of OPTEVFOR PTIP activities in accordance with references OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.6.4 The contractor shall participate in briefings/meetings in support of OPTEVFOR PTIP activities in accordance with references OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.6.5 The contractor shall lead briefings/meetings in support of OPTEVFOR PTIP activities in accordance with references OT&E Manual (Formerly OTD Manual) and (Best Practice Series).

5.11.6.6 The contractor shall provide a trip report when the activities occur away from the OPTEVFOR site in Norfolk, VA.

5.11.7 Document and Brief Preparation

5.11.7.1 The contractor shall prepare and document briefings to include the Integrated Evaluation Framework, Executive In-Process Review and stakeholder collaboration briefings.

5.12 Cyber Security Subject Matter Expert/Operational (SME).

5.12.1 Cyber Security Support.

5.12.1.1 IAW the DoD Cybersecurity Test and Evaluation Guidebook 2.0 Series, the contractor shall utilize paragraph F.2.1.2, Cybersecurity Subject Matter Experts and Figure F-2 RASCI Table to assist the OTD and 01D Exploitation Analyst (EA) in cyber test preparations and coordination.

5.12.2 Cyber Survivability Test Planning and Research.

5.12.2.1 The Contractor shall support Cyber Survivability Test Planning Research in accordance with Cyber Test Planning Process guidance.

5.12.2.2 The contractor shall review and identify technical documents required to support Cyber Survivability Test Planning.

5.12.2.3 The contractor shall identify need dates for all required technical documents and provide dates to the OTD/OTC.

5.12.2.4 The contractor shall identify previous and planned Cyber Survivability tests that may contribute to current Cyber Survivability efforts.

5.12.2.5 The contractor shall conduct a Cyber Survivability level of test review with Warfare Division and Code 01D.

5.12.2.6 The contractor shall coordinate with Fleet Resources and the OTD/OTC to determine asset availability in support of Cyber Security objectives.

5.12.2.7 The contractor shall develop and provide a Cyber Survivability POA&M to support the test planning effort.

5.12.2.8 The contractor shall identify and provide risk management and recertification baseline concerns for communication to the Program Management Office (PMO).

5.12.2.9 The contractor shall document the test planning research in a Cyber Survivability Test Plan document.

5.12.2.10 The contractor shall review the test planning research during Cyber Survivability reviews.

5.12.2.11 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of test planning research during Cyber Survivability Test Planning reviews.

5.12.3 Cyber SUT/SoS and Schedule Development.

5.12.3.1 The Contractor shall support Cyber Survivability SUT/SoS and Schedule Development in accordance with Cyber Test Planning Process guidance.

5.12.3.2 The contractor shall identify and document the system attack surface.

5.12.3.3 The contractor shall identify and document the system attack vectors.

5.12.3.4 The contractor shall develop and document Cyber Survivability Test Plan site visit objectives.

5.12.3.5 The contractor shall develop and document the test execution schedule.

5.12.3.6 The contractor shall document the SUT/SoS and Schedule in a Cyber Survivability Test Plan document.

5.12.3.7 The contractor shall review the SUT/SoS and Schedule during Cyber Survivability reviews.

5.12.3.8 The contractor shall provide meeting minutes, to include any required comment resolution matrix for issues, to document the results of SUT /SoS and Schedule during Cyber Survivability Test Planning reviews.

5.12.4 Cyber Survivability Test Plan Site Visit.

5.12.4.1 The contractor shall support Cyber Survivability Test Plan Site Visit in accordance with Cyber Test Planning Process guidance.

5.12.4.2 The contractor shall coordinate dates, attendance lists, and documentation requirements with the PMO prior to execution of the site visit.

5.12.4.3 The contractor shall develop and conduct an informal site visit in-brief covering the purpose of the site visit and what the site visit personnel should expect.

5.