PERFORMANCE WORK STATEMENT

Facilitation, Training, and Accelerator Team Support

18 October 2025

1. Scope of Tasking. Contractor will provide technical and analytical support to Operational Test and Evaluation

(T&E) Force (OPTEVFOR) Technical Point of Contact (TPOC), the Test Design Division (01B). The contractor will facilitate processes, aid in production, train personnel, and collaborate with stakeholders. This work will require adherence to policy, review of existing material, creation of unique inputs, attendance at working-groups, briefing of leadership, and tracking of metrics.

1.1. Tasking Categories. The tasking within this contract is divided into four categories.

1.1.1. Statistical Analysis. Support use of Scientific Test and Analysis Techniques (STAT), including Design of Experiments (DOE) and regression analysis, for pre-test design, mid-test adjustment, and post-test analysis. Tasking specifics are provided in section 2.

1.1.2. MBTD. Perform Core Team Facilitator (CTF) and training duties when directed. Tasking specifics are provided in section 3.

1.1.2.1. Facilitate the Mission-Based Test Design (MBTD) process, consulting with test teams to improve their Integrated Evaluation Frameworks (IEF) creation efforts. Contribute per policy to test strategies, test plans, and post-test processing.

1.1.2.2. Provide on-site and offsite training on MBTD policies and practices, to include a multi-day course for a classroom of students that can be run at OPTEVFOR or other customer organizations. Classroom training for the Mission-Based Test and Evaluation System (MBTES) is not part of this contract.

1.1.3. Modeling and Simulation (M&S). Aid test teams in following the Verification, Validation and Accreditation (VV&A) processes when directed. Contribute per policy to requirements, plans, analyses, and letters. Tasking specifics are provided in section 4.

1.1.4. Accelerator Team. Support test programs that 01B designates as needing early involvement and/or additional assistance in test design, test planning, and/or post-test processing. These are programs for which other contract support is not yet established, or will not be funded. Tasking specifics are provided in section 5.

1.1.5. Program Management Support. The statistical analysis, MBTD, and M&S tasking categories have a combined program management support line item. The accelerator team also has program management support.

1.2. Background. OPTEVFOR is the Navy’s Operational Test (OT) Activity (OTA), providing credible, prompt, warfighting-focused test results to the operational and acquisition communities of the Navy, Marine Corps, and Coast Guard. Within this matrixed organization describe in reference (a), 01B functions as one of the three Competency Divisions, aiding the five Warfare Divisions in execution of OPTEVFOR’s policies and processes.

1.2.1. MBTD. MBTD, documented in reference (b), is the foundational approach used to structure OT.

1.2.1.1. In test design, test teams identify the minimum and adequate data needed to assess the effectiveness, suitability, and cyber survivability of a System Under Test (SUT) in the context of a System of Systems (SoS). The test design is documented in the IEF per reference (c) or (d).

1.2.1.2. The test strategy incorporates MBTD, establishing agreement on the resources required to support the scope of data collection, as well as a notional schedule for test execution and resource use. Alignment of OT with Developmental Test (DT) events allows for integrated test. Test and Evaluation Master Plan (TEMP) and Master Test Strategy (MTS) policies are found in references (e) and (f).

1.2.1.3. The MBTD process enables the Level-of-Test Determination (LTD) process summarized in reference (b). The decision options are OT, OTA observe DT, and no OTA participation.

1.2.1.4. MBTD principles also apply in test planning per reference (g) and reporting per reference (h).

1.2.1.5. MBTD enables test for organizations other than OPTEVFOR. Personnel from those organizations have come to OTPEVFOR for training. OPTEVFOR also takes training courses off-site as needed. One of these courses has been focused on MBTD.

1.2.2. STATs. Complex statistical calculations are supported by the 01B Analyst cell per reference (i), and done using methods accepted by academia with tools hosted on OPTEVFOR networks.

1.2.2.1. Tests that measure stochastic behaviors may require multiple samples under varying conditions to characterize performance across the battlespace. If applicable, DOE will be used pre-test to identify the most efficient test design. When DOE does not apply, other statistical methods can be used to scope test. Design efforts are per reference (b).

1.2.2.2. Data may be analyzed using inferential statistical methods after completion of the test to determine what effects were significant to the performance of the system. Regression analysis yields a predictive statistical model. Post-test analysis follows reference (h).

1.2.2.3. Training to test teams is required to ensure both OPTEVFOR personnel and external stakeholders understand the use and application of STATs. 01B accomplishes this on a team-by-team basis, rather than formal courses.

1.2.3. M&S VV&A. M&S use in OT is expanding. Effective use of M&S for OT relies on MBTD, STATs, and other disciplines specific to the VV&A process documented in references (j) and (k).

The OTA documents M&S requirements per reference (l), documents the accreditation plan per reference (m), and issues accreditation conclusions per reference (n).

1.2.4. Accelerated Acquisition Paths. Programs following the Middle Tier of Acquisition (MTA) path move quickly, while Software Acquisition Pathway (SWP) programs move faster still. There are also tests associated with Science and Technology (S&T) Fleet Experimentation (FLEX), S&T Rapid Capability Delivery (RCD), and Urgent Capability Acquisition (UCA). 01B may provide support to augment the warfare division. Adjustments to MBTD processes to meet the speed of SWP are provided in reference (o). The applicability of MBTD and TIEFs to S&T is covered by Reference (p).

1.3. Period of Performance. Performance period is 12 months from date of award with the option for four additional 12 month periods (Base + four option years) to be exercised at the discretion of the government.

1.3.1. Facilitation. Statistical Analysis, MBTD, and M&S facilitation is anticipated to be needed for the base year and all four option years.

1.3.2. Classroom Training. Presenting of classroom training on MBTD will be a separate line item.

Extension of other work into option years does not guarantee extension of the training class.

1.3.3. Accelerator Team. The Accelerator Team will be a separate line item from the other two.

Extension of other work into option years does not guarantee extension of the Accelerator Team.

1.4. Place of Performance. Unless required to support mission accomplishment, work shall primarily be performed at the customer’s site. The customer location is:

Operational Test and Evaluation Force 7970 Diven Street Norfolk, VA 23505-1498

1.4.1. The contractor shall comply with reference (q) with specific regard to non-government hardware and software.

1.4.2. The government will provide the contractor access to government facilities, as required, for performance of tasks under this contract. Contractor personnel shall comply with the instructions/guidance required by the facility.

1.5. Travel requirements per year. All travel costs shall be In Accordance With (IAW) the Federal Travel Regulations (FTR). Invoices shall include actual costs experienced. Airfare shall be based on the lowest available cost for coach or economy in writing, in advance. Travel dates and locations must be confirmed and approved in writing through the TPOC prior to commencement of any travel. The boxes below depict the anticipated travel for one year but will be repeated for each Option Year if the associated tasking category is exercised.

1.5.1. Facilitation

Location # of Trips # of Days each Trip Patuxent River, MD 2 2 Washington DC Area 2 2

1.5.2. Training

Location # of Trips # of Days each Trip

Port Hueneme, CA 1 5

1.5.3. Accelerator Team

Location # of Trips # of Days each Trip

Patuxent River, MD 1 2 Washington DC Area 2 2 China Lake, CA 1 5

1.5.4. The contractor is not authorized to perform any travel that is not in conjunction with this contract.

It is the Department of the Navy (DON) policy not to allow a charge of profit or fee on reimbursable items. The government will make no reimbursements for a contractor’s local travel.

The contractor shall not exceed the amount specified in the contract for travel.

1.6. Other Direct Cost (ODC). No ODC expenses are budgeted for this contract.

1.7. Personal Services. This is not a personal services contract. The contractors/sub-contractors should be well-educated in respect to “personal services”. No one (government employee or military) may task the contractor to perform work that is not listed in a task order.

1.8. Automated Data Processing (ADP) Requirements. The government will provide, if required, the necessary computer workstation/system access for on-site work. The offerors assigned ADP Government Furnished Property (GFP) will be held accountable to respond to the governments ADP inventory requirements conducted semi-annually re-occurring every Mar and Sep to ensure 100% accountability of all ADP assets. Any offeror not adhering to this call for inventory of ADP assets may be directed to forfeit their ADP GFP at no additional cost to the government IAW FAR 52.245-1.

1.9. Common Access Card (CAC) / Public Key Infrastructure (PKI), System Authorization Access Request (SAAR)-Navy (SAAR-N). All contractor personnel requiring access to Government Information Technology systems shall have an approved SAAR-N Form OPNAV 5239/14 (Rev Sep 2011) on file, and complete required Annual Information Awareness Training. New employees must submit their SAAR forms upon check-in on their first day of work. SAAR-N forms shall be submitted to the Command Information Officer (CIO) Department, specifically the Information Systems Security Manager (ISSM).

Instructions for processing the SAAR-N forms are available from the CIO Department.

1.10. CAC / Local Badges. Contractor CACs and facility-specific identification badges will be issued by the government to on-site contractor personnel and shall be visible at all times while personnel are at the government site. The contractor shall furnish all requested information required to facilitate issuance of identification badges and shall conform to all instructions/guidance required by the facility. All CACs and identification badges issued to contractor employees shall be returned to the Government Security Department at the government site IAW the instructions/guidance required by the OPTEVFOR facility following completion of the contract, relocation or termination of an employee, or upon request from the Contracting Officer’s Representative.

2. Statistical Analysis Tasking/Deliverables. The government reserves the right to specify deliverables at the task order level. Items required from the contractor under this tasking are specified in the Contract Data Requirements List (CDRL) 001-005. Up to six separate programs will be worked in parallel. Tasking to support these programs simultaneously is expected to occupy the full workload of two personnel. The personnel offered as analysts will complete the following tasks:

2.1. Test design

2.1.1. The contractor will act in the STAT analyst role supporting creation of test designs to scope OT IAW references (b) and (i). When assigned, the contractor shall:

2.1.1.1. Review program source data and existing MBTD products, as needed, to implement

STATs in the MBTD test design phase.

2.1.1.2. Train test teams on STAT implementation for design.

2.1.1.3. Appraise the candidate Response Variables (RV) and other effectiveness critical measures for validity of use of STATs.

2.1.1.4. Leverage existing data, performance predictions, and/or other quantitative means to inform STAT method selection and to align accepted uncertainty with expected results.

2.1.1.5. Consider the conditions/descriptors associated with each critical measure, including their assigned roles as blocks, factors, constants, or recordables.

2.1.1.6. Understand and account for test realities that yield blocking, hard-to-change factors, disallowed combinations, and/or other design constraints.

2.1.1.7. Coordinate with the test team to select deltas and/or interval widths that are operationally meaningful.

2.1.1.8. Consult with the test team to understand reasonable resourcing expectations for the test, and the related impacts to design.

2.1.1.9. Apply inferential statistical tools and methods to produce a test designs IAW OPTEVFOR best practices, Department of Navy (DoN) and Department of Defense (DoD) T&E policy, and commonly accepted industry practices.

2.1.1.10. Employ the appropriate statistical tools to make calculations.

2.1.1.11. Create sizing options that allow leadership to make impactful selections within the trade space of cost, schedule, and precision.

2.1.1.12. When needed, produce a run matrix for each RV, implementing randomization as appropriate.

2.1.1.13. Consult with the test team to verify the test design can be executed.

2.1.1.14. If warranted, propose changes to design inputs (measures, conditions, descriptors, roles, expectations, methods, etc.) to enable better design outputs.

2.1.1.15. Obtain peer review of test designs.

2.1.1.16. When appropriate, consult with test teams mid-test to adjust designs or to determine if data collection can end early based on results to date.

2.1.1.17. As needed, consult on other program documents and briefings to include the Executive

In-Process Review (E-IPR), stakeholder collaboration briefings, and Running Comment Resolution Matrices (CRM) (RCRM).

2.1.2. Collaboration and meetings. When assigned, the contractor shall:

2.1.2.1. Identify and recommend outside organization(s) for participation and inclusion in OT design activities.

2.1.2.2. Participate in briefings/meetings as a STAT analyst in support of Test Design activities

IAW references (a), (b), and (i).

2.1.2.3. As directed, lead briefings/meetings in support of STAT implementation IAW references (b) and (i).

2.1.2.4. Aid the test team in responding to stakeholder comments specific to STAT implementation.

2.1.2.5. Attend trainings that promulgate policy and best practices relevant to the STAT analyst role.

2.1.3. Documents, briefs, and tools. When assigned, the contractor shall:

2.1.3.1. Provide any run table files to the test team that can be easily imported to MBTES.

2.1.3.2. Document the test designs by inputting the STAT Analyst portions of reference (c).

2.1.3.3. As directed, review and/or prepare OPTEVFOR Test Design Policy guidance.

2.1.3.4. When appropriate or as directed, review, recommend, or create STAT tools for design.

2.1.3.5. As directed, adjust and/or maintain STAT software tools for design.

2.2. Post-test analysis

2.2.1. The contractor will act in the STAT analyst role supporting post-test data analysis IAW references

(g) and (i). When assigned, the contractor shall:

2.2.1.1. Receive data from test teams, and consult on whether it contains the information implied by the original test design.

2.2.1.2. Apply statistical tools and methods to produce exploratory data analysis.

2.2.1.3. Train test teams on STAT implementation for analysis.

2.2.1.4. Advise the test team on whether the collected data is sufficient for the intended analysis.

2.2.1.5. Apply statistical tools and methods to produce performance characterization for RVs defined in the test plan.

2.2.1.6. Apply statistical tools and methods to produce descriptive statistics and/or hypothesis testing results for RVs identified in the test plan where sufficient data is not available for RV analysis.

2.2.1.7. As directed, calculate reporting inputs for non-RV confidence intervals, tolerance intervals, or hypothesis tests.

2.2.1.8. Obtain peer review of RV analyses.

2.2.1.9. Support 01B Director review of RV analysis results.

2.2.1.10. As needed, advise the test team on how to best capture the characterization results in the report.

2.2.2. Collaboration and meetings. When assigned, the contractor shall:

2.2.2.1. Identify and recommend outside organization(s) for participation and inclusion in OT Post-Test Iterative Process (PTIP) activities.

2.2.2.2. When appropriate, participate in briefings/meetings as a STAT analyst in support of PTIP activities IAW references (h) and (i).

2.2.3. Documents, briefs, and tools. When assigned, the contractor shall:

2.2.3.1. Document RV analysis briefs per reference (r) for critical measures defined as RVs in the test plan.

2.2.3.2. When appropriate, provide documents and/or briefings to the test team for inclusion in the Data Analysis Summary.

2.2.3.3. As directed, review and/or prepare OPTEVFOR Post-Test Analysis Policy guidance.

2.2.3.4. When appropriate or as directed, review, recommend, or create STAT tools for analysis.

2.2.3.5. As directed, adjust and/or maintain STAT software tools for analysis.

2.3. Program management support

2.3.1. The contractor shall, IAW CDRL A001, provide trip reports with a synopsis of meetings attended, meeting attendees, major outcomes/coordination, and action items applicable to OPTEVFOR.

2.3.2. The contractor shall, IAW CDRL A002, provide the TPOC monthly reports including the progress of work on assigned tasks, conferences/meetings attended, work plans and the expenditure of funds, and labor hours during the month.

2.3.3. The contractor shall, IAW CDRL A003, provide the TPOC with a technical reports summary of all technical reports delivered during the reporting period.

2.3.4. The contractor shall, IAW CDRL A004, provide the government an annual assessment of performance in a Contract Performance Assessment Report (CPAR).

2.3.5. The contractor shall, IAW CDRL A005, provide résumés for all personnel proposed to perform work on this contract. The government shall review and determine acceptability.

3. MBTD Tasking/Deliverables. The government reserves the right to specify deliverables at the task order level.

Items required from the contractor under this tasking are specified in the CDRL 001-005. Up to twelve separate programs will be worked in parallel, with an additional twenty requiring awareness. Tasking to support all these programs simultaneously, along with classroom training, is expected to occupy half the workload of a single person. The personnel offered as MBTD facilitators will complete the following tasks:

3.1. Facilitation

3.1.1. The contractor will act in the CTF role supporting LTD IAW reference (b). When assigned, the contractor shall:

3.1.1.1. Function as a member of the core team alongside Warfare Division test teams to execute the LTD process.

3.1.1.2. Train test teams on LTD process and templates.

3.1.1.3. Review, comment on, and provide inputs to LTD products created by the test team for the assigned program.

3.1.1.4. Provide read-aheads to 01B leadership in preparation for LTD decisions, highlighting any important disagreements with the warfare division.

3.1.2. The contractor will act in the CTF role supporting creation of test designs IAW reference (b).

When assigned, the contractor shall:

3.1.2.1. Function as a member of the core team alongside Warfare Division test teams to execute the MBTD process.

3.1.2.2. Train test teams on MBTD process and templates.

3.1.2.3. Review, comment on, and provide inputs to MBTD products created by the test team for the assigned program.

3.1.2.4. Provide read-aheads to 01B leadership in preparation for MBTD review meetings, highlighting any important disagreements with the warfare division.

3.1.3. The contractor will act in the CTF role supporting collaboration on TEMPs and MTSs IAW reference (a). When assigned, the contractor shall:

3.1.3.1. Train test teams on TEMP and MTS processes.

3.1.3.2. Review, comment on, and provide inputs to TEMP/MTS products for the assigned program.

3.1.3.3. Ensure 01B leadership is properly included in routing of the TEMP/MTS, and is briefed on any issues.

3.1.4. The contractor will act in the CTF role supporting test planning IAW reference (g). When assigned, the contractor shall:

3.1.4.1. Function as a member of the core team alongside Warfare Division test teams to advise on IEF and MBTD inputs to the test planning process.

3.1.4.2. When appropriate, review, comment on, and provide inputs to test plan products created by the test team for the assigned program.

3.1.4.3. Provide read-aheads to 01B leadership in preparation for touchpoint B, highlighting any important deviations from the IEF.

3.1.5. The contractor will act in the CTF role supporting test reporting IAW reference (h). When assigned, the contractor shall:

3.1.5.1. Function as a member of the core team alongside Warfare Division test teams to advise on IEF and MBTD inputs to the reporting process.

3.1.5.2. When appropriate, contribute to data scoring.

3.1.5.3. When appropriate, review and provide inputs to RV analysis briefs created by the STAT analysts.

3.1.5.4. When appropriate, contribute to analysis evaluation.

3.1.6. Collaboration and meetings. When assigned, the contractor shall:

3.1.6.1. Identify and recommend outside organization(s) for participation and inclusion in OT design activities.

3.1.6.2. Advised test teams on the proper timing, duration, and attendance for process reviews.

3.1.6.3. Participate in briefings/meetings as a CTF in support of OT processes IAW references

(a), (b), (g), and (h).

3.1.6.4. Aid the test team in responding to stakeholder comments within the cognizance of the

CTF role.

3.1.6.5. Attend trainings that promulgate policy and best practices relevant to the CTF role.

3.1.7. Documentation, briefs, and tools. When assigned, the contractor shall:

3.1.7.1. Competently operate MBTES to perform facilitation duties and to train test teams.

3.1.7.2. As directed, provide policy inputs to modify the LTD process and/or templates.

3.1.7.3. As directed, provide policy inputs to modify the MBTD process and/or templates.

3.1.7.4. As directed, provide inputs to process trackers.

3.1.7.5. As directed, record process metrics.

3.2. Multi-day training course material

3.2.1. The contractor will deliver training products to the government. As directed, the contractor shall:

3.2.1.1. Structure the course to meet the objectives of MBTD training previously delivered to the government. The government shall give the contractor access to prior training materials.

3.2.1.2. Provide training slides and hypothetical reference documents.

3.2.1.3. Provide practical examples and group exercises.

3.2.2. The contractor shall keep the course materials updated to account for policy changes in references (b), (c), (e), and (f).

3.2.3. The contractor shall, as needed, tailor course material to best fit the needs of the organization being trained.

3.3. Multi-day training course instruction

3.3.1. The contractor will instruct one 3-day class on MBTD fundamentals to a classroom of 15-20 personnel who will need MBTD to support their testing work. As directed, the contractor shall:

3.3.1.1. Provide two instructors for the full duration of the class.

3.3.1.2. If required, take the necessary electronic materials with them to the training site.

3.3.2. The contractor will coordinate with non-OPTEVFOR organizations who request the course to meet their schedule and deliver the training at their site. As directed, the contractor shall:

3.3.2.1. Provide a training schedule with sufficient lead-time for the training customer to identify students and coordinate their attendance.

3.3.2.2. Coordinate with the TPOC and the training customer to preview the course, tailor as needed, and respond to relevant adjustments requested by that customer.

3.3.2.3. If required, coordinate with the training customer to ensure physical materials needed to conduct the course will be in place.

3.4. Program management support

3.4.1. The contractor shall, IAW CDRL A001, provide trip reports with a synopsis of meetings attended, meeting attendees, major outcomes/coordination, and action items applicable to OPTEVFOR.

3.4.2. The contractor shall, IAW CDRL A002, provide the TPOC monthly reports including the progress of work on assigned tasks, conferences/meetings attended, work plans and the expenditure of funds, and labor hours during the month.

3.4.3. The contractor shall, IAW CDRL A003, provide the TPOC with a technical reports summary of all technical reports delivered during the reporting period.

3.4.4. The contractor shall, IAW CDRL A004, provide the government an annual assessment of performance in a CPAR.

3.4.5. The contractor shall, IAW CDRL A005, provide résumés for all personnel proposed to perform

4. M&S Tasking/Deliverables. The government reserves the right to specify deliverables at the task order level.

Items required from the contractor under this tasking are specified in the CDRL 001-005. Up to four separate programs will be worked in parallel. Tasking to support four VV&A efforts simultaneously is expected to occupy a quarter of the workload of a single person. The personnel offered as M&S facilitators will complete the following tasks:

4.1. M&S VV&A Support

4.1.1. The contractor will act in the M&S analyst role supporting M&S Requirements creation IAW references (j) and (k). When assigned, the contractor shall:

4.1.1.1. Review the program MBTD and advise test teams on the viability of M&S use in OT data collection.

4.1.1.2. Review and provide inputs to M&S sections in the IEF and TEMP/MTS for assigned programs.

4.1.1.3. Function as a member of the core team alongside Warfare Division test teams to develop

M&S requirements.

4.1.1.4. Train test teams on M&S requirements policy and templates.

4.1.1.5. Review and provide inputs to M&S requirements products created by the test team for assigned programs.

4.1.1.6. Provide products for 01B leadership review, highlighting any important disagreements with the Warfare Division.

4.1.2. The contractor will act in the M&S analyst role supporting M&S Accreditation Planning IAW references (j) and (k). When assigned, the contractor shall:

4.1.2.1. Review the program M&S documentation and advise test teams on how to asses their nominative M&S solution.

4.1.2.2. Function as a member of the core team alongside Warfare Division test teams to plan

M&S accreditation.

4.1.2.3. Train test teams on M&S Accreditation Planning policy and templates.

4.1.2.4. Review and provide inputs to M&S Accreditation Plan products created by the test team for assigned programs.

4.1.2.5. Provide products for 01B leadership review, highlighting any important disagreements with the warfare division.

4.1.2.6. Review and provide inputs to M&S sections in the test plan for the assigned program.

4.1.2.7. Review Verification and Validation (V&V) Plan(s) to confirm the M&S validation approach will provide sufficient data to support OT accreditation.

4.1.3. The contractor will act in the M&S analyst role supporting M&S VV&A Analysis IAW references

(j) and (k). When assigned, the contractor shall:

4.1.3.1. Review V&V Report(s) to confirm adequate techniques for M&S validation have been conducted and documented.

4.1.3.2. Function as a member of the core team alongside Warfare Division test teams to make

M&S accreditation recommendations to OPTEVFOR leadership.

4.1.3.3. Train test teams on M&S accreditation decision policy and templates.

4.1.3.4. Review and provide inputs to M&S Accreditation Letters created by the test team for the assigned program.

4.1.3.5. Provide products for 01B leadership review, highlighting any important disagreements with the Warfare Division.

4.1.4. Collaboration and meetings. When assigned, the contractor shall:

4.1.4.1. Identify and recommend outside organization(s) for participation and inclusion in M&S

VV&A activities.

4.1.4.2. When appropriate, participate in briefings/meetings in support of M&S activities IAW reference (g).

4.1.4.3. As directed, lead briefings/meetings in support of M&S activities IAW reference (g).

4.1.4.4. Aid the test team in responding to stakeholder comments specific to M&S.

4.1.4.5. Attend trainings that promulgate policy and best practices relevant to the M&S analyst role.

4.1.5. Documents and briefs. When assigned, the contractor shall:

4.1.5.1. Provide lessons learned on processes, to improve policy and/or practices.

4.1.5.2. As directed, review and/or prepare OPTEVFOR M&S Policy guidance.

4.1.5.3. As directed, record process metrics.

4.2. Program management support

4.2.1. The contractor shall, IAW CDRL A001, provide trip reports with a synopsis of meetings attended, meeting attendees, major outcomes/coordination, and action items applicable to OPTEVFOR.

4.2.2. The contractor shall, IAW CDRL A002, provide the TPOC monthly reports including the progress of work on assigned tasks, conferences/meetings attended, work plans and the expenditure of funds, and labor hours during the month.

4.2.3. The contractor shall, IAW CDRL A003, provide the TPOC with a technical reports summary of all technical reports delivered during the reporting period.

4.2.4. The contractor shall, IAW CDRL A004, provide the government an annual assessment of performance in a CPAR.

4.2.5. The contractor shall, IAW CDRL A005, provide résumés for all personnel proposed to perform

5. Accelerator Team Tasking/Deliverables. Items required from the contractor under this tasking are specified in the CDRL 001-005. Up to three separate programs will be worked in parallel, with the infrequent need to expand to four. Each program is expected to occupy half the workload of a single person. The personnel offered as accelerator team members will complete the following task:

5.1. Test design support

5.1.1. The contractor shall, when assigned, perform LTD IAW reference (b). When assigned, the contractor shall:

5.1.1.1. Identify the acquisition decision, system capability changes, employment changes, and

DT plans that inform the LTD decision.

5.1.1.2. Aid in recommending an OTA participation type.

5.1.2. The contractor shall, when assigned, perform MBTD mission analysis IAW reference (b). When assigned, the contractor shall:

5.1.2.1. Analyze program source data to perform MBTD mission analysis.

5.1.2.2. Define the purpose of the MBTD effort, including subsequent test documents that will pull material from the IEF.

5.1.2.3. Detail the SUT, including components and capabilities, and the SoS.

5.1.2.4. Identify the Concept of Operations (CONOPS), sustainment concept, and cybersecurity concept.

5.1.2.5. Expand on suitability definitions as needed, and will detail how the mission critical systems support availability in missions.

5.1.2.6. Identify the mission areas, as well as the effectiveness, suitability, and cyber survivability Critical Operational Issues (COI).

5.1.2.7. Outline operator tasks.

5.1.2.8. Define the operational conditions applicable to the SUT’s support of tasks, including the associated descriptors, and link those conditions to operator tasks.

5.1.3. The contractor shall, when assigned, perform MBTD requirements analysis IAW reference (b).

When assigned, the contractor shall:

5.1.3.1. Analyze program source data and documents to perform MBTD requirements analysis.

5.1.3.2. Identify OT measures necessary to test all subtasks and/or COIs.

5.1.3.3. Link measures to subtasks.

5.1.3.4. Identify the data required to evaluate the measures.

5.1.3.5. Identify the data required to recall the operational conditions at test.

5.1.3.6. Identify critical tasks and the associated critical measures.

5.1.4. The contractor shall, when assigned, perform MBTD test design IAW reference (b). When assigned, the contractor shall:

5.1.4.1. Analyze program source data and documents to perform the MBTD test design phase.

5.1.4.2. Establish the objective in testing each critical measure, including the treatment of some as RVs, and justify its selection as critical.

5.1.4.3. Identify conditions (with corresponding levels) associated with each critical measure, and detail their design roles, ease-of-change, constraints, etc.

5.1.4.4. As appropriate, and with the help of the STAT Analyst, establish an executable designed experiment to meet the test objective.

5.1.4.5. Support selection of a minimum adequate test scope.

5.1.4.6. Establish post-test analysis plans.

5.1.4.7. Identify, refine, and summarize the test vignettes.

5.1.4.8. Support the development of all vignette run matrices.

5.1.4.9. Identify a test schedule supporting execution of the test design.

5.1.4.10. Summarize the expected use of M&S in the execution of the test.

5.1.4.11. Determine the resources required to conduct the test.

5.1.4.12. Detail the limitations to test based on known availability of resources and assets to conduct the test.

5.1.5. Collaboration and meetings. When assigned, the contractor shall:

5.1.5.1. Support preparation for and completion of LTD/MBTD reviews.

5.1.5.2. Provide meeting minutes, action items, and any required CRM for issues, to document the results of LTD/MBTD reviews.

5.1.5.3. Collaborate with the three Competency Divisions IAW OPTEVFOR processes found in references (a), (b), (o), and (p).

5.1.5.4. Identify and recommend outside organization(s) for participation and inclusion in

OPTEVFOR MBTD activities.

5.1.5.5. As directed, coordinate briefings/meetings in support of OPTEVFOR Test Design activities IAW references (a), (b), (o), and (p).

5.1.5.6. As directed, participate in briefings/meetings in support of OPTEVFOR Test Design activities IAW references (a), (b), (o), and (p).

5.1.5.7. As directed, lead briefings/meetings in support of OPTEVFOR Test Design activities

IAW references (a), (b), (o), and (p).

5.1.5.8. As directed, aid the test team in collaborating with external stakeholders and in responding to stakeholder comments on the MBTD.

5.1.6. Documents and briefs. When assigned, the contractor shall:

5.1.6.1. Provide briefings materials to include the E-IPR and LTD.

5.1.6.2. Build and maintain the MBTD in MBTES.

5.1.6.3. Document the MBTD in the IEF document per reference (c) or (d), as appropriate.

5.1.6.4. Support IEF document routing.

5.2. M&S support

5.2.1. The contractor shall, when directed, develop M&S requirements IAW references (j) and (k).

When assigned, the contractor shall:

5.2.1.1. Identify Specific Intended Uses (SIU), and how those link to assessment objectives.

5.2.1.2. Detail representation requirements, and how those link to SIUs.

5.2.1.3. Detail implementation requirements, and how those link to SIUs.

5.2.1.4. List documentation, programmatic, and support requirements.

5.2.2. The contractor shall, when directed, plan M&S accreditation IAW references (j) and (k). When assigned, the contractor shall:

5.2.2.1. Define the purpose of the Accreditation effort.

5.2.2.2. Update the SIUs and requirements previously defined in the requirements letter.

5.2.2.3. Summarize the M&S implementation, including how the model captures the operational scenarios and executes the designed test.

5.2.2.4. Detail Acceptability Criteria (AC), associated tolerances, evaluation methods, referent data, and how those ACs link to requirements.

5.2.2.5. Identify the prospective validation data sources.

5.2.2.6. Describe the evaluation methodology and data formats.

5.2.2.7. Detail M&S assumptions, limitations, and risks.

5.2.2.8. List accreditation process administrative, documentation, and management considerations and information.

5.2.2.9. Review and evaluate V&V plan methodologies for support of accreditation.

5.2.2.10. Provide recommendations for alternative V&V methodologies supporting accreditation.

5.2.3. Collaboration and meetings. When assigned, the contractor shall:

5.2.3.1. When appropriate, provide meeting minutes, action items, and any required CRM for issues, to document the results of M&S stakeholder meetings.

5.2.3.2. Identify and recommend outside organization(s) for participation and inclusion in M&S

VV&A activities.

5.2.3.3. As directed, coordinate briefings/meetings in support of M&S VV&A activities IAW references (j) and (k).

5.2.3.4. As directed, participate in briefings/meetings in support of M&S VV&A activities IAW references (j) and (k).

5.2.3.5. As directed, lead briefings/meetings in support of M&S VV&A activities IAW references (j) and (k).

5.2.3.6. As directed, aid the test team in collaborating with external stakeholders and in responding to stakeholder comments on M&S.

5.2.4. Documents and briefs. When assigned, the contractor shall:

5.2.4.1. As directed, provide briefing materials for stakeholder collaboration.

5.2.4.2. Document the M&S Requirements Letter per reference (l).

5.2.4.3. Document the M&S Accreditation Plan per reference (m).

5.2.4.4. Support M&S document routing.

5.3. Test strategy document support

5.3.1. The contractor shall, if directed, support translation of MBTD and/or M&S products into the

TEMP or MTS.

5.3.2. The contractor shall, if directed, support stakeholder collaboration on the TEMP or MTS.

5.3.3. The contractor shall, if directed, participate in T&E Working Integrated Product Team (WIPT) meetings.

5.3.4. The contractor shall, if directed, support review and routing of the TEMP or MTS.

5.4. Test planning support

5.4.1. The contractor will perform Test Planning IAW reference (g). When assigned, the contractor shall:

5.4.1.1. Review program references and information to perform test planning.

5.4.1.2. Define the purpose of the test.

5.4.1.3. Detail the test article, including difference from fielding, and the SoS.

5.4.1.4. Outline the CONOPS and the tactics.

5.4.1.5. Summarize the testing approach and the COIs.

5.4.1.6. Detail data coming from sources other than OT events, including DT contributions, data qualified for OT, and schedule integrated test.

5.4.1.7. Update limitations to test and testing resources.

5.4.1.8. Capture administrative considerations such as safety and project management.

5.4.1.9. Detail test execution, including schedule and events.

5.4.1.10. Update the MBTD, including tasks, conditions, measures, required data, vignettes, and/or run matrices.

5.4.1.11. Detail the data collection plan; create test cards, data sheets, interviews, surveys, etc.

5.4.1.12. Establish the post-test assessment or evaluations approaches, including scoring criteria.

5.4.2. Collaboration and meetings. When assigned, the contractor shall:

5.4.2.1. Support preparation for and completion of Test Planning reviews.

5.4.2.2. Provide meeting minutes, action items, and any required CRM for issues, to document the results of Test Planning reviews.

5.4.2.3. Collaborate with the three Competency Divisions IAW processes found in references (a) and (g).

5.4.2.4. Identify and recommend outside organization(s) for participation and inclusion in OPTEVFOR test planning activities.

5.4.2.5. As directed, coordinate briefings/meetings in support of Test Planning activities IAW references (a), (g), (o), and (p).

5.4.2.6. As directed, participate in briefings/meetings in support of Test Planning activities IAW references (a), (g), (o), and (p).

5.4.2.7. As directed, lead briefings/meetings in support of Test Planning activities IAW references (a), (g), (o), and (p).

5.4.2.8. As directed, aid the test team in collaborating with external stakeholders and in responding to stakeholder comments on the MBTD.

5.4.3. Documents and briefs. When assigned, the contractor shall:

5.4.3.1. Provide briefings materials to include the Concept of Test Brief and Test Plan Review

Board.

5.4.3.2. Build and maintain the Test Plan in MBTES.

5.4.3.3. Document the Test Plan per reference (s), (t), (u), (v), (w), or (x), as appropriate.

5.4.3.4. Support Test Plan document routing.

5.5. Test reporting support

5.5.1. The contractor will perform Test Reporting IAW reference (h). When assigned, the contractor shall:

5.5.1.1. Out-brief from test.

5.5.1.2. Score data.

5.5.1.3. When required, recommend and draft effectiveness, suitability, and cyber survivability calls.

5.5.1.4. When required, recommend and draft COI resolutions, results, and operational considerations.

5.5.1.5. When required, make fleet introduction and similar recommendations.

5.5.1.6. Quantify and/or qualify measure results or detail functional areas observed.

5.5.1.7. When required, summarize supporting data and the associate analyses to create results.

5.5.1.8. When required, draft deficiencies or risks separated between blue and gold sheets, as appropriate.

5.5.1.9. When required, detail test limitations.

5.5.1.10. When required, establish task and measure mission contributions via PMT Views.

5.5.2. Collaboration and meetings. When assigned, the contractor shall:

5.5.2.1. Support preparation for and completion of PTIP reviews.

5.5.2.2. Provide meeting minutes to document the results of PTIP reviews.

5.5.3. Documents and briefs. When assigned, the contractor shall:

5.5.3.1. As directed, provide briefings materials to include the System Evaluation Review Board

(SERB) and Executive SERB (ESERB).

5.5.3.2. Build and maintain the Issues in MBTES.

5.5.3.3. Document the Test Report per reference (y), (z), (aa), (ab), (ac), or (ad), as appropriate.

5.5.3.4. When appropriate, document the Data Analysis Summary per reference (ae) or (af), as appropriate.

5.5.3.5. Support Test Report document routing.

5.6. Program management support

5.6.1. The contractor shall, IAW CDRL A001, provide trip reports with a synopsis of meetings attended, meeting attendees, major outcomes/coordination, and action items applicable to OPTEVFOR.

5.6.2. The contractor shall, IAW CDRL A002, provide the TPOC monthly reports including the progress of work on assigned tasks, conferences/meetings attended, work plans and the expenditure of funds, and labor hours during the month.

5.6.3. The contractor shall, IAW CDRL A003, provide the TPOC with a technical reports summary of all technical reports delivered during the reporting period.

5.6.4. The contractor shall, IAW CDRL A004, provide the government an annual assessment of performance in a Contract Performance Assessment Report (CPAR).

5.6.5. The contractor shall, IAW CDRL A005, provide résumés for all personnel proposed to perform

6. Required Personnel Qualifications. Qualifications are delineated below for each of the functional areas within this contract.

6.1. All personnel offered to support these efforts shall possess the following qualifications/skills:

6.1.1. U.S. citizenship.

6.1.2. Demonstrated proficiency with MS-Office software, to include MS Word, Excel, and Power Point.

6.1.3. Demonstrated proficiency in technical writing.

6.1.4. Demonstrated ability to interact effectively within the naval community.

6.1.5. Demonstrated proficiency in scientific approaches and analytical methods, as applicable to testing, including:

− Problem identification and investigation;

− Solution creation, comparison, prioritization, and implementation;

− Conclusion development and justification.

6.2. Statistical Analysis. Personnel offered as STAT Analysts shall possess the following qualifications/skills beyond those listed in 6.1:

6.2.1. Demonstrated experience with the use of statistical design and analysis of results in a government testing or laboratory environment, which may include but is not limited to Contractor Testing (CT), DT, and OT.

6.2.2. Demonstrated ability to apply analytical methodologies to evaluate systems undergoing test.

6.2.2.1. Must have experience related to the development of formal statistical DOE such as developing full factorial, optimal, and space filling designs; knowledge on the appropriate use of replicates; augmenting designs; and evaluating designs.

6.2.2.2. Must have experience with a broad range of statistical analysis methods applicable to testing to include statistical hypothesis testing and linear regression (standard least squares and logistic) modeling and desired experience with step-wise, mixed model, penalized regression, and recursive partitioning modeling techniques.

6.2.2.3. Minimum of five years’ experience in the use of statistics and/or DOE or a minimum of two years’ experience creating statistical designs for OT.

6.2.2.4. Advanced level education in a statistics-related field or a related Engineering/Science field (a minimum of 4 years’ experience in applying statistical concepts may be substituted). Graduate level or higher education is preferred.

6.2.3. Demonstrated experience with computer-aided statistical design tools, such as JMP, R, MATLAB, or Design Expert.

6.2.4. Demonstrated expertise in scripting functions for automatic data analysis using Excel, Access, and/or other database software applications.

6.3. MBTD Facilitation. Personnel offered as MBTD Facilitators shall possess the following qualifications/skills beyond those listed in 6.1:

6.3.1. Must have 2 years (within the last 6 years) of experience in designing OT through implementation of MBTD, including coordination with stakeholders such that they understood OPTEVFOR MBTD products and processes.

6.3.2. Within the last two years, have directly supported an OPTEVFOR IEF development process, including drafting portions of the IEF document and participation in an IEF review meeting.

6.3.3. Demonstrated experience with the OPTEVFOR LTD process, TEMP and/or MTS coordination, test planning process, and post-test iterative process.

6.3.4. Demonstrated experience and familiarity with the DoD and DoN instructions and procedures governing the Navy and Joint acquisition process.

6.3.5. Demonstrated working knowledge of and/or experience with tactical operations, and the mission and role of the Navy commands and units tasked to operate in a multi-threat environment.

6.3.6. Demonstrated experience and skill with logic and reasoning, as well as debate and negotiation.

6.4. MBTD Training. Personnel offered as MBTD Instructors shall possess the following qualifications/skills beyond those listed in 6.1:

6.4.1. Must have previously instructed students in a classroom setting, including facilitation of practical exercises.

6.4.2. Must have 2 years (within the last 6 years) of experience in designing OT through implementation of MBTD, including coordination with stakeholders such that they understood OPTEVFOR MBTD products and processes.

6.4.3. Within the last two years, have directly supported an OPTEVFOR IEF development process, including drafting portions of the IEF document and participation in an IEF review meeting.

6.4.4. Demonstrated experience with the OPTEVFOR LTD process, TEMP and/or MTS coordination, test planning process, M&S VV&A process, and post-test iterative process.

6.5. M&S Facilitation. Personnel offered as M&S Analysts shall possess the following qualifications/skills beyond those listed in 6.1:

6.5.1. Demonstrated experience with the application of DOE techniques and statistical validation methods to M&S in order to determine the level of accreditation of a model for use in system performance characterization.

6.5.2. Must have 2 years (within the last 8 years) of experience in working M&S processes to support test, including coordination with stakeholders such that they understood M&S capabilities, uses, inputs, outputs, and test impact.

6.5.3. Within the last two years, have directly supported an OPTEVFOR M&S VV&A process, including drafting or reviewing portions of VV&A documents.

6.5.4. Completion of the OPTEVFOR M&S course.

6.5.5. Demonstrated experience with the OPTEVFOR MBTD process, test planning process, and post-test iterative process.

6.6. Accelerator Team. Personnel offered as Accelerator Team members shall possess the following qualifications/skills beyond those listed in 6.1:

6.6.1. Must have 2 years (within the last 8 years) of experience in designing, planning, executing, and/or reporting on OT.

6.6.2. When assigned to support LTD development, within the last two years, have directly supported an

OPTEVFOR LTD process, including drafting portions of the LTD brief and participation in an LTD approval meeting.

6.6.3. When assigned to support IEF development, within the last two years, have directly supported an OPTEVFOR MBTD process, including inputting data into MBTES, exporting products from MBTES, drafting portions of the IEF document, and participation in process reviews.

6.6.4. When assigned to support M&S VV&A product development, within the last three years, have directly supported an OPTEVFOR VV&A process, including drafting portions of VV&A documents and participation in M&S process meetings.

6.6.5. When assigned to support TEMP/MTS development, within the last four years, have directly supported a T&E WIPT process, including strategy document review and coordination.

6.6.6. When assigned to support test plan development, within the last two years, have directly supported an OPTEVFOR test planning process, including inputting data into MBTES, exporting products from MBTES, drafting portions of the test plan document, and participation in touchpoints.

6.6.7. When assigned to support test report development, within the last two years, have directly supported an OPTEVFOR PTIP process, including drafting portions of the report document and participation in PTIP meetings.

6.6.8. Completion of the OPTEVFOR MBTES course.

6.6.9. Demonstrated experience and familiarity with the DoD and DoN instructions and procedures governing the Navy and Joint acquisition process.

6.6.10. Demonstrated working knowledge of and/or experience with tactical operations, and the mission and role of the Navy commands and units tasked to operate in a multi-threat environment.

7. Security Clearance. The security clearance required for personnel supporting this task varies between SECRET and TOP SECRET, depending on the assigned program(s) to be worked. Personnel proposed to work on this effort shall be available up to TOP SECRET, thus including some personnel with SECRET. Personnel shall be eligible for necessary clearances to immediately begin performance at the time of task award.

8. Reference List. If a reference for this contract is superseded or replaced, the updated/new policy document shall serve as the correct reference. The references are:

8.1. Reference (a): OPTEVFORINST 3980.2 (series), Operational Test and Evaluation Manual

8.