OPF-L RFP Amendment 001_Attachment J.3_Test and Evaluation Support V.2.pdf

Attachment J-3 – Page 1

Attachment J-3: T&E Support V.2

Test Scope and Locations

September 2023

Attachment J-3 – Page 2

1.1 Scope of Planned Government Testing:

1.1.1 E3/Radiation Hazard (HERO/HERP/HERF/E3) Testing

Radiation hazard testing and analysis will be performed early in the testing sequence for safety purposes. Hazards of Electromagnetic Radiation to Ordnance (HERO) testing will be performed to characterize the robustness and the safety of the OPF-L system in its operational environment.

Radio Frequency (RF) emissions from co-located radios and other emitters must not cause a safety hazard to the ordnance, nor cause a mission essential function failure in the OPF-L system. HERO testing will subject the OPF-L ordnance to RF emissions.

Hazards of Electromagnetic Radiation to Personnel (HERP) / Hazards of Electromagnetic Radiation to Fuel (HERF) testing and analysis will be conducted to characterize the type and amount of Electric and Magnetic Field (EMF) emissions of the OPF-L system during operation.

Since the OPF-L system has an RF data link, the expectation is that there will be RF emissions during operations. The acceptable limit for these emissions on personnel and fuel will be analyzed to ensure that they are within safe limits.

Electromagnetic Environmental Effects (E3) testing will be required to establish a characterization of E3 on the OPF-L system. The test program will be tailored by working with Naval Surface Warfare Center Dahlgren Division (NSWCDD) from tests and requirements in MIL-STD-461 and MIL-STD-464. It will be determined if the system is safe in the expected electromagnetic environment as part of the test plan development. The OPF-L system will also be subject to Personnel Borne Electrostatic Discharge (PESD) and Helicopter ESD (HESD) requirements and testing to support operations with Marines and transport via rotary wing assets.

HERO/HERP/HERF/E3 Testing is planned for FY25 Q1-Q2 at the NSWCDD. It is planned for the first phase of testing to help characterize the safety of the system early before other test events can occur.

ESD testing is planned for FY25 Q1-Q2 at the Naval Surface Warfare Center, Indian Head Division (NSWCIHD). After testing is complete, the articles under test will undergo physical inspection by Government test personnel and then returned to the vendor to determine if any damage had occurred that was not uncovered by the Built-In-Test (BIT).

These test series will require an instrumented Loitering Munition (LM) configuration with an inert payload with an inert fully functioning fuze.

1.1.2 Performance Testing

Performance Testing includes LM flight performance, munition performance, and Ground Control Station (GCS) performance for the intended functionality. This will include testing on the range with inert and live rounds. As this program is focused on obtaining non-developmental items, the performance of the vendor solutions will be quantified IAW User requirements and system specifications. Performance Testing will evaluate the functions of the system through flight cards against stationary targets, characterizing aspects of the system. In addition, lab testing and analysis will be performed to supplement range testing through Night Vision Labs to determine the system’s ability to Detect and Identify. If available, a vendor-provided model of sensor capabilities would aid in the determination of performance parameters. Performance testing will include, but not be limited to, evaluating the following parameters:

Attachment J-3 – Page 3

a. Munition accuracy [Probability of Hit (PoH) and Circular Error Probable (CEP)] against stationary targets

b. Battery life of munition and ground control station

c. Loiter time/munition endurance/max speed/max range

d. GCS capability to plan and execute missions, abort missions, plan lost link scenarios, etc.

e. Munition sensor target discrimination

Testing will begin with flying inert rounds to help ensure that system capabilities are understood.

Close coordination with range and system safety will occur to ensure that there are clear contingency plans for when a LM loses link with the GCS, or otherwise undergoes a fault (e.g., loses GPS). The GCS control and mission planning capabilities will be determined during this time. Data in loiter time, range, and endurance can also be collected with an inert round to help bound the remainder of the flight cards. This includes characterization of limitations of the battery as well as the radio. Data on reliability of the LMs can also be gathered during these flight tests. The intent is for each round to finish its flight either through engagement of a target or with an intentional abort/ditch to exercise the capability.

Performance Testing is planned for FY25 Q1-Q2 at Yuma Proving Ground (YPG). The duration is expected to be 14 calendar days.

Delta Performance Testing is planned for FY25 Q4-FY26 Q1 at YPG. The duration is expected to be 14 calendar days. This test event will be an opportunity to test lower priority flight cards, additional attributes of the vendor solution, and to fly assets that have gone through some level of environmental testing.

1.1.3 Basic Safety Series Testing

Limited environmental testing and analysis will be performed in a basic safety series to characterize the robustness of the OPF-L system in the operational environment without loss of mission essential function or introduction of safety hazards. Deficiencies will not preclude further testing and evaluation but may inform training and employment planning of the system during fielding. These tests are intended to focus on the safety of the OPF-L system while in a transportation configuration IAW MIL-STD-2105E. The test sequence will include, but not be limited to:

a. 28 day temperature and humidity

b. Transportation Vibration for Fixed Wing Aircraft

c. 4 day temperature and humidity

d. 12 meter (40’) drop, then ensuring the LM is safe to transport and dispose of

The government may reserve the right to fire the LM after this sequence of testing, as it is intended to simulate a life cycle of the round from delivery to fielding.

This will help identify any potential limitations with safe shipment of the OPF-L.

Basic Safety Series Testing is planned for FY25 Q1-Q2 at YPG. Performing these tests early will help to inform the limits of the system survivability as it pertains to safe transport to other test ranges and events as part of the test program.

Attachment J-3 – Page 4

1.1.4 Arena Testing

Arena testing will be performed to characterize the effectiveness of the warhead against personnel targets. The data from this testing will be used to inform measures of effectivity and lethality for anti-personnel rounds.

Arena testing is planned for FY25 Q1-Q2 at NSWCDD.

1.1.5 Harmonized Insensitive Munitions Testing and Hazard Classification

Harmonized Insensitive Munitions (IM) and Hazard Classification (HC) testing will focus on testing for safety of the warhead IAW MIL-STD-2105D. IM testing will include, but not be limited to, the following tests:

a. Slow Heating/Slow Cook Off

b. Fast Heating/Fast Cook Off

c. Bullet impact

d. Sympathetic Detonation (unconfined)

e. Thermal Stability

Harmonized IM and HC testing is planned for FY25 Q4-FY26 Q1 at NSWCDD.

1.1.6 Environmental Testing

Environmental testing and analysis will be performed to characterize the robustness of the OPF- L system in a representation of the operational environment without loss of mission essential function or introduction of safety hazards. This testing will subject the system in different configurations to different environmental conditions. This series of testing will inform the suitability of the system for the operational environment, as well as to identify any limitations.

Environmental testing may include, but not be limited to:

a. Low temperature operation

b. Icing

c. Blowing rain

d. Freezing rain

e. Temperature shock

f. High temperature operations

g. Humidity

h. Solar Radiation

i. Blowing Sand and Dust

j. Salt spray/salt fog

k. 5’ drop

l. Altitude

Environmental testing is planned for FY25 Q4-FY26 Q2 at YPG.

The OPF-L system is expected to be transported via other means such as rotary wing and ground transportation. The system will also be subject to a series of transportation vibration tests vibration profiles simulating rotary wing (e.g. CH-53, MV-22) and ground (e.g. JLTV, MTVR, ACV, etc.) transportation vibration in accordance with MIL-STD-810.

Attachment J-3 – Page 5

1.1.7 Packaging, Handling, Storage and Transportation (PHS&T) Testing and Analysis

Packaging, Handling, Storage and Transportation (PHS&T) testing will be performed to ensure that the OPF-L system, in various packaging configurations, can be safely handled, shipped, and transported without degradation of its mission essential capabilities or introducing safety hazards. The packaging configuration should meet the requirements for Level A Fleet-Issue Unit Load Level (Navy) IAW MIL-STD 1660.

PHS&T testing with rounds in the packaging may include, but not be limited to:

a. Limited environmental testing of transportation configuration

b. Loose Cargo Shock and Vibration

c. 7’ drop

d. Shipboard Suitability Testing (SST)

Additional testing/analysis may be required on the packaging itself to determine the safety and suitability of the items. The level of testing or analysis required will be determined by the vendor solution selected. In lieu of OPF-L system hardware, mass simulators will be developed to use during testing. PHS&T testing on the packaging itself may include, but not limited to:

a. Fire safety

b. Palletized testing (assuming the PHS&T Center will develop the palletized load with vendor input regarding vendor packaging)

Depending on the results of drop and vibration testing on the system without packaging, additional testing or analysis may be required to characterize the risk of transporting the system.

PHS&T testing is planned for FY26 Q2-Q3 at YPG.

1.1.8 Lithium Battery Certification

Lithium (Li) Battery testing and analysis will be required to support Li Battery Certification.

Depending on the facility, Li Battery Certification applies to all Navy and Marine Corps events and activities involving Li battery-powered devices intended for use or transportation on Navy/Marine Corps facilities, submarines, ships, vessels, and aircraft. Li Battery Certification will be required for all Li batteries within their specific system even when the battery has been approved in another system. Li Battery testing and analysis will be performed as early as possible once systems have been identified and will be coordinated with NSWC Crane. The scope of testing and analysis will be determined once a system, battery type, and battery configuration have been identified. Additional spare batteries may be required for government analysis and test. Portions of the testing and analysis may be accepted if adequate data is available from a trusted test agency, as deemed by the Government.

1.1.9 Fuze Testing and Analysis

As the OPF-L vendor solution has not yet been selected, it is currently unknown what type of fuze or initiator will be used by the system. If the system under test has a fuze that has undergone testing as part of another program, the OPF-L program will coordinate with the Navy Fuze and Initiation System Technical Review Panel (FISTRP) to determine what data is available from previous test or analysis, and whether additional testing and/or analysis may be required. If the system has a new fuze that has not been previously reviewed by a recognized Department of

Attachment J-3 – Page 6

Defense fuze and initiation system review board, the OPF-L program will schedule a FISTRP technical assistance meeting to determine the required testing and/or analysis to be conducted.

1.1.10 Cybersecurity Testing and Analysis

The goal of cybersecurity test and evaluation is to identify and mitigate exploitable system vulnerabilities, impacting operational resilience of military capabilities before system deployment to include safety, survivability, and security. Early discovery of system vulnerabilities can facilitate remediation and reduce impact on cost, schedule, and performance.

The vendor will be required to support a Cyber Table Top (CTT) to inform government cybersecurity experts on the characteristics of the system. The vendor will need to support cybersecurity scans to ascertain attack surface, and to support a Cooperative Vulnerability and Penetration Assessment (CVPA). The vendor will need to provide information on their system to support the Interim Authorization to Test (IATT) and Authorization to Operate (ATO) processes led by the Government. The system will also undergo Adversarial Assessment (AA), which will have minimal vendor involvement. The vendor may also need to assist in recovering a system that has undergone cybersecurity attack during Cybersecurity testing.

1.1.11 Field User Evaluation

The OPF-L test program will also perform a Field User Evaluation (FUE) to support Operational Assessment. The FUE is a test activity run by representative operators with minimal vendor involvement. The intent is to determine the suitability of the solution in the field for use by Marines with minimal vendor support.

- FUE, will be conducted at a CONUS location, with YPG being the most probable facility.

- The duration will be not greater than 6 weeks.

- The vendor will provide maintenance and operator instructor support in an on-call capacity who will provide solicited guidance and recommendations.

- The event will be run by Government test personnel.

- This event will also validate the quality of vendor training package.

- The vendor will need to provide one Subject Matter Expert to support the event for the full duration. This SME will be responsible to be on-call to assist the Government Operator with subject matter expertise and technical support.

Attachment J-3 – Page 7

Figure 1: Government Test Event Overview

Attachment J-3 – Page 8

Training Activity

Course Content Location Class Size

(Max)

Conduct Period Class Duration

(estimated) Phase 1 Familiarization of Government Test Personnel

OPF-L

Familiarization;

system/subsystem

YPG 30 Must be completed prior to the start of Government

Testing

5 days

Training for Government

Testing

System Operation, Operator

Preventative Maintenance Checks and Services,ammo handling, setup and teardown

YPG 25 (8

operators and 17 observers)

Must be completed prior to the start of Government

Testing

10 days

Phase 2 Familiarization of FUE and

MCOTEA

(optional)

OPF-L

Familiarization;

system/subsystem

TBD 30 Must be completed prior to the start of FUE

5 days

Training of FUE Marines

System Operation, Operator

Preventative Maintenance Checks and Services, ammo handling, setup and teardown

TBD 12 Must be completed prior to the start of FUE

5 days

Table 1: Contractor Training of Government Personnel (Projected)

Attachment J-3 – Page 9

Item QTY Warhead Comments Delivered Location

LM* 3 Inert* E3/RADHAZ NSWCDD

LM* 5 Inert* Phase 1: ESD NSWCIHD

LM* 13 Live Basic Safety Sequence YPG

LM* 20 Live Performance Testing YPG

LM* 24 Inert

LM* 17 Live Arena Testing YPG

LM* 18 Live Harmonized IM and HC NSWCDD

LM* 7 Live Delta Performance YPG

LM* 11 Inert

LM* 44 Live Environmental Testing YPG

LM* 5 Live PHS&T Testing YPG

LM* 45 Live

FUE YPG

LM* 30 Inert

Spare Battery 10 n/a Battery Certification NSWC Crane

Table 2: Required Deliverables/Equipment to Support Government Testing

For information only. Actual quantities will be determined at the Delivery Order level.

*Coordination with Government Test Activities may be needed to asset with testing instrumentation.