Attachment 0004 - Hardware Evaluation - CNR - FINAL - 24 June 2021.pdf

CNR Hardware Evaluation Plan 24 June 2021

SOURCE SELECTION HARDWARE EVALUATION 1

FOR 2

PROGRAM EXECUTIVE OFFICE 3

COMMAND CONTROL COMMUNICATIONS – 4

TACTICAL (PEO C3T) 5

DEPUTY PRODUCT MANAGER FOR WAVEFORMS 6

(PDM WF) 7

SINGLE CHANNEL GROUND AND AIRBORNE RADIO 8

SYSTEM (SINCGARS) 9

COMBAT NET RADIO (CNR) 10

CNR SOURCE SELECTION HARDWARE EVALUATION 14

24 JUNE 2021 15

PROGRAM EXECUTIVE OFFICE 17

COMMAND CONTROL COMMUNICATIONS – 18

TACTICAL (PEO C3T) 19

6560 SURVEILLANCE LOOP 20

ABERDEEN PROVING GROUND, MD 21005 21

Statement A – Approved for public release; distribution is unlimited24

CNR Hardware Evaluation Plan 24 June 2021

Table of Contents 25

Source Selection Hardware Evaluation ........................................................................................................... 4 26 Test Equipment Interfaces .............................................................................................................................. 4 27

1 Physical Attributes .............................................................................................................................. 4 28

1.1 HE 1.1 Dismounted Configuration ................................................................................................. 4 29

1.1.1 Test Objectives ........................................................................................................................ 4 30

1.1.2 Test Configuration .................................................................................................................. 4 31

1.1.3 Requirements and Test Criteria/Metrics ................................................................................. 4 32

1.1.4 Test Procedure......................................................................................................................... 5 33

1.2 HE 1.2 CNR Physical Size Characteristics ..................................................................................... 5 34

1.2.1 Test Objectives ........................................................................................................................ 5 35

1.2.2 Test Configuration .................................................................................................................. 5 36

1.2.3 Requirements and Test Criteria/Metrics ................................................................................. 5 37

1.2.4 Test Procedure......................................................................................................................... 6 38

1.3 HE 1.3 CNR Physical Weight Characteristics ................................................................................ 6 39

1.3.1 Test Objectives ........................................................................................................................ 6 40

1.3.2 Test Configuration .................................................................................................................. 6 41

1.3.3 Requirements and Test Criteria/Metrics ................................................................................. 6 42

1.3.4 Test Procedure......................................................................................................................... 6 43

1.4 HE 1.4 Connectors and Interfaces ................................................................................................... 7 44

1.4.1 Test Objectives ........................................................................................................................ 7 45

1.4.2 Test Configuration .................................................................................................................. 7 46

1.4.3 Requirements and Test Criteria/Metrics ................................................................................. 7 47

1.4.4 Test Procedure......................................................................................................................... 8 48

2 Cryptography .......................................................................................................................................... 8 49

2.1 HE 2.1 CNR Zeroize and Reload .................................................................................................... 8 50

2.1.1 Test Objectives ........................................................................................................................ 8 51

2.1.2 Test Configuration .................................................................................................................. 8 52

2.1.3 Requirements and Test Criteria/Metrics ................................................................................. 8 53

2.1.4 Test Procedure......................................................................................................................... 9 54

3 Control and Display .............................................................................................................................. 10 55

3.1 HE 3.1 Displaying and Changing Modes ...................................................................................... 10 56

3.1.1 Test Objectives ...................................................................................................................... 10 57

3.1.2 Test Configuration ................................................................................................................ 10 58

3.1.3 Requirements and Test Criteria/Metrics ............................................................................... 10 59

CNR Hardware Evaluation Plan 14 May 2021

3.1.4 Test Procedure....................................................................................................................... 12 60 4 Legacy SINCGARS Voice ................................................................................................................... 12 61

4.1 HE 4.1 SINCGARS Voice Modes ................................................................................................ 12 62

4.1.1 HE 4.1.1 SINCGARS SCPT – Voice.................................................................................... 12 63

4.1.2 HE 4.1.2 SINCGARS FH2CT – Voice ................................................................................. 14 64

5 Legacy SINCGARS Data ..................................................................................................................... 16 65

5.1.1 HE 5.1.1 SINCGARS SCPT – Data...................................................................................... 16 66

5.1.2 HE 5.1.2 SINCGARS FH2CT – Data ................................................................................... 18 67

6 Modernized SINCGARS Voice ............................................................................................................ 20 68

6.1 SINCGARS Voice Modes ............................................................................................................ 20 69

6.1.1 HE 6.1 SINCGARS CT2 – Voice ......................................................................................... 20 70

Source Selection Hardware Evaluation 73

The purpose of this Hardware Evaluation is to inform the Source Selection of basic attributes of 74 the Offeror’s proposed solution, hereinafter referred to as “CNR”. A distinct subset of the 75 Performance Requirements Document (PRD) requirements are chosen to identify potential risk 76 and relative maturity of the offer. Each Hardware Evaluation (HE) Test Case (TC) number aligns 77 with a capability being evaluated, as identified in the PRD (Attachment 0001). 78

The HE will begin with measurement of the CNR’s basic physical attributes (size/weight) 79 configuration for dismounted operations, and a quick Voice check. Following successful 80 installation/integration of the CNR into the lower tray of a Vehicle Radio Communications (VRC) 81 VRC-91 radio rack and connection to the legacy amplifier, additional Voice and Data checks will 82 be performed as specified in this document. Deviations from the PRD requirements will be 83 annotated. Rationale: The lower tray is a more challenging installation and successful 84 demonstration contributes to confidence for integration in the most challenging platforms (e.g., 85 those lacking in overhead space above the top tray). 86

Test Equipment Interfaces 87

Standard test cables will be provided by the lab. If the Offeror’s hardware requires a special cable, 88 different from the one used by a legacy RT-1523 for interface to the Fireberd, it should be 89 supplied with the CNR hardware provided. 90

1 Physical Attributes 91

This is a series of checks for compliance with the identified PRD requirements. 92

1.1 HE 1.1 Dismounted Configuration 93

1.1.1 Test Objectives 94

The objectives of this test case are to measure the CNR’s ability to integrate with the standard 95 ancillaries of the PRC-119F and transmit voice to a legacy SINCGARS radio. 96

1.1.2 Test Configuration 97

The CNR will be configured for dismounted operations with a battery, antenna, and handmic. 98

1.1.3 Requirements and Test Criteria/Metrics 99

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 100 table below: 101

Test Case CNR PRD Requirements Test Criteria/Metric

HE 1.1 Dismounted Configuration

3.1.1.7.1 (T) Shall provide capability to use battery power when dismounted with common primary and rechargeable batteries.

Criteria:

Met: Completed successful

Not Met: Unable to use common batteries

3.1.1.7.2 (T) Shall allow the replacement of primary power source(s) without any special tools and/or equipment.

Met: Completed successful

Not Met: Unable to change batteries without special tools and/or equipment

3.1.1.7.3 (T) The CNR-RT shall be able to operate the legacy SINCGARS and SINCGARS CT2 waveforms using all modes specified in the Compliance Matrix in a dismounted network for voice or data operations at maximum transmit power in an operational environment with 6:3:1 (Listen, Receive, Transmit) for no less than 24 hours while meeting the size requirements specified in PRD paragraph 3.1.1.3.1.

Criteria:

Met: Completed successful

Not Met: Unable to maintain power output for 24 hours

1.1.4 Test Procedure 103

Testing will be done on a single radio and not repeated. The procedures for executing this test 104 case are shown in the following table: 105

Test Procedure 1 Configure the CNR for operations by installing ancillaries, including a battery, and power on the radio.

2 Load the radio and enter the network with a legacy SINCGARS radio.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

4 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

1.2 HE 1.2 CNR Physical Size Characteristics 106

1.2.1 Test Objectives 107

The objectives of this test case are to demonstrate the CNR’s ability to meet size requirements. 108

1.2.2 Test Configuration 109

The CNR will be measured. 110

1.2.3 Requirements and Test Criteria/Metrics 111

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 112 table below: 113

HE 1.2 CNR Physical Size Characteristics

3.1.1.3.1 (T) The size of the CNR shall be equal to or less than the cubic measurement of a legacy RT-1523F in each dimension. This is inclusive of batteries necessary for 24 hours for dismounted operations. Note: The SINCGARS RT shall be capable of being installed in the existing SINCGARS mounting adapter (i.e., AM-7239).

CNR-RT Maximum Dimensions Dimension Size

Width 13.4 cm (5.3 in) Height 8.7 cm (3.4 in) Depth 25.8 cm (10.15 in)

Met: Dimensions not exceeded

Not Met: Dimensions exceeded

1.2.4 Test Procedure 115

Testing will be done on a single radio of each type and not repeated. The procedures for executing 116 this test case are shown in the following table: 117

Test Procedure 1 Measure the CNR

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

1.3 HE 1.3 CNR Physical Weight Characteristics 118

1.3.1 Test Objectives 119

The objectives of this test case are to demonstrate the CNR’s ability to meet weight requirements. 120

1.3.2 Test Configuration 121

The CNR will be weighed. 122

1.3.3 Requirements and Test Criteria/Metrics 123

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 124 table below: 125

Test Case CNR PRD Requirements Test Criteria/Metric

HE 1.3 CNR Physical Weight Characteristics

3.1.1.3.2 (T) The weight of the CNR Radio shall be equal to or less than the weight of a legacy RT- 1523F: 5.5 lbs empty or 8.7 lbs with a battery.

This is inclusive of additional batteries if they are necessary for 24 hour operation for dismounted operations.

Criteria:

Met: Weight not exceeded

Not Met: Weight exceeded

1.3.4 Test Procedure 127

Testing will be done on a single radio of each type and not repeated. The procedures for executing 128 this test case are shown in the following table: 129

Test Procedure 1 Weigh the CNR with and without battery.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

1.4 HE 1.4 Connectors and Interfaces 130

1.4.1 Test Objectives 131

The objectives of this test case are to demonstrate the CNR’s connectors and interfaces. 132

1.4.2 Test Configuration 133

The CNR will be integrated into the legacy SINCGARS Vehicle Amplifier Adapter (VAA), 134 specifically as shown in Figure 1, into the lower tray. 135

Figure 1: Integration into the Lower Tray 137

1.4.3 Requirements and Test Criteria/Metrics 138

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 139 table below: 140

HE 1.4 CNR Connectors and Interfaces

3.1.1.5.1 (T) The CNR-RT or its adaptor shall interface with the legacy VRC mounts, pin configuration, handsets, intercom interfaces, locking mechanism, amplifiers and the INC (Internet Controller) for mounted operation and digital fires.

3.1.1.5.2 (T) Radio shall provide Type N Female RF interfaces for all dismounted antennas.

3.1.1.5.3 (T) Shall allow the RT to be installed/uninstalled without any special tools and/or equipment.

3.1.1.5.4 (T) Shall provide an audio connector and support U-283/U key fill or adapter.

3.1.1.5.5 (T) Shall provide electrical interface for headsets, speaker/microphone, and handset in accordance with MIL-DTL-55116C.

3.3.1.3 (T) Shall accept prime power to the RT from the legacy mount and run off the vehicular power.

3.3.1.1 (T) Shall allow the CNR-RT to be installed/uninstalled without any special tools and/or equipment.

Criteria:

Met: Requirements met

Not Met: Requirements not met

1.4.4 Test Procedure 142

Testing will be done on a single radio of each type and not repeated. The procedures for executing 143 this test case are shown in the following table: 144

Test Procedure

1 To the extent possible, allow the Offeror to integrate the CNR into the legacy SINCGARS VAA, lower tray.

2 Power on the CNR.

3 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

2 Cryptography 145

2.1 HE 2.1 CNR Zeroize and Reload 146

2.1.1 Test Objectives 147

The objectives of this test case are to measure the CNR’s ability to zeroize and reload keys. 148

2.1.2 Test Configuration 149

The CNR will be integrated into the legacy SINCGARS VAA, specifically into the lower tray. 150

2.1.3 Requirements and Test Criteria/Metrics 151

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 152 table below: 153

Test Case CNR PRD Requirements Test Criteria/Metric

HE 2.1 CNR Zeroize and Reload

3.1.1.5.8 (T) Shall provide a push-button or other mechanical interface to allow the radio operator and maintainer to access operational status, control functions and parameters, and zeroize the RT from the front panel.

3.1.4.1.3 (T) Shall support manual zeroization of keys individually or collectively.

Criteria:

Met: Zeroize successful

Not Met: Zeroize not successful

3.1.1.5.9.1.1 (T) Shall provide a front panel keypad interface similar in function to the existing RT-1523E/F radio. The front panel keypad shall be capable of selecting the following operational parameters:

3.1.1.5.9.1.5 (T) COMSEC (Plaintext (PT), Ciphertext (CT), Ciphertext 2 (CT2))

3.1.1.5.9.2 (T) The CNR-RT HMI shall provide operators and maintainers with the ability to check the following functions with precise visual feedback at any given time:

3.1.1.5.9.2.1.4 (T) Crypto status

3.1.2.2 (T) Shall store all data encrypted while at rest in accordance with current National Security Agency (NSA) guidelines for NSA-controlled data (e.g., keying material (KEYMAT)).

3.1.2.3 (T) If using an NSA key for storage, it shall be a split key that is reloadable by soldiers in the field. Examples of this are JOSEKI or Watari split keys. A full key that is not reloadable by soldiers in the field is not acceptable.

3.1.4.1.1 (T) Shall be capable of using the existing Simple Key Loader (SKL) to load COMSEC and hopsets/presets for SINCGARS.

Criteria:

Met: Operational in ≤50 seconds

Not Met: Operational in >50 seconds

2.1.4 Test Procedure 155

Testing will be done on a single radio and not repeated. The procedures for executing this test 156 case are shown in the following table: 157

1 Using the CNR in the legacy SINCGARS VAA, lower tray.

2 Zeroize the radio.

3 Attempt to power on the CNR. Verify no key.

4 Reload split key and mission variables. Power cycle the CNR. Verify key.

5 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 Control and Display 158

3.1 HE 3.1 Displaying and Changing Modes 159

3.1.1 Test Objectives 160

The objectives of this test case are to measure the CNR’s ability to display the radio’s mode and 161 to change waveform modes. 162

3.1.2 Test Configuration 163

The CNR will be integrated into the legacy SINCGARS VAA, specifically into the lower tray. 164

3.1.3 Requirements and Test Criteria/Metrics 165

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 166 table below: 167

HE 3.1 Displaying and Changing Modes

3.1.1.5.9.1.2 (T) Preset channel (e.g., Single Channel (SC), 6 Frequency Hopping (FH))

3.1.1.5.9.1.3 (T) RF Transmit Power (LO, MED, HI, PA)

3.1.1.5.9.1.4 (T) Mode (SC, FH, Frequency Hopping 2 (FH2), Frequency Hopping 3 (FH3), Radio Based Situational Awareness (RBSA))

3.1.1.5.9.1.8 (T) Data Rate and Selection (Standard Data Mode (SDM) Data Rate, Enhanced Data Mode (EDM) Data Rate)

3.1.1.5.9.2.1.1 (T) Radio power (battery charge) status

3.1.1.5.9.2.1.5 (T) Frequency Hopping Mode (SC, FH, FH2, and FH3)

3.1.1.5.9.2.2 (T) Plain text vs. Cypher text (legacy) or Crypto Modernized CT2

3.1.1.5.9.2.3 (T) Transmitting power/signal strength

3.1.1.5.9.2.4 (T) Receive signal strength

3.1.1.5.9.2.5 (T) Alphanumeric Preset numbers with at least 5 digits

3.1.1.5.9.2.6 (T) Net ID (identification)

3.1.1.5.9.2.7 (T) Operating Frequency

3.1.1.5.9.2.8 (T) Volume level

3.1.1.5.9.3 (T) All presets must be accessible and the radio’s controls must be able to perform all tasks without need for an ancillary device or detachable HMI.

3.1.1.5.9.6 (T) The CNR-RT shall allow control of the HMI display brightness from off to maximum.

3.1.1.5.9.7 (T) The CNR-RT shall provide the user the capability to input numerical and alpha numeric characters via a keypad device.

3.1.1.5.9.8 (T) The built-in display shall be readable when the RT is mounted.

Met: Display each mode described in PRD paragraph 3.1.1.5., inclusive of the sub paragraphs.

Not Met: Unable to display the required data for Thresholds

3.1.2.4.1 (T) Waveform modes shall be user selectable. For example: Change mode of

SINCGARS.

Criteria:

Met: Change successful

Not Met: Change not successful

3.1.2.4.2 (T) Shall be able to switch waveform modes in less than 60 seconds for supported waveforms. (e.g., SINCGARS voice to SINCGARS data mode)

Criteria:

Met: Operational in ≤60 seconds

Not Met: Operational in >60 seconds

3.1.4 Test Procedure 169

Testing will be done on a single radio and not repeated. The procedures for executing this test 170 case are shown in the following table: 171

Test Procedure 1 Using the CNR in the legacy SINCGARS VAA, lower tray.

2 Power on the radio 3 Change Modes.

4 Change Modes and record the time.

5 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

4 Legacy SINCGARS Voice 172

4.1 HE 4.1 SINCGARS Voice Modes 173

The objective of this test case is to verify that the CNR Radio can successfully operate 174 SINCGARS in a limited number of threshold voice modes, as specified in the CNR PRD. 175

4.1.1 HE 4.1.1 SINCGARS SCPT – Voice 176

4.1.1.1 Test Objectives 177

The objective of this test case is to verify the CNR can successfully operate the SCPT threshold 178 voice mode of SINCGARS. 179

4.1.1.2 Test Configuration 180

The following test setup will be used to demonstrate the ability of the CNR to support the 181 SINCGARS SCPT voice mode. Audio testing will utilize an automated voice quality analysis 182 tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of 183 Speech Quality (PESQ). The test will vary the RF attenuation and propagation between radio 184 links to establish the receiver sensitivity for the CNR under test. A legacy SINCGARS RT-1523 185 and the Offeror’s new CNR radio will be used with presets configured for the SINCGARS Voice 186 modes as shown in Figure 2. 187

Figure 2: HE 4.1.1 SINCGARS SCPT – Voice 189

4.1.1.3 Traffic Profile 190

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 191 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 192 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 193 transmit and receive. 194

4.1.1.4 Requirements and Test Criteria/Metrics 195

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 196 table below: 197

Test Case CNR PRD Requirements Test Criteria/Metric

HE 4.1.1 SINCGARS SCPT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting distance range requirements.

3.1.6.1 (T) Audible Status: The radio shall provide audible status, alerts, and cues.

3.4.1.1 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in PT SC mode.

Criteria:

Met: Call Completion percentage ≥90%.

Not Met: Call Completion percentage < 90%.

4.1.1.5 Test Procedure 198

The procedures for executing this test case are shown in the following table: 199

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level, roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

4.1.1.6 Data to be Collected 201

The data to be collected are described in the table below: 202

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

4.1.1.7 Data Analysis 203

The test engineer will review the test record sheets collected at the end of each test trial and 204 compare the results against the test criteria/metrics. The results and any anomalies will be peer 205 reviewed with the test team and the documentation will be updated as necessary. 206

4.1.2 HE 4.1.2 SINCGARS FH2CT – Voice 207

4.1.2.1 Test Objectives 208

The objective of this test case is to verify the CNR can successfully operate the FH2CT threshold 209 voice mode of SINCGARS. 210

4.1.2.2 Test Configuration 211

The following test setup will be used to demonstrate the ability of the CNR to support the 212 SINCGARS FH2CT voice mode. Audio testing will utilize an automated voice quality analysis 213 tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of 214 Speech Quality (PESQ). The test will vary the RF attenuation and propagation between radio 215 links to establish the receiver sensitivity for the CNR under test. A legacy SINCGARS RT-1523 216 and the Offeror’s new CNR radio will be used with presets configured for the SINCGARS voice 217 modes as shown in Figure 3: 218

Figure 3: HE 4.1.2 SINCGARS FH2CT – Voice 220

4.1.2.3 Traffic Profile 221

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 222 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 223 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 224 transmit and receive. 225

4.1.2.4 Requirements and Test Criteria/Metrics 226

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 227 table below: 228

Test Case CNR PRD Requirements Test Criteria/Metric

HE 4.1.2 SINCGARS FH2CT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting range requirements.

3.4.1.10 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in CT FH2 mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

4.1.2.5 Test Procedure 229

The procedures for executing this test case are shown in the following table: 230

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

4.1.2.6 Data to be Collected 231

The data to be collected are described in the table below: 232

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

4.1.2.7 Data Analysis 233

The test engineer will review the test record sheets collected at the end of each test trial and 234 compare the results against the test criteria/metrics. The results and any anomalies will be peer 235 reviewed with the test team and the documentation will be updated as necessary. 236

5 Legacy SINCGARS Data 237

5.1.1 HE 5.1.1 SINCGARS SCPT – Data 238

5.1.1.1 Test Objectives 239

The objective of this test case is to verify the CNR can successfully operate the threshold Data 240 mode of 4800 bps EDM of SINCGARS. 241

5.1.1.2 Test Configuration 242

The following test setup will be used to demonstrate the ability of the CNR to support the 243 SINCGARS data mode. Two (2) CNR radios with presets configured for the SINCGARS data 244 mode will be used as shown in Figure 4: 245

Figure 4 HE: 5.1.1 CNRs connected SINCGARS for Data testing 247

5.1.1.3 Traffic Profile 248

Once radios are configured and successfully connected via SINCGARS, data will be transmitted 249 from the Reference Radio and received on CNR; data will also be transmitted from CNR and 250 received on the Reference Radio at 4800 bps EDM. 251

5.1.1.4 Requirements and Test Criteria/Metrics 252

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 253 table below: 254

Test Case CNR PRD Requirements Test Criteria/Metric

HE 5.1.1 SINCGARS SCPT –

Data

3.1.1.2.2 (T) Data shall have an 85% or greater Message Completion Rate (MCR) while meeting distance range requirements.

3.4.2.13 The CNR-RT shall operate the SINCGARS

waveform and be interoperable with legacy RT- 1523 using 4800 bps EDM in PT/SC.

Met: Bit error rate ≤ 10e-05

Not Met: Bit error rate > 10e-05

5.1.1.5 Test Procedure 255

The procedures for executing this test case are shown in the following table: 256

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 Configure FireBERD for the tested data rate.

4 Set up Device under test in the above test configuration.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

5.1.1.6 Data to be Collected 257

The data to be collected are described in the table below: 258

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

5.1.1.7 Data Analysis 259

The test engineer will review the test record sheets collected at the end of each test trial and 260 compare the results against the test criteria/metrics. The results and any anomalies will be peer 261 reviewed with the test team and the documentation will be updated as necessary. 262

5.1.2 HE 5.1.2 SINCGARS FH2CT – Data 263

5.1.2.1 Test Objectives 264

The objective of this test case is to verify the CNR can successfully operate the threshold FH2CT 265 data mode of 4800 bps EDM of SINCGARS. 266

5.1.2.2 Test Configuration 267

The following test setup will be used to demonstrate the ability of the CNR to support the 268 SINCGARS data mode. A legacy SINCGARS RT-1523 and the Offeror’s new CNR radio will 269 be used with presets configured for the SINCGARS data mode as shown in Figure 5: 270

Figure 5: HE 5.1.2 SINCGARS FH2CT – Data 272

5.1.2.3 Traffic Profile 273

Once radios are configured and successfully connected via SINCGARS, data will be transmitted 274 from the Reference Radio and received on CNR; data will also be transmitted from CNR and 275 received on the Reference Radio at 4800 bps EDM. 276

5.1.2.4 Requirements and Test Criteria/Metrics 277

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 278 table below: 279

Test Case CNR PRD Requirements Test Criteria/Metric

HE 5.1.2 SINCGARS FH2CT –

Data

3.1.1.2.2 (T) Data shall have an 85% or greater Message Completion Rate (MCR) while meeting distance range requirements.

3.4.2.13 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 using 4800 bps EDM in CT/FH2.

Met: Bit error rate ≤ 10e- 04.

Not Met: Bit error rate > 10e-04.

5.1.2.5 Test Procedure 280

The procedures for executing this test case are shown in the following table: 281

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 Configure FireBERD for the tested data rate.

4 Set up Device under test in the above test configuration.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

5.1.2.6 Data to be Collected 282

The data to be collected are described in the table below: 283

Data Output 1 Test record sheets documenting Bit Error Rate.

2 TIR(s) documenting any anomaly or test failure.

5.1.2.7 Data Analysis 284

The test engineer will review the test record sheets collected at the end of each test trial and 285 compare the results against the test criteria/metrics. The results and any anomalies will be peer 286 reviewed with the test team and the documentation will be updated as necessary. 287

6 Modernized SINCGARS Voice 288

6.1 SINCGARS Voice Modes 289

6.1.1 HE 6.1 SINCGARS CT2 – Voice 290

6.1.1.1 Test Objectives 291

The objective of this test case is to verify the CNR can successfully operate a threshold voice 292 mode of CT2 SINCGARS. 293

6.1.1.2 Test Configuration 294

The following test setup will be used to demonstrate the ability of the CNR to support the 295 SINCGARS CT2 in a voice mode with FH2. Audio testing will utilize an automated voice quality 296 analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation 297 of Speech Quality (PESQ). The test will vary the RF attenuation and propagation between radio 298 links to establish the receiver sensitivity for the CNR under test. A legacy SINCGARS RT-1523, 299 the CT2 emulator, and the Offeror’s new CNR radio will be used with presets configured for the 300 SINCGARS voice modes as shown in Figure 6: 301

Figure 6: HE 6.1 SINCGARS FH2CT2 – Voice 303

6.1.1.3 Traffic Profile 304

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 305 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 306 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 307 transmit and receive. 308

6.1.1.4 Requirements and Test Criteria/Metrics 309

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 310 table below: 311

Test Case CNR PRD Requirements Test Criteria/Metric

HE 6.1.1 SINCGARS CT2 –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting distance range requirements.

3.4.1.12 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with a legacy RT-1523 using a VACM (VINSON/ANDVT CRYPTOGRAPHIC MODERNIZATION) for voice in CT2 SC mode.

3.4.1.13 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with a legacy RT-1523 using a VACM for voice in CT2 FH2 mode.

3.4.1.14 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with a legacy RT-1523 using a VACM for voice in CT2 FH2M mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

6.1.1.5 Test Procedure 312

The procedures for executing this test case are shown in the following table: 313

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level, roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

6.1.1.6 Data to be Collected 314

The data to be collected are described in the table below: 315

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

6.1.1.7 Data Analysis 316

The test engineer will review the test record sheets collected at the end of each test trial and 317 compare the results against the test criteria/metrics. The results and any anomalies will be peer 318 reviewed with the test team and the documentation will be updated as necessary. 319