Attachment 0005 - First Article Testing Plan - CNR - FINAL - 24 June 2021.pdf

CNR Government-Led First Article Test Plan 24 June 2021

GOVERNMNET-LED 1

FIRST ARTICLE TEST (FAT) PLAN 2

FOR 3

PROGRAM EXECUTIVE OFFICE 4

COMMAND CONTROL COMMUNICATIONS – 5

TACTICAL (PEO C3T) 6

DEPUTY PRODUCT MANAGER FOR WAVEFORMS 7

(PDM WF) 8

SINGLE CHANNEL GROUND AND AIRBORNE RADIO 9

SYSTEM (SINCGARS) 10

COMBAT NET RADIO (CNR) 11

GOVERNMENT-LED 16

CNR FAT PLAN 24 JUNE 2021 17

PROGRAM EXECUTIVE OFFICE 19

COMMAND CONTROL COMMUNICATIONS – 20

TACTICAL (PEO C3T) 21

6560 SURVEILLANCE LOOP 22

ABERDEEN PROVING GROUND, MD 21005 23

Statement A – Approved for public release; distribution is unlimited26

CNR Government-Led First Article Test Plan 24 June 2021

Table of Contents 27

First Article Test (FAT) .................................................................................................................................. 5 28 Test Execution ................................................................................................................................................ 5 29 1 Test Case (TC) 1.0 SINCGARS Waveform Specifications .................................................................... 5 30

1.1 TC 1.1 SINCGARS BW, Tx Output Power and Spectral Mask ..................................................... 5 31

1.1.1 TC 1.1.1 SINCGARS Tx Output Power ................................................................................. 6 32

1.1.2 TC 1.1.2 Spectral Mask ........................................................................................................... 7 33

1.1.3 TC 1.1.3 Operating BW ........................................................................................................ 10 34

1.2 TC 1.2 SINCGARS Receive Sensitivity ....................................................................................... 13 35

1.2.1 Test Objectives ...................................................................................................................... 13 36

1.2.2 Test Configuration ................................................................................................................ 13 37

1.2.3 Traffic Profile ........................................................................................................................ 13 38

1.2.4 Requirements and Test Criteria/Metrics ............................................................................... 13 39

1.2.5 Test Procedure....................................................................................................................... 14 40

1.2.6 Data to be Collected .............................................................................................................. 14 41

1.2.7 Data Analysis ........................................................................................................................ 14 42

1.3 TC 1.4 SINCGARS Threshold Modes .......................................................................................... 14 43

1.3.1 TC 1.4.1 SINCGARS SCPT – Voice .................................................................................... 15 44

1.3.2 TC 1.4.2 SINCGARS SCCT – Voice ................................................................................... 17 45

1.3.3 TC 1.4.3 SINCGARS FHPT – Voice.................................................................................... 19 46

1.3.4 TC 1.4.4 SINCGARS FHCT – Voice ................................................................................... 21 47

1.3.5 TC 1.4.5 SINCGARS SCPT – Data ...................................................................................... 23 48

1.3.6 TC 1.4.6 SINCGARS SCCT – Data ..................................................................................... 25 49

1.3.7 TC 1.4.7 SINCGARS FHPT – Data...................................................................................... 27 50

1.3.8 TC 1.4.8 SINCGARS FHCT – Data ..................................................................................... 29 51

1.3.9 TC 1.4.9 16 kbps Transparent Data Mode (TDM) ................................................................ 31 52

1.3.10 TC 1.4.10 SINCGARS FH2/3 Hopping Mode (repeat select FHCT Voice and Data subtests)53 33 54

1.3.11 TC 1.4.11 SINCGARS F1/F2 Retransmit ............................................................................. 38 55

1.3.12 TC 1.4.12 SINCGARS Frequency Hop Master (FHM) / Late Net Entry (LNE) .................. 40 56

1.3.13 TC 1.4.13 SINCGARS Voice mode testing .......................................................................... 42 57

1.3.14 TC 1.4.14 SINCGARS CT2 – Voice .................................................................................... 44 58

1.3.15 TC 1.4.15 SINCGARS CT2 – Data ...................................................................................... 46 59

1.4 TC 1.5 SINCGARS Other Modes ................................................................................................. 47 60

1.4.1 TC 1.5.1 SINCGARS F1/F1 Retransmit ............................................................................... 48 61

1.4.2 TC 1.5.2 SINCGARS ERF Mode ......................................................................................... 50 62

CNR Government-Led First Article Test Plan 14 May 2021

1.4.3 TC 1.5.3 SINCGARS CUE Mode ........................................................................................ 51 63

1.4.4 TC 1.5.4 SINCAGRS Saville Automatic Remote Keying (SARK) Mode ........................... 53 64

1.4.5 TC 1.5.5 SINCGARS SCAN Mode ...................................................................................... 55 65

1.4.6 TC 1.5.6 Packet Mode – Shared Voice and Data .................................................................. 57 66

1.4.7 TC 1.5.7 SINCGARS 5kHz / 10kHz Channel Offset ........................................................... 60 67

1.5 TC 1.6 SINCGARS Fires Data with ULTRALink ....................................................................... 61 68

1.5.1 Test Objectives ...................................................................................................................... 61 69

1.5.2 Test Configuration ................................................................................................................ 62 70

1.5.3 Traffic Profiles ...................................................................................................................... 62 71

1.5.4 Requirements and Test Criteria/Metrics ............................................................................... 62 72

1.5.5 Test Procedures ..................................................................................................................... 63 73

1.5.6 Data to be Collected .............................................................................................................. 63 74

1.5.7 Data Analysis ........................................................................................................................ 64 75

2 TC 2.0 Other Attributes ........................................................................................................................ 64 76

2.1 TC 2.1 Dismounted Functions ...................................................................................................... 64 77

2.1.1 Test Objectives ...................................................................................................................... 64 78

2.1.2 Test Configuration ................................................................................................................ 64 79

2.1.3 Requirements and Test Criteria/Metrics ............................................................................... 64 80

2.1.4 Test Procedure....................................................................................................................... 64 81

2.2 TC 2.2 Physical Size Characteristics ............................................................................................ 65 82

2.2.1 Test Objectives ...................................................................................................................... 65 83

2.2.2 Test Configuration ................................................................................................................ 65 84

2.2.3 Requirements and Test Criteria/Metrics ............................................................................... 65 85

2.2.4 Test Procedure....................................................................................................................... 65 86

2.3 TC 2.3 Physical Weight Characteristics........................................................................................ 65 87

2.3.1 Test Objectives ...................................................................................................................... 65 88

2.3.2 Test Configuration ................................................................................................................ 66 89

2.3.3 Requirements and Test Criteria/Metrics ............................................................................... 66 90

2.3.4 Test Procedure....................................................................................................................... 66 91

2.4 TC 2.4 Connectors and Interfaces ................................................................................................. 66 92

2.4.1 Test Objectives ...................................................................................................................... 66 93

2.4.2 Test Configuration ................................................................................................................ 66 94

2.4.3 Requirements and Test Criteria/Metrics ............................................................................... 66 95

2.4.4 Test Procedure....................................................................................................................... 67 96

2.5 TC 2.5 Power On Self-Test (POST) and Built In Test (BIT) ....................................................... 67 97

2.5.1 Test Objectives ...................................................................................................................... 67 98

2.5.2 Test Configuration ................................................................................................................ 67 99

2.5.3 Requirements and Test Criteria/Metrics ............................................................................... 67 100

2.5.4 Test Procedure....................................................................................................................... 68 101

2.6 TC 2.6 Cold Start and Warm Start ................................................................................................ 68 102

2.6.1 Test Objectives ...................................................................................................................... 68 103

2.6.2 Test Configuration ................................................................................................................ 68 104

2.6.3 Requirements and Test Criteria/Metrics ............................................................................... 69 105

2.6.4 Test Procedure....................................................................................................................... 69 106

2.7 TC 2.7 CNR Zeroize, Reload, and Retain Variables .................................................................... 70 107

2.7.1 Test Objectives ...................................................................................................................... 70 108

2.7.2 Test Configuration ................................................................................................................ 70 109

2.7.3 Requirements and Test Criteria/Metrics ............................................................................... 70 110

2.7.4 Test Procedure....................................................................................................................... 71 111

2.8 TC 2.8 Displaying and Changing Modes ...................................................................................... 72 112

2.8.1 Test Objectives ...................................................................................................................... 72 113

2.8.2 Test Configuration ................................................................................................................ 72 114

2.8.3 Requirements and Test Criteria/Metrics ............................................................................... 72 115

2.8.4 Test Procedure....................................................................................................................... 74 116

2.9 TC 2.9 Endurance ......................................................................................................................... 74 117

2.9.1 Test Objectives ...................................................................................................................... 74 118

2.9.2 Test Configuration ................................................................................................................ 74 119

2.9.3 Requirements and Test Criteria/Metrics ............................................................................... 74 120

2.9.4 Test Procedure....................................................................................................................... 74 121

First Article Test (FAT) 124

FAT is acceptance testing. Portions of FAT will be conducted by the Contractor with Government 125 witness at the contractor facility or at a 3rd-party facility; other portions of the FAT will be 126 conducted by the Government at a Government facility. This test plan is for the Government-Led 127 portion. 128

Test Execution 129

Validation is in accordance with Section 4 "Verification" of the PRD (Attachment 0001). 130 Compliance will be verified by Government personnel in accordance with this (DRAFT) Test 131 Plan. Some interfaces such as “Fires” in the Compliance Matrix may include interfaces and 132 integration that the APG Lab is not at this time equipped to definitively certify; these tests will be 133 conducted at either at U.S. Army Missiles and Space facilities in Huntsville, AL or Yuma Proving 134 Grounds, AZ under guidance from the Fires Community. 135

Compliance Matrix items carried over from the PRD and identified as “Contractor Format Test 136 Report” are expected for the Offeror to self-certify, using the contractor’s own format, 137 compliance either by test, 3rd party test, or by analysis. An example of “by analysis” that is 138 acceptable is Fungus. An example of “by analysis” that is not acceptable is vibration. This test 139 plan does not address those items that will be reported as the Contractor’s portion of FAT. 140

Test cables and RETRANS cables, if different from standard cables used by the RT-1523F, are 141 expected to be provided by the Contractor. For the tests conducted by the Government, many tests 142 require cables that need to interface with standard test equipment, as detailed in this (DRAFT) test 143 plan. This includes a serial data cable that terminates in a DB-25 connector for connection to the 144 Fireberd, as shown in the appropriate paragraphs that follow. 145

1 Test Case (TC) 1.0 SINCGARS Waveform Specifications 147

1.1 TC 1.1 SINCGARS BW, Tx Output Power and Spectral 148

Mask 149

The objective of this test case is to measure the Operating Bandwidth, Tx Power Out, and the 150 Spectral Mask of the CNR Radio when operating the SINCGARS waveform. This test case will 151 include three sub-cases: 152

Test Case Number Test Case 1 TC 1.1.1 SINCGARS Tx Output Power 2 TC 1.1.2 Spectral Mask 3 TC 1.1.3 Operating BW

1.1.1 TC 1.1.1 SINCGARS Tx Output Power 154

1.1.1.1 Test Objectives 155

The objective of this sub-case is to measure the Tx Output Power of the CNR Radio when 156 operating in the SINCGARS waveform. 157

1.1.1.2 Test Configuration 158

The CNR Radio under test will be configured as shown in Figure 1. Testing will be conducted on 159 a calibrated Agilent E4443A Spectrum Analyzer and JFW Model 50AA 079 Attenuator 160 Assembly. 161

Tests will be performed on all available SINCGARS 30-88 MHz as set by the Mission Plan. 162

The procedures listed below will be completed on fifteen (15) of the same Contractor radios. 163

Figure: 1 TC 1.1.1 SINCGARS Tx Output Power Test Configuration 165

1.1.1.3 Traffic Profile 166

The test support equipment in this test case displays the actual output power level from the radio 167 and does not require either voice or data traffic to be generated or recorded. 168

1.1.1.4 Requirements and Test Criteria/Metrics 169

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 170 table below: 171

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.1.1

SINCGARS Tx Output Power

The PRD Requirements do not specify what the output power of the CNR radio must be, only that it must meet certain range requirements when operating in specific terrain environments.

Criteria:

Characterization Only. Each Contractor has provided Tx Power Out specifications of their radio for reference.

Metric: Tx Output Power measured in dBm.

1.1.1.5 Test Procedure 172

The procedures for executing this test case are shown in the following table: 173

Test Procedure Review and understand the above Test Objectives and Test Criteria/Metrics.

2 Configure the Test Equipment to determine Insertion Loss following the procedures in the test record sheet.

3 Power on the test radios and allow them to complete POST.

4 Select the first Preset for testing and connect the radio to the calibrated test rig.

5 Following the detailed procedures in the test record sheet, tune the Spectrum Analyzer to the test frequency and set Amplitude Offset, expected Amplitude, Bandwidth and Span.

6 Select Trace View and record the Tx Power Out on the test record sheet.

7 Repeat the tests for all radios and all frequencies and bandwidths.

8 Record test data in the test record sheet.

9 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.1.1.6 Data to be Collected 174

The data to be collected are described in the table below: 175

Data Output 1 Test record sheets documenting test results.

2 Spectral Mask screen captures of each test.

3 TIR(s) documenting any anomaly or test failure.

1.1.1.7 Data Analysis 176

The test engineer will review the test record sheets collected at the end of each test trial and 177 compare the results against the test criteria/metrics. The results and any anomalies will be peer 178 reviewed with the test team and the documentation will be updated as necessary. 179

1.1.2 TC 1.1.2 Spectral Mask 180

1.1.2.1 Test Objectives 181

The objective of this sub-case is to measure and characterize the ability of the CNR Radio to 182 control its spectral emissions output while maintaining all of its occupied bandwidth within its 183 spectral mask definition. This includes any out-of-band interference such as a radio carrier 184 frequency harmonics or spurious emissions. Radios will be tested for spectral emissions and 185 spectral mask in the SINCGARS band. 186

1.1.2.2 Test Configuration 187

The CNR Radio under test will be configured as shown in Figure 2. Testing will be conducted on 188 a calibrated Agilent E4443A Spectrum Analyzer and JFW Model 50AA 079 Attenuator 189 Assembly. 190

Tests will be performed in the SINCGARS band as set by the Mission Plan. 191

The procedures listed below will be completed on three (3) of the same Contractor radios. 192

Figure 2: TC 1.1.2 Spectral Mask Test Configuration 194

1.1.2.3 Traffic Profile 195

The test support equipment in this test case displays the actual RF emissions from the radio and 196 does not require either voice or data traffic to be generated or recorded. 197

1.1.2.4 Requirements and Test Criteria/Metrics 198

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.1.2 Spectral Mask

3.1.1.1.1 (T) Shall cover the frequency range from 30-88 MHz for narrow band channels.

3.1.1.1.2 (T) Shall operate in 25kHz bandwidths supporting all modes of the legacy SINCGARS waveform and all modes of the upgraded SINCGARS 3.1 waveform.

3.1.1.2.4 (T) CNR dismounted service shall have a single hop (point-to-point without relaying) range in open terrain no less than 5km.

3.1.1.2.5 (T) Mounted CNR amplified service shall have a single hop (point-to-point without relaying) range in open terrain no less than 30km for SINCGARS.

Criteria:

Met: The CNR meets all Spectrum Compliance Standards.

Not Met: The CNR fails to meet Spectrum Compliance Standards.

Metric: Screenshots of test results and/or table of data.

The radio system under test requires an application for frequency allocation prior to use by end-199 users in the field. This application includes transmitter output characteristics as an attachment to 200 this application and is informally known as a DD-1494. The DD-1494 application that is 201 submitted with the CNR under test will be verified. The table below is only meant as an example 202 of what is typically found in a DD-1494 submission. The CNR system DD-1494 spectral mask 203 values will be used to generate the carrier offsets used to conduct the spectral mask test. If a DD-204 1494 application is not available, the CNR spectral mask, any spurious emissions, and harmonics 205 will be characterized and compared against requirements defined in Conducted Emissions 106 206 (CE106) referenced from MIL-STD-461G. 207

Spectral Mask Offsets for 1.2 MHz BW fc ± 18.75 kHz -25 dB fc ± 37.5 kHz -35 dB fc ± 75 kHz -43 dB

Table 1: DD 1494 Spectral Mask Power Levels for Carrier Offsets 208

This test also measures and characterizes the ability of the radio in controlling its spectral 209 emissions output and minimize any unintended out-of-band interference. Unintended interference 210 can be caused by the radio system affecting other communication systems or electrical devices 211 and all emissions that are not the radio carrier signal should be minimized to the greatest extent 212 possible. 213

The CNR under test is expected to adhere to its harmonic and spurious emissions as defined in the 214 DD-1494 application. If a DD-1494 is not available, the CNRs harmonic and spurious emissions 215 will be characterized and referenced against MIL-STD-461F Requirements for the Control of 216 Electromagnetic Interference Characteristics of Subsystems and Equipment CE106 Conducted 217 Emissions Antenna. The table below states the requirements from MIL-STD-461G for harmonic 218 and spurious performance. 219

Harmonic Levels

2nd Harmonic (fc * 2) -13 dBm 3rd Harmonic (fc * 3) -13 dBm

All Other Harmonics (fc * 4…n) -50 dBc Spurious Emissions (Spur) -50 dBc

Table 2: MIL-STD-461F Harmonic and Spurious Power Levels 221

1.1.2.5 Test Procedure 222

The procedures for executing this test case are shown in the following table: 223

Test Procedure

Review and understand the above Test Objectives and Test Criteria/Metrics.

2 Configure the Test Equipment to determine Insertion Loss following the procedures in the test record sheet.

3 Power on the test radios and allow them to complete POST.

4 Select the first Preset for testing and connect the radio to the calibrated test rig as depicted in the configuration diagram above.

5 Following the detailed procedures in the test record sheet, tune the Spectrum Analyzer to the test frequency and set Amplitude Offset, expected Amplitude, Bandwidth and Span.

6 Set the Spectrum Emission Mask to the specified parameters per the test record sheet instructions.

7 Select Trace View and capture screenshots of spectral emissions (spectral masks and harmonics/spurious emissions) for the CNR Radios Under Test.

8 Repeat the tests for all radios and all frequencies.

9 Record test data in the test record sheet.

10 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.1.2.6 Data to be Collected 224

The data to be collected are described in the table below: 225

Data Output 1 Test record sheets documenting test results.

2 Spectral Mask screen captures of each test.

3 TIR(s) documenting any anomaly or test failure.

1.1.2.7 Data Analysis 226

The test engineer will review the test record sheets collected at the end of each test trial and 227 compare the results against the test criteria/metrics. The results and any anomalies will be peer 228 reviewed with the test team and the documentation will be updated as necessary. 229

1.1.3 TC 1.1.3 Operating BW 230

1.1.3.1 Test Objectives 231

The objective of this test case is to ensure the CNR Radio covers the 30-88 MHz narrow band 232 channels frequency range. 233

1.1.3.2 Test Configuration 234

The CNR Radio under test will be configured as shown in Figure 3. Testing will be conducted on 235 a calibrated Agilent E4443A Spectrum Analyzer and JFW Model 50AA 079 Attenuator 236 Assembly. 237

Tests will be performed on the listed frequency bands listed above as set by the Mission Plan. 238

This test will be repeated on three (3) radios. 239

Figure 3: TC 1.1.3 Operating BW Test Configuration 241

1.1.3.3 Traffic Profile 242

The test support equipment in this test case displays the actual output power level from the radio 243 and does not require either voice or data traffic to be generated or recorded. 244

1.1.3.4 Requirements and Test Criteria/Metrics 245

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 246 table below: 247

TC 1.1.3

Operating BW

3.1.1.1.1 (T) Shall cover the frequency range from 30-88 MHz for narrow band channels.

Criteria:

Met: The CNR meets all Spectrum Compliance Standards.

Not Met: The CNR fails to meet Spectrum Compliance Standards.

Metric: Screenshots of test results.

1.1.3.5 Test Procedure 248

The procedures for executing this test case are shown in the following table: 249

Test Procedure 1 Review and understand the above Test Objectives and Test Criteria/Metrics.

2 Configure the Test Equipment to determine Insertion Loss following the procedures in the test record sheet.

3 Power on the test radios and allow them to complete POST.

4 Select the first Preset for testing and connect the radio to the calibrated test rig as depicted in the configuration diagram above.

5 Following the detailed procedures in the test record sheet, tune the Spectrum Analyzer to the test frequency and set Amplitude Offset, expected Amplitude, Bandwidth and Span.

6 Set the Spectrum Emission Mask to the specified parameters per the test record sheet instructions.

7 Select Trace View and capture screenshots of spectral emissions (spectral masks and harmonics/spurious emissions) for the CNR Radios Under Test.

8 Select different frequency on the radio within the operating band and capture screenshots.

9 Repeat the tests for all radios and all frequencies.

10 Record test data in the test record sheet.

11 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.1.3.6 Data to be Collected 250

The data to be collected are described in the table below: 251

Data Output 1 Test record sheets documenting test results.

2 TIR(s) documenting any anomaly or test failure.

3 Spectral Mask screen captures of each test.

1.1.3.7 Data Analysis 252

The test engineer will review the test record sheets collected at the end of each test trial and 253 compare the results against the test criteria/metrics. The results and any anomalies will be peer 254 reviewed with the test team and the documentation will be updated as necessary. 255

1.2 TC 1.2 SINCGARS Receive Sensitivity 257

1.2.1 Test Objectives 258

The objective of this test case is to measure the Receiver Sensitivity of the CNR Radio when 259 operating in the SINCGARS waveform. 260

1.2.2 Test Configuration 261

The CNR Radios will be configured as shown in Figure 4. System Under Test (SUT) will be 262 installed into RF shielded Faraday boxes in the test lab. Radios will be connected into net through 263 an Agilent Variable Attenuator. All unused ports will be terminated. 264

Tests will be performed on SINCGARS 30-88 MHz as set by the Mission Plan. 265

This test will be repeated on three (3) radios. 266

Figure 4: TC 1.2 SINCGARS Rx Sensitivity test Configuration 268

1.2.3 Traffic Profile 269

Manual Push To Talk (PTT) voice calls will be conducted for this test case. No data traffic profile 270 will be required. Audio testing will utilize an automated voice quality analysis tool. This tool 271 transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality 272 (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio 273 links to establish the receiver sensitivity for the CNR under test. 274

1.2.4 Requirements and Test Criteria/Metrics 275

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 276 table below: 277

TC 1.2

SINCGARS Rx Sensitivity

The PRD Requirements do not specify what the Rx sensitivity of the CNR radio must be, only that it must meet certain range requirements when operating in specific terrain environments.

Criteria:

Characterization Only.

Metric: Rx Sensitivity measured in dBm.

1.2.5 Test Procedure 279

The procedures for executing this test case are shown in the following table: 280

Test Procedure 1 This test is performed concurrently with TC 1.1.1. Please read that test case before beginning.

Select a radio with known Tx power out to be used as the Tx Reference Radio. This radio will remain as the Tx Reference Radio for the duration of the test. Install the test radio into the Faraday box as shown above; be sure to install a 30dB attenuator in line with the radio.

3 Install the System Under Test (SUT) into a Faraday box and power it on; be sure to install a 30 dB attenuator in line with the radio.

Following detailed instructions in the test record sheet, conduct PTT voice radio checks. Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test.

Increase the attenuation until clear voice is no longer heard. PESQ scores of 3 or greater will be counted as the call being complete.

5 Decrease attenuation until clear voice is again heard. Record this setting and calculate the Rx sensitivity per instructions in the test record sheet.

6 Repeat the tests for all radios and all frequencies and bandwidths.

7 Prior to powering down the radio, use the handheld temp gun to record knobs, handles, and HMI/HMI buttons. Then scan the thermo buttons for readings, add info to record sheet, and save file.

8 Record test data in the test record sheet.

9 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.2.6 Data to be Collected 282

The data to be collected are described in the table below: 283

Data Output 1 Test record sheets documenting test results.

3 TIR(s) documenting any anomaly or test failure.

1.2.7 Data Analysis 285

The test engineer will review the test record sheets collected at the end of each test trial and 286 compare the results against the test criteria/metrics. The results and any anomalies will be peer 287 reviewed with the test team and the documentation will be updated as necessary. 288

1.3 TC 1.4 SINCGARS Threshold Modes 289

The objective of this test case is to verify that the CNR Radio can successfully operate 290

SINCGARS in the threshold voice and data modes specified in the CNR PRD. See table below: 291

Test Case Number Test Case TC 1.4.1 SINCGARS SCPT – Voice TC 1.4.2 SINCGARS SCCT – Voice TC 1.4.3 SINCGARS FHPT – Voice TC 1.4.4 SINCGARS FHCT – Voice TC 1.4.5 SINCGARS SCPT – Data TC 1.4.6 SINCGARS SCCT –Data TC 1.4.7 SINCGARS FHPT – Data TC 1.4.8 SINCGARS FHCT – Data TC 1.4.9 16 kbps Transparent Data Mode (TDM)

TC 1.4.10 SINCGARS FH2/FH3 Hopping Mode (repeat select CT/CT2 Voice and Data subtests)

TC 1.4.11 SINCGARS F1/F2 Retransmit

TC 1.4.12 SINCGARS FHM / LNE

TC 1.4.13 SINCGARS Voice mode testing TC 1.4.14 SINCGARS CT2 – Voice TC 1.4.15 SINCGARS CT2 – Data

1.3.1 TC 1.4.1 SINCGARS SCPT – Voice 293

1.3.1.1 Test Objectives 294

The objective of this test case is to verify the CNR can successfully operate the threshold voice 295 modes of SINCGARS. 296

1.3.1.2 Test Configuration 297

The following test setup will be used to demonstrate the ability of the CNR to support the 298 SINCGARS voice modes. A legacy SINCGARS RT-1523 and the Contractor’s new CNR radio 299 will be used with presets configured for the SINCGARS Voice modes as shown in Figure 5. 300

Figure 5: TC 1.4.1 SINCGARS SCPT – Voice 302

1.3.1.3 Traffic Profile 303

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 304 made; 15 voice calls transmitted from Reference Radio and received on CNR, and 15 calls will be 305 transmitted from CNR and received on the Reference Radio. Calls will alternate between 306 transmit and receive. A standard voice count will be conducted and manually scored for each call. 307

1.3.1.4 Requirements and Test Criteria/Metrics 308

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 309 table below: 310

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.1 SINCGARS SCPT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting distance range requirements.

3.1.6.1 (T) Audible Status: The radio shall provide audible status, alerts, and cues.

3.4.1.1 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in PT SC mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

1.3.1.5 Test Procedure 311

The procedures for executing this test case are shown in the following table: 312

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.1.6 Data to be Collected 313

The data to be collected are described in the table below: 314

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

1.3.1.7 Data Analysis 315

The test engineer will review the test record sheets collected at the end of each test trial and 316 compare the results against the test criteria/metrics. The results and any anomalies will be peer 317 reviewed with the test team and the documentation will be updated as necessary. 318

1.3.2 TC 1.4.2 SINCGARS SCCT – Voice 319

1.3.2.1 Test Objectives 320

The objective of this test case is to verify the CNR can successfully operate the threshold voice 321 modes of SINCGARS. 322

1.3.2.2 Test Configuration 323

The following test setup will be used to demonstrate the ability of the CNR to support the 324 SINCGARS voice modes. A legacy SINCGARS RT-1523 and the Contractor’s new CNR radio 325 will be used with presets configured for the SINCGARS voice modes as shown in Figure 6: 326

Figure 6: TC 1.4.2 SINCGARS SCCT – Voice 328

1.3.2.3 Traffic Profile 329

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 330 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 331 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 332 transmit and receive. A standard voice count will be conducted and manually scored for each call. 333

1.3.2.4 Requirements and Test Criteria/Metrics 334

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 335 table below: 336

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.2 SINCGARS SCCT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting distance range requirements.

3.4.1.8 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in CT SC mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

1.3.2.5 Test Procedure 337

The procedures for executing this test case are shown in the following table: 338

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.2.6 Data to be Collected 339

The data to be collected are described in the table below: 340

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

1.3.2.7 Data Analysis 341

The test engineer will review the test record sheets collected at the end of each test trial and 342 compare the results against the test criteria/metrics. The results and any anomalies will be peer 343 reviewed with the test team and the documentation will be updated as necessary. 344

1.3.3 TC 1.4.3 SINCGARS FHPT – Voice 345

1.3.3.1 Test Objectives 346

The objective of this test case is to verify the CNR can successfully operate the threshold voice 347 modes of SINCGARS. 348

1.3.3.2 Test Configuration 349

The following test setup will be used to demonstrate the ability of the CNR to support the 350 SINCGARS voice modes. A legacy SINCGARS RT-1523 and the Contractor’s new CNR radio 351 will be used with presets configured for the SINCGARS voice modes as shown in Figure 7: 352

Figure 7: TC 1.4.3 SINCGARS FHPT – Voice 354

1.3.3.3 Traffic Profile 355

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 356 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 357 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 358 transmit and receive. A standard voice count will be conducted and manually scored for each call. 359

1.3.3.4 Requirements and Test Criteria/Metrics 360

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 361 table below: 362

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.3 SINCGARS FHPT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting distance range requirements.

3.4.1.2 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in PT FH mode.

3.4.3.11 (T) The CNR-RT shall operate the SINCGARS waveform and demonstrate the ability to perform functions as Frequency Hop Master control station in FH mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

1.3.3.5 Test Procedure 363

The procedures for executing this test case are shown in the following table: 364

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level, roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.3.6 Data to be Collected 365

The data to be collected are described in the table below: 366

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

1.3.3.7 Data Analysis 367

The test engineer will review the test record sheets collected at the end of each test trial and 368 compare the results against the test criteria/metrics. The results and any anomalies will be peer 369 reviewed with the test team and the documentation will be updated as necessary. 370

1.3.4 TC 1.4.4 SINCGARS FHCT – Voice 371

1.3.4.1 Test Objectives 372

The objective of this test case is to verify the CNR can successfully operate the threshold voice 373 modes of SINCGARS. 374

1.3.4.2 Test Configuration 375

The following test setup will be used to demonstrate the ability of the CNR to support the 376 SINCGARS voice modes. A legacy SINCGARS RT-1523 and the Contractor’s new CNR radio 377 will be used with presets configured for the SINCGARS voice modes as shown in Figure 8: 378

Figure 8: TC 1.4.4 SINCGARS FHCT – Voice 380

1.3.4.3 Traffic Profile 381

Once radios are configured and successfully connected via SINCGARS, 30 voice calls will be 382 made: 15 voice calls will be transmitted from Reference Radio and received on CNR and 15 calls 383 will be transmitted from CNR and received on the Reference Radio. Calls will alternate between 384 transmit and receive. A standard voice count will be conducted and manually scored for each call. 385

1.3.4.4 Requirements and Test Criteria/Metrics 386

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 387 table below: 388

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.4 SINCGARS FHCT –

Voice

3.1.1.2.1 (T) Voice shall have a 90% or greater Call Completion Rate (CCR) while meeting range requirements.

3.4.1.9 (T) The CNR-RT shall operate the SINCGARS waveform and be interoperable with legacy RT-1523 voice in CT FH mode.

Criteria:

Met: Call Completion percentage ≥ 90%.

Not Met: Call Completion percentage < 90%.

1.3.4.5 Test Procedure 389

The procedures for executing this test case are shown in the following table: 390

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 The test engineer will set attenuation to a nominal input level roughly 20db above sensitivity.

Audio testing will utilize an automated voice quality analysis tool. This tool transmits pre-recorded audio files and calculates the Perceptual Evaluation of Speech Quality (PESQ). The test will vary the Radio Frequency (RF) attenuation and propagation between radio links to establish the receiver sensitivity for the CNR under test. PESQ scores of 3 or greater will be counted as the call being complete.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.4.6 Data to be Collected 391

The data to be collected are described in the table below: 392

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

1.3.4.7 Data Analysis 393

The test engineer will review the test record sheets collected at the end of each test trial and 394 compare the results against the test criteria/metrics. The results and any anomalies will be peer 395 reviewed with the test team and the documentation will be updated as necessary. 396

1.3.5 TC 1.4.5 SINCGARS SCPT – Data 397

1.3.5.1 Test Objectives 398

The objective of this test case is to verify the CNR can successfully operate the threshold Data 399 modes (1200, 2400, 4800, 9600 kbps) of SINCGARS. 400

1.3.5.2 Test Configuration 401

The following test setup will be used to demonstrate the ability of the CNR to support the 402 SINCGARS voice modes. Two (2) CNR radios with presets configured for the SINCGARS 403 Voice modes is shown in Figure 9 below: 404

Figure 9: TC 1.1.4.5 CNRs connected SINCGARS for Data testing 406

1.3.5.3 Traffic Profile 407

Once radios are configured and successfully connected via SINCGARS, data will be transmitted 408 from the Reference Radio and received on CNR; data will also be transmitted from CNR and 409 received on the Reference Radio at the following data rates 1200, 2400, 4800, 9600 kbps. 410

1.3.5.4 Requirements and Test Criteria/Metrics 411

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 412 table below: 413

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.5 SINCGARS SCPT –

Data

3.1.1.2.2 (T) Data shall have an 85% or greater Message Completion Rate (MCR) while meeting distance range requirements.

3.4.2 (T) The CNR-RT shall operate the following SINCGARS Data Modes.

(Reference PRD Requirement 3.4.2 subparagraphs. The list includes 1200 bps SDM, 2400 bps SDM, 4800 bps SDM, 16 kbps transparent data mode, 1200 bps Enhanced Data Mode (EDM), 2400 bps EDM, 4800 bps EDM, 9600 bps EDM, Packet Mode – shared voice and data, 1200 bps RS-232 EDM, 2400 bps RS-232 EDM, 4800 bps RS-232 EDM, and 9600 bps RS-232

EDM)

Criteria:

Met: Bit error rate ≤ 10e-05

Not Met: Bit error rate > 10e-05

1.3.5.5 Test Procedure 414

The procedures for executing this test case are shown in the following table: 415

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 Configure FireBERD for each data rate.

4 Set up Device under test in the above test configuration.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.5.6 Data to be Collected 416

The data to be collected are described in the table below: 417

Data Output 1 Test record sheets documenting voice call scores.

2 TIR(s) documenting any anomaly or test failure.

1.3.5.7 Data Analysis 418

The test engineer will review the test record sheets collected at the end of each test trial and 419 compare the results against the test criteria/metrics. The results and any anomalies will be peer 420 reviewed with the test team and the documentation will be updated as necessary. 421

1.3.6 TC 1.4.6 SINCGARS SCCT – Data 422

1.3.6.1 Test Objectives 423

The objective of this test case is to verify the CNR can successfully operate the threshold Data 424 modes (1200, 2400, 4800, 9600 bps) of SINCGARS. 425

1.3.6.2 Test Configuration 426

The following test setup will be used to demonstrate the ability of the CNR to support the 427 SINCGARS data modes. Two (2) CNR radios with presets configured for the SINCGARS Data 428 modes as shown in Figure 10: 429

Figure 10: TC 1.4.6 SINCGARS SCPT – Data 431

1.3.6.3 Traffic Profile 432

Once radios are configured and successfully connected via SINCGARS, data will be transmitted 433 from the Reference Radio and received on CNR; data will also be transmitted from CNR and 434 received on the Reference Radio at the following data rates 1200, 2400, 4800, 9600 bps. 435

1.3.6.4 Requirements and Test Criteria/Metrics 436

The requirements, test criteria, and metrics that will be collected for this test case are shown in the 437 table below: 438

Test Case CNR PRD Requirements Test Criteria/Metric

TC 1.4.6 SINCGARS SCCT –

Data

3.1.1.2.2 (T) Data shall have an 85% or greater Message Completion Rate (MCR) while meeting range requirements.

3.4.2 (T) The CNR-RT shall operate the following SINCGARS Data Modes.

(Reference PRD Requirement 3.4.2 subparagraphs. The list includes 1200 bps SDM, 2400 bps SDM, 4800 bps SDM, 16 kbps transparent data mode, 1200 bps Enhanced Data Mode (EDM), 2400 bps EDM, 4800 bps EDM, 9600 bps EDM, Packet Mode – shared voice and data, 1200 bps RS-232 EDM, 2400 bps RS-232 EDM, 4800 bps RS-232 EDM, and 9600 bps RS-

232 EDM)

Criteria:

Met: Bit error rate ≤ 10e- 05.

Not Met: Bit error rate > 10e-05.

1.3.6.5 Test Procedure 439

The procedures for executing this test case are shown in the following table: 440

1 Review the test objective and test criteria/metric.

2 Fill out a test record sheet at start of test and capture required information in the test record sheet during the trial.

3 Configure FireBERD for each data rate.

4 Set up Device under test in the above test configuration.

5 Record test data in the test record sheet.

6 Document any anomaly experienced during the test in the test record sheet and a Test Incident Report (TIR) in accordance with lab procedures.

1.3.6.6 Data to be Collected 441

The data to be collected are described in the table below: 442

Data Output 1 Test record sheets documenting Bit Error Rate.

2 TIR(s) documenting any anomaly or test failure.

1.3.6.7 Data Analysis 443

The test engineer will review the test record sheets collected at the end of each test trial and 444 compare the…