A22_Attachment_11_(JT_Sample_Task_Order_FINAL_-_May_26_2017).pdf

SAMPLE TASK FOR CONTRACTING PURPOSES ONLY

Submitted By:

First MI. Last, Col, USAF

Joint Test Director, J-SALT JT

Signature

Approved By:

First MI. Last First MI. Last

Deputy Director Deputy Assistant Secretary of Defense

Air Warfare Emerging Capability & Prototyping

DOT&E

Signature Signature

Distribution Statement D: Distribution authorized to the Department of Defense and US

DOD contractors only for the purposes of test and evaluation, April 14, 2018. Other requests shall be referred to the Joint Test and Evaluation Program Office.

Joint Satellite Avoidance of Laser Threats (J-SALT)

Joint Test (JT)

Project Master Plan

April 2018

Revised and Replaced by Amendment 0004 u4cttpvf Typewritten Text Solicitation Attachment 11

J-SALT JT Project Master Plan

This page intentionally left blank.

Revised and Replaced by Amendment 0004

REPORT DOCUMENTATION PAGE

Form Approved

OMB No. 0704-0188 Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS.

1. REPORT DATE (DD-MM-YYYY)

2. REPORT TYPE

3. DATES COVERED (From - To)

4. TITLE AND SUBTITLE

5a. CONTRACT NUMBER

5b. GRANT NUMBER

5c. PROGRAM ELEMENT NUMBER

6. AUTHOR(S)

5d. PROJECT NUMBER

5e. TASK NUMBER

5f. WORK UNIT NUMBER

7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES)

AND ADDRESS(ES)

8. PERFORMING ORGANIZATION REPORT

NUMBER

9. SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S)

11. SPONSOR/MONITOR’S REPORT

NUMBER(S)

12. DISTRIBUTION / AVAILABILITY STATEMENT

13. SUPPLEMENTARY NOTES

14. ABSTRACT

15. SUBJECT TERMS

16. SECURITY CLASSIFICATION OF:

17. LIMITATION

OF ABSTRACT

18.

NUMBER OF

PAGES

19a. NAME OF RESPONSIBLE

PERSON

a. REPORT

b. ABSTRACT

c. THIS PAGE

19b. TELEPHONE NUMBER (include area code)

Standard Form 298 (Rev. 8-98) Prescribed by ANSI Std. Z39.18

J-SALT JT Project Master Plan i

EXECUTIVE SUMMARY

ES.0 Joint Test Overview

The Joint Satellite Avoidance of Laser Threats (J-SALT) Joint Test (JT) will develop tactics, techniques, and procedures (TTP) designed to mitigate adversary laser threats while maximizing the effectiveness of space-based system operations. Specifically, the J-SALT JT will focus on improving space operator’s mission planning capabilities at both the operational and tactical levels in response to laser threats, and build mitigation strategies by including guidelines for developing courses of action at the tactical level.

Chartered on February 25, 2018, the J-SALT JT is conducted under the auspices of the Director, Operational Test and Evaluation. The United States Strategic Command (USSTRATCOM) is the sponsor. The United States Air Force Warfare Center is the operational endorser.

Participants in the J-SALT JT include the Joint Space Operations Center (JSpOC), First Space

Operations Squadron (1 SOPS), Air Force Research Laboratory (AFRL), Operationally

Responsive Space (ORS) Program Office, and the Joint Electronic Warfare Center (JEWC).

ES.1 Problem Description

Space is vital to United States (US) national security and our ability to understand emerging threats, project power globally, conduct operations, support diplomatic efforts, and enable global economic viability. Space systems and their supporting infrastructure face a range of man-made threats that could deny, degrade, deceive, disrupt, or destroy assets. Potential adversaries continually seek to exploit perceived space vulnerabilities. As nations and non-state actors develop counterspace capabilities in the next decade, threats to US space systems will challenge both the stability and security of the space environment.

Recent improvements in both laser power and beam control technologies have generated concerns in the space community. The potential effects of laser-based anti-satellite (ASAT) systems pose a serious threat to space operations. There is a paradox where the potential for damage to high-value space-based systems can be caused by a relatively low-power laser. This is due to the fact that a high optical gain (magnification) typical for space-based imaging systems can be directly affected by a low-power laser system. The optical gain of the sensor enhances the low-power laser’s ability to deliver energy onto sensitive or critical components. The results of this damage range from obscuration of portions of the sensor’s field of view to sensor dazzling or even catastrophic system failure.

Current operational procedures executed at the JSpOC begin with initial indications and warnings from the intelligence community. Based on these indications and warnings, the JSpOC uses existing tools and processes to determine which satellites will be exposed to the threat—that is, simply determining which satellite’s ground track will pass over the identified threat location.

JSpOC then notifies all tactical level units that have satellites exposed to the threat. The tactical units then evaluate the risk to their payload by determining if it is oriented toward the identified threat during the pass. No further information is available to the operational or tactical units to refine their risk determination or to develop appropriate courses of action to continue space-based operations.

J-SALT JT Project Master Plan ii

ES.1.1 Problem Statement

The following J-SALT JT problem statement was developed in coordination with the space community and approved at the January 2018 Joint Warfighter Advisory Group conference.

Space operators at the operational and tactical levels lack the ability to adequately identify and mitigate laser ASAT threats.

ES.1.2 Test Issues

To address this problem, the J-SALT JT will develop TTP that provide procedures to conduct payload susceptibility assessments and development courses of action to mitigate laser ASAT threats while maximizing space-based system availability. The J-SALT problem statement was separated into two supporting test issues representing the operational and tactical level. While TTP are needed at both levels, the tasks performed at each level are sufficiently different to warrant this separation. The J-SALT test issues are as follows:

Table ES-1. Test Issues

Issue Description

1 Using laser-based ASAT threat identification and mitigation (LAIM) TTP, to what extent are space operators at the operational level able to identify and mitigate laser

ASAT threats?

2 Using LAIM TTP, to what extent are space operators at the tactical level able to identify and mitigate laser ASAT threats?

ES.1.3 Operational Effectiveness Measures

The J-SALT JT will measure operational effectiveness in terms of satellite availability. This is defined as the amount of time a satellite can perform its mission during a single orbit and still remain within acceptable risk levels. Other measures of accuracy, timeliness, completeness, and usefulness will be used to determine the ability of the TTP to support operational and tactical payload susceptibility assessments, unit notifications, and development of COAs to support the mission. Operational effectiveness will be assessed by comparing results using new procedures to results using existing procedures.

ES.1.4 Test Limitations and Assumptions

The J-SALT JT has identified the following limitation that impacts testing: ATLAS was designed as an “engineering tool.” As such, ATLAS requires certain technical background and experience to run the program to receive valid outputs. This software configuration is not currently designed for operational use (it was not designed for space operators to make inputs and run the assessment). To mitigate this limitation, the J-SALT JT team will maintain two JEWC personnel trained in operating and running ATLAS to provide dedicated response capability for space operators during the joint test. The LAIM TTP will guide space operators on how to use the output from ATLAS for mission planning, and the mechanics of how space operators obtain that output will not impact evaluation of the LAIM TTP.

The J-SALT JT assumes that ATLAS is valid and provides acceptable payload susceptibility results. This assumption will be validated by reviewing and documenting verification and

J-SALT JT Project Master Plan iii validation (V&V) or V&V-like activities accomplished by AFRL or other ATLAS users to support JTD accreditation of the tool for use by the J-SALT JT.

ES.2 Test Concept

The J-SALT JT test concept consists of the test approach, test articles, test events, test support, test design, and test schedule.

ES.2.1 Test Approach

The J-SALT JT will employ a three-phase test approach to conduct two sequential field tests in conjunction with combatant command (CCMD) exercises involving space operations.

During each phase, the JWAG and GOSC will provide top-level guidance and feedback.

Results from test events and subsequent data analysis will support interim test product releases to the warfighter. Figure ES-1 illustrates the three phases and the following sections describe the main activities in each phase.

Figure ES-1. J-SALT JT Test Approach

Phase I

The primary objectives of this phase are to develop an initial draft TTP and to conduct planning for field test one (FT-1). After standing up the joint test, the J-SALT JT team will conduct a risk reduction event (RRE). The RRE will help establish both data exchange requirements and baseline measurements for existing procedures. Phase I also consists of test planning in preparation for FT-1 as well as conducting JWAG and GOSC meetings to involve the space community in the development of the initial draft TTP.

Phase II

The primary objectives of this phase are to conduct FT-1, refine the draft TTP based on test results, and plan for field test two (FT-2). Upon completion of FT-1, the J-SALT JT team will release the revised TTP as an interim test product. JWAG and GOSC meetings will be used to provide critical feedback from the results of FT-1 to the warfighter.

Interim products delivered to warfighters during JT

• Standup of joint test

• Develop Initial TTP

• Risk Reduction Event

• Document Baseline Procedures

• Collect Baseline Data

• Joint Warfighter Advisory Group

• General Officer Steering Committee

• Plan for Field Test 1

• Conduct Field Test 1

• Analyze results of Field Test-1

• Joint Warfighter Advisory Group

• General Officer Steering Committee

• Refine TTP

• Plan for Field Test 2

• Conduct Field Test 2

• Analyze results of Field Test-2

• Joint Warfighter Advisory Group

• General Officer Steering Committee

• Develop test report

• Finalize and Transition TTP

• Closedown joint test

Final products delivered to warfighters at JT end

Phase I Develop TTP

Phase II Test and Refine

TTP

Phase III Test and Transition

J-SALT JT Project Master Plan iv

Phase III

The primary objectives of this phase are to conduct FT-2, finalize the TTP based on test results, develop the final report, transition the final TTP to the test product owner, and closedown the joint test.

ES.2.2 Test Article

The test article is laser-based ASAT threat identification and mitigation (LAIM) TTP that incorporates payload susceptibility information into the mission planning and mitigation process for the operational and tactical levels of space operations to improve space operators’ response to laser ASAT threats. The planned users of the LAIM TTP are space operators located at the JSpOC for operational level execution and at space operations squadrons for tactical level execution.

ES.2.3 Test Events

The J-SALT JT will conduct two major test events, Field Test One (FT-1) and Field Test

Two (FT-2), in conjunction with CCMD exercises involving space operations. Based on the

J-SALT team’s evaluation, Exercise Global Thunder 16 (GT-16), scheduled for October

2018, was selected as the test venue for FT-1. Exercise GT-16 is USSTRATCOM’s annual field training and battle staff exercise designed to exercise all command mission areas in space, cyberspace, missile defense, combating weapons of mass destruction, and ISR with primary emphasis on nuclear command and control. GT-16 will be conducted with North

American Aerospace Defense Command and US Northern Command’s Exercise Vigilant

Shield 16, which aims to train participants in homeland defense.

Exercise Global Lightning 16, scheduled for May 2019, was selected as the test venue for

FT-2. As a USSTRATCOM-sponsored event, GL-16 has a robust history of exercise scenarios that include space-based ISR assets, laser ASAT threats, and required participants.

Exercise GL-16 will be conducted in coordination with other combatant commands, Services, and appropriate US government agencies to deter and detect strategic attacks against the US and its allies. GL-16 provides unique training opportunities to incorporate the most current technology and techniques in support of the USSTRATCOM mission.

ES.2.4 Test Support

For each field test, the J-SALT JT will require the appropriate organizations and related hardware necessary to represent the operational environment. Table ES-2 illustrates the required support.

J-SALT JT Project Master Plan v

Table ES-2. Test Support

Organization/Location Systems

JSpOC/Vandenberg AFB, CA Telephone (Unsecure/Secure)

Email (NIPR/SIPR/JWICS)

SKIWeb

JMS

1 SOPS/Schriever AFB, CO Telephone (Unsecure/Secure)

Email (NIPR/SIPR/JWICS)

SKIWeb

Satellite Tool Kit (STK)

JEWC/San Antonio, TX Telephone (Unsecure/Secure)

Email (NIPR/SIPR/JWICS)

ATLAS

ES.2.5 Test Design

The J-SALT JT identified three factors affecting both operational and tactical-level operator responses to laser ASAT threats. These factors were selected based on an expected and significant change in operator responses and subsequent use of the LAIM TTP. Other factors such as atmospheric conditions, satellite position, and satellite altitude are beyond the control of the J-SALT JT team and will be recorded during the test since these factors may vary during individual runs and impact the test results. For this reason, the recordable factors are maintained in the event causality analysis is required. The three accepted factors and associated levels are listed in table ES-3.

Table ES-3. Test Design

JMP software was used to determine the required runs using the three factors with each at two levels. JMP output for a full-factorial design yielded 5 replicates for a total of 20 runs based on the following inputs:

Alpha: .1

Signal to noise ratio: 1

Error degrees of freedom: 25

Power: .866

Data are normally distributed

Design Of Experiment (DOE) Factors

Accepted Factors Levels

Threat system capability Can damage sensor Cannot damage sensor

Commander’s Risk Acceptance Accept some risk Accept no risk

Operator procedures Current procedures New procedures

Recordable (Non-DOE)

Atmospheric conditions Satellite position (nadir/off-nadir) Satellite altitude

J-SALT JT Project Master Plan vi

The numbers presented in table ES-4 reflect the number of runs to establish enough data to determine if there is a statistical difference between the current procedures and the LAIM

TTP.

Table ES-4. Test Design Trial Runs

Factor

Operator Procedures Threat Capability Commander’s Risk

Acceptance Number of

Runs

Current Procedures

Can damage sensor Accept some risk 5

L e v e l

Accept no risk 5

Cannot damage sensor Accept some risk 5

Accept no risk 5

New Procedures

Can damage sensor Accept some risk 5

Accept no risk 5

Cannot damage sensor Accept some risk 5

Accept no risk 5

Total Trial Runs 40

ES.2.6 Joint Test Schedule

The joint test schedule, shown in figure ES-2, provides an orderly timeline that yields interim products for the warfighter, with the final test product completed in two years. The schedule depicts planned timelines for each test event and the major milestones that will be achieved during the joint test cycle. The schedule also includes advisory committee dates, test event technical review dates, detailed test plan, and report dates. This timeframe reflects consideration of the timing and sequencing of the test events.

The keystone events include two field tests: FT-1 scheduled for October 2018 and FT-2 scheduled for May 2019. The J-SALT JT team will conduct three JWAG meetings for warfighter feedback and advice; test planning; report coordination, and test product review.

The J-SALT JT will hold three GOSC meetings: one for initial introduction and guidance, one for FT-1 test result updates, and one after FT-2 to out brief the final results. A detailed test plan (DTP) for each field test will be submitted in accordance with the JT&E Program

Handbook. Test Event Technical Review (TETR) and Post-Test Technical Review (PTTR) meetings will be conducted prior to and following each field test. Other required documents such as the closedown and transition plan (CTP) and lessons learned report (LLR) will be published in accordance with the JT&E Program Handbook. The closedown date for the J-

SALT JT is December 31, 2019.

J-SALT JT Project Master Plan vii

Figure ES-2. Test Schedule

ES.3 Data Collection, Analysis, and Evaluation

The following sections describe the data collection, analysis, and evaluation for the J-SALT JT.

ES.3.1 Data Collection

Required data elements include: threat event, time of occurrence, warfighter actions taken, data source used, products produced, decisions made, who the warfighter coordinated with or passed products to, and so on. The data collection methods are expected be the same or similar for both test events, with appropriate adjustments made depending on the nature of the test. Electronic data collection will include email and chat as well as other softcopy files created as part of COA development. Electronic data files will be collected daily. While electronic data files and logs will make up some of the data collection, manual data collection will collect the majority of data using data collection forms and questionnaires.

Manual data collection will be conducted by positioning data collectors at key locations within the JSpOC and 1SOPS. Data collectors will record relevant actions taken to identify and mitigate laser ASAT threats. These actions include ops floor discussions, telephone calls/messages, and LAIM TTP compliance. Data collectors will be responsible for recording event times and personal observations, collecting copies of relevant products, and administering questionnaires. Data collectors will also administer demographic and task-related questionnaires.

J-SALT JT Project Master Plan viii

ES.3.2 Analysis

The J-SALT JT will conduct exploratory and confirmatory analysis and operational assessment to measure and explain LAIM TTP-related effectiveness and to identify potential revisions to the LAIM TTP. The joint test will utilize standard statistical packages such as

JMP to conduct analysis. Once trial reconstruction is complete, J-SALT data analysts will conduct exploratory analysis with the intent of gaining insight into the data. This entails producing descriptive statistics (for example, mean, median, standard deviation, variance, range, skewness, and kurtosis), frequency tables and graphs, histograms, box-and-whisker plots, stem-and-leaf plots, and scatter plots. Analysts will examine these statistics and graphs to investigate any differences in the data. The major goal of exploratory analysis will be to:

Determine the underlying distribution (especially since the test design assumed normality) and what statistical tests are appropriate given the underlying distribution

Determine if there are any outliers and under what circumstances (controlled or uncontrolled) these outliers occurred, and develop procedures for handling these outliers

Confirmatory analysis will consist of statistical and hypothesis testing techniques based upon the factor-level combinations. The first step will be to conduct an analysis of variance

(ANOVA) to determine if any of the factors or their interactions yield significant inputs to the measure being assessed. The second step will be to conduct hypothesis testing on each of the measures to determine if the measure when using LAIM TTP was statistically better than when using existing procedures.

Analysts will also conduct an operational assessment of the LAIM TTP. To accomplish this, analysts will include experienced space operators in the analysis process. The

J-SALT JT may also consult external subject matter experts (SME) from the JWAG or from

USSTRATCOM, and subordinate and supporting operational units tasked with the space mission to clarify particular processes or procedures. The operational assessment will be conducted concurrently throughout the test analysis process. The objectives of the operational assessment are to:

Conduct a detailed review of the collected data, surveys, and observations

Identify areas that are performing well

Identify deficiencies in C2 architecture, processes, or procedures

Identify any other deficiencies in DOTMLPF factors

Develop specific recommendations in order of recommended implementation

Develop a roadmap for improvement

ES.3.3 Evaluation

To evaluate the overall effectiveness of the LAIM TTP, the J-SALT JT will establish the importance of each measure in answering each sub-issue, the importance of each sub-issue relative to the issue, and the importance of each issue to resolving the problem. Prior to FT-

1, the J-SALT JT will solicit guidance from JWAG members to establish the relative importance (weighting) of each measure, sub-issue, and issue. The purpose of this is two-fold: 1) it incorporates warfighter feedback, and 2) it allows for an objective assessment of the “roll up” to evaluate the overall effectiveness of the LAIM TTP.

J-SALT JT Project Master Plan ix

The performance of most of the measures will be obtained from the results conducted via confirmatory analysis. For each measure where the analysts rejected the null hypothesis, a corresponding “pass” assessment will be assigned. For each measure where analysts failed to reject the null hypothesis, a corresponding “fail” assessment will be assigned (meaning there was not enough statistical evidence to state the measure had a discernible improvement).

Each metric scored as “pass” would be assigned a “1”; those scored as “fail” would be assigned a “0”. Each measure score (0 or 1) would then be multiplied by the importance factor (weight) assigned. As there is only one OEM, mean time of mission availability, that measure will be weighted more than other measures in the roll-up. The corresponding sub-issue will be rated as “pass” if the total score of all measures is more than 75%. The same process will be applied at the sub-issue level to determine the total score for each issue, and to the issues to determine problem resolution.

ES.4 Test Products

The J-SALT JT will develop the LAIM TTP that incorporate payload susceptibility information into mission planning at operational and tactical levels for space operator response to laser

ASAT threats. The LAIM TTP will inform space operators on how to use the payload susceptibility assessment tool output to identify when their payload is at risk and to develop courses of action to mitigate risk while supporting the warfighter. The LAIM TTP will be delivered incrementally during the course of the joint test. At the end of phase II, the J-SALT JT will have produced a revised version of the LAIM TTP based on results of FT-1. This revised version will be delivered to AFSPC A3for use at the operational and tactical levels as an interim test product. The final version of the LAIM TTP will be provided at the end of phase III following any revisions based on results of FT-2. AFSPC A3 will be the final test product owner.

Other products that the J-SALT JT may develop that may be of use to the warfighter include scenarios developed for the field tests. These will be transitioned to the JSpOC for inclusion in existing training programs as appropriate. There is no anticipated funding requirement and currently assigned training personnel at the JSpOC can incorporate these scenarios into their existing training program.

J-SALT JT Project Master Plan x

J-SALT JT Project Master Plan xi

TABLE OF CONTENTS

EXECUTIVE SUMMARY ......................................................................................................ES-1

CHAPTER 1 INTRODUCTION ................................................................................................ 1-1

1.0 Overview .............................................................................................................................. 1-1

1.1 Problem Background ............................................................................................................ 1-1

1.1.1 Problem Description ..................................................................................................... 1-1

1.1.2 Operational Scenario ..................................................................................................... 1-1

1.1.3 Systems Description...................................................................................................... 1-2

1.1.4 Threat Assessment ........................................................................................................ 1-3

1.2 Problem Statement ................................................................................................................. 1-3

1.3 Test Issues .............................................................................................................................. 1-3

1.4 Operational Effectiveness Measures ...................................................................................... 1-4

1.5 Test Limitations and Assumptions ........................................................................................ 1-4

CHAPTER 2 TEST CONCEPT................................................................................................... 2-1

2.0 Introduction ............................................................................................................................ 2-1

2.1 Test Approach ....................................................................................................................... 2-1

2.1.1 Phase I ........................................................................................................................... 2-1

2.1.2 Phase II.......................................................................................................................... 2-1

2.1.3 Phase III ........................................................................................................................ 2-2

2.2 Test Article............................................................................................................................. 2-2

2.3 Test Events ............................................................................................................................. 2-2

2.3.1 FT-1............................................................................................................................... 2-2

2.3.2 FT-2............................................................................................................................... 2-3

2.4 Test Support ........................................................................................................................... 2-4

2.4.1 Operational Force Test Support .................................................................................... 2-4

2.4.2 Simulations, Models, and/or Test Beds ........................................................................ 2-4

2.5 Test Design ............................................................................................................................ 2-4

2.6 Joint Test Schedule ................................................................................................................ 2-6

2.7 Risk Management .................................................................................................................. 2-7

2.7.1 Test Site or Venue Planning ......................................................................................... 2-7

2.7.2 Backup Test Venues ..................................................................................................... 2-8

2.7.3 Risk Reduction Event ................................................................................................... 2-8

2.7.4 Test Article Training ..................................................................................................... 2-9

2.7.5 Test Team Training ....................................................................................................... 2-9

2.8 Safety .................................................................................................................................... 2-9

2.9 Environmental Considerations ............................................................................................... 2-9

CHAPTER 3 DATA MANAGEMENT, ANALYSIS, AND EVALUATION ........................... 3-1

3.0 Introduction ............................................................................................................................ 3-1

3.1 Data Management Overview ................................................................................................. 3-1

3.1.1 Data Collection ............................................................................................................. 3-1

3.1.2 Media Handling and Control ........................................................................................ 3-4

3.1.3 Data Storage .................................................................................................................. 3-4

3.1.4 Data Quality Control ..................................................................................................... 3-4

3.1.5 Data Access and Control ............................................................................................... 3-5

3.1.6 Data Processing ............................................................................................................ 3-5

J-SALT JT Project Master Plan xii

3.1.7 Trial Reconstruction ..................................................................................................... 3-6

3.2 Analysis Overview ................................................................................................................. 3-6

3.2.1 Exploratory Analysis .................................................................................................... 3-7

3.2.2 Confirmatory Analysis .................................................................................................. 3-7

3.2.3 Operational Assessment ................................................................................................ 3-8

3.3 Evaluation Plan ...................................................................................................................... 3-8

CHAPTER 4 TEST PRODUCTS ................................................................................................ 4-1

4.0 Introduction ............................................................................................................................ 4-1

4.1 Test Products .......................................................................................................................... 4-1

4.2 Test Product Transition .......................................................................................................... 4-1

4.3 Other Products and Transition Strategy ................................................................................. 4-1

CHAPTER 5 TEST REQUIREMENTS ...................................................................................... 5-1

5.0 Introduction ............................................................................................................................ 5-1

5.1 DOT&E Requirements........................................................................................................... 5-1

5.1.1 DOT&E Support Requirements .................................................................................... 5-1

5.1.2 DOT&E Automated Data Processing Requirements .................................................... 5-2

5.1.3 DOT&E Test Activity Requirements............................................................................ 5-2

5.1.4 DOT&E Production Requirements ............................................................................... 5-2

5.1.5 DOT&E Infrastructure Requirements ........................................................................... 5-3

5.1.6 DOT&E Contractor Staffing Requirements.................................................................. 5-3

5.1.7 DOT&E Project Modeling and Simulation Requirements ........................................... 5-3

5.1.8 DOT&E Final Test Product Requirements ................................................................... 5-3

5.2 Sponsor and Participating Service Requirements .................................................................. 5-3

5.2.1 Sponsor and Service Support Requirements ................................................................. 5-3

5.2.2 Sponsor and Service Automated Data Processing Requirements ................................. 5-3

5.2.3 Sponsor and Service Test Activity Requirements ........................................................ 5-3

5.2.4 Sponsor and Service Infrastructure Requirements ........................................................ 5-4

5.2.5 Government Personnel Requirements........................................................................... 5-4

5.3 Other Requirements ............................................................................................................... 5-4

5.4 Resource Accountability ........................................................................................................ 5-4

5.5 Formal Agreements ................................................................................................................ 5-5

CHAPTER 6 MANAGEMENT .................................................................................................. 6-1

6.0 Introduction ............................................................................................................................ 6-1

6.1 Joint Test Team Composition ................................................................................................ 6-1

6.1.1 Government-Provided Personnel .................................................................................. 6-1

6.1.2 Contractor Staff ............................................................................................................. 6-1

6.2 Advisory Functions ................................................................................................................ 6-3

6.2.1 General Officer Steering Committee ............................................................................ 6-3

6.2.2 Joint Warfighter Advisory Group ................................................................................. 6-4

6.3 Project Management Reviews ................................................................................................ 6-4

6.3.1 Internal Reviews ........................................................................................................... 6-4

6.3.2 External Reviews .......................................................................................................... 6-5

6.4 Required Documentation ....................................................................................................... 6-6

6.4.1 Plans .............................................................................................................................. 6-6

6.4.2 Reports .......................................................................................................................... 6-6

6.5 Security .................................................................................................................................. 6-6

J-SALT JT Project Master Plan xiii

LIST OF FIGURES

Figure 1-1. Operational Scenario ................................................................................................. 1-2

Figure 2-1. Test Approach ........................................................................................................... 2-1

Figure 2-2. Test Schedule ............................................................................................................ 2-7

Figure 3-1. Data Management, Analysis, and Evaluation Overview .......................................... 3-1

Figure 3-2. Test Locations ........................................................................................................... 3-4

Figure 3-3. Data Processing Flow ................................................................................................ 3-6

LIST OF TABLES

Table 2-1. Test Support................................................................................................................ 2-4

Table 2-2. Test Design ................................................................................................................. 2-5

Table 2-3. Test Design Trial Runs ............................................................................................... 2-6

Table 3-1. Data Collection Footprint ........................................................................................... 3-3

Table 6-1. Government-Provided Personnel................................................................................ 6-1

Table 6-2. Contractor Staff Functional Skill Sets and Abilities/Experience ............................... 6-2

Table 6-3. General Officer Steering Committee Composition .................................................... 6-3

Table 6-4. Joint Warfighter Advisory Group Composition ......................................................... 6-4

Table 6-5. Internal Reviews ......................................................................................................... 6-4

Table 6-6. External Reviews ........................................................................................................ 6-5

LIST OF ANNEXES

ANNEX A ACRONYMS AND ABBREVIATIONS .............................................................. A-1

ANNEX B DEFINITIONS OF TERMS ...................................................................................B-1

ANNEX C DENDRITIC STRUCTURE AND TEST DATA REQUIREMENTS MATRIX ..C-1

ANNEX D CONSOLIDATED RESOURCE ESTIMATE ...................................................... D-1

(Provided under separate cover)

ANNEX E FORMAL AGREEMENTS .................................................................................... E-1

ANNEX F ARMY TEST RESOURCES PLAN ...................................................................... F-1

ANNEX G AIR FORCE TEST RESOURCES PLAN ............................................................. G-1

ANNEX H SECURITY ............................................................................................................ H-1

ANNEX I MODELING AND SIMULATION PLAN ............................................................. I-1

ANNEX J REFERENCES ........................................................................................................ J-1

ANNEX K DISTRIBUTION LIST .......................................................................................... K-1

ANNEX L TEST ARTICLE DEVELOPMENT....................................................................... L-1

ANNEX M SUPPLEMENTAL INFORMATION .................................................................. M-1

(Provided under separate cover – located in the JT&E handbook)

J-SALT JT Project Master Plan xiv

J-SALT JT Project Master Plan 1-1

CHAPTER 1 INTRODUCTION

1.0 Overview

This project master plan (PMP) provides guidance for managing and conducting the Joint

Satellite Avoidance of Laser Threats (J-SALT) Joint Test (JT). This PMP outlines the problem description, test issues, and test objectives; the test concept (to include test planning and execution);

data management, analysis, and evaluation plans; test products; test requirements; and test management activities. It provides project-level specifics the joint test must accomplish to answer the test issues and resolve the operational problem. This chapter describes the problem background, problem statement, test issues, operational effectiveness measures, and test limitations and assumptions.

Chartered on February 25, 2018, the J-SALT JT is conducted under the auspices of the Director, Operational Test and Evaluation. The United States Strategic Command (USSTRATCOM) is the sponsor. The United States Air Force Warfare Center (USAFWC) is the operational endorser. Participants in the J-SALT JT include the Joint Space Operations Center (JSpOC), First Space Operations Squadron (1 SOPS), Air Force Research Laboratory (AFRL), Operationally Responsive Space (ORS) Program Office, and Joint Electronic Warfare Center

(JEWC).

1.1 Problem Background

The following sections describe the problem, operational scenario, systems, and threat pertinent to the J-SALT JT.

1.1.1 Problem Description

Space is vital to United States (US) national security and our ability to understand emerging threats, project power globally, conduct operations, support diplomatic efforts, and enable global economic viability. Space systems and their supporting infrastructure face a range of man-made threats that could deny, degrade, deceive, disrupt, or destroy assets. Potential adversaries continually seek to exploit perceived space vulnerabilities. As nations and non-state actors develop counterspace capabilities in the next decade, threats to US space systems will challenge both the stability and security of the space environment.

Recent improvements in both laser power and beam control technologies have generated concerns in the space community. The potential effects of laser-based anti-satellite (ASAT) systems pose a serious threat to space operations. There is a paradox where the potential for damage to high-value space-based systems can be caused by relatively low-power laser. This is due to the fact that a high optical gain (magnification) typical for space-based imaging systems can be directly affected by a low-power laser threat system. The optical gain of the sensor enhances the low-power laser’s ability to deliver energy onto sensitive or critical components. The results of this damage range from obscuration of portions of the sensor’s field of view, to sensor dazzling, or even catastrophic system failure.

1.1.2 Operational Scenario

The operational scenario for the J-SALT problem consists of low earth orbit (LEO) satellites controlled by 1 SOPS and the JSpOC being denied or degraded by ground-based laser threats as depicted in figure 1-1. Current operational procedures executed at the JSpOC begin with

J-SALT JT Project Master Plan 1-2 initial indications and warnings from the intelligence community. Based on these indications and warnings, the JSpOC uses existing tools and processes to determine which satellites will be exposed to the threat—that is, simply determining which satellite’s ground track will pass over the identified threat location. JSpOC then notifies all tactical level units that have satellites exposed to the threat. The tactical units then evaluate the risk to their payload by determining if it is oriented toward the identified threat during the pass. No further information is available to the operational or tactical units to refine their risk determination or to develop appropriate courses of action to continue space-based operations.

Figure 1-1. Operational Scenario

1.1.3 Systems Description

The operational scenario includes existing systems used by both JSpOC and 1 SOPS to execute current operations. The primary methods to exchange information include:

telephone; email; Non-secure Internet Protocol Router Network (NIPRNet); Secure Internet

Protocol routing Network (SIPRNet); Joint Worldwide Intelligence Communications System

(JWICS), and Strategic Knowledge Integration Web (SKIWeb). SKIWeb provides net-centric, asynchronous, collaborative event management capabilities that include enterprise level features to reduce information overload and improve space operator effectiveness.

J-SALT JT Project Master Plan 1-3

Another tool the JSpOC uses is the JSpOC Mission System (JMS) to plot satellite orbits.

JMS is an integrated, net-centric Space Situational Awareness (SSA) and Command &

Control (C2) capability designed to rapidly detect, track, & characterize objects of interest, using a near real-time high accuracy catalog. JMS provides timely space effects in support of joint tactical operations while identifying and exploiting both traditional and non-traditional sources. This system performs space threat analysis; displays results via a user-defined operational picture (UDOP); develops a space order of battle; and supports C2 of space forces in dynamic environments.

Essential to providing payload susceptibility information from potential laser threats is the

AFRL Tool for Lasers and Satellites (ATLAS). At the tactical level, the outputs from

ATLAS allow further evaluation of payload susceptibility and COA development. The

ATLAS tool may also be used to gain increased threat fidelity or to build pre-existing assessments of the identified threat.

1.1.4 Threat Assessment

See annex M, supplemental information, regarding current status of laser ASAT threats.

1.2 Problem Statement

The following J-SALT JT problem statement was developed in coordination with the space community and approved at the January 2018 Joint Warfighter Advisory Group conference.

Space operators at the operational and tactical levels lack the ability to adequately identify and mitigate laser ASAT threats.

1.3 Test Issues

To address this problem, the J-SALT JT will develop TTP that provide procedures to conduct payload susceptibility assessments and development courses of action to mitigate laser ASAT threats while maximizing space-based system availability. The J-SALT problem statement was separated into two supporting test issues representing the operational and tactical level. While

TTP are needed at both levels, the tasks performed at each level are sufficiently different to warrant this separation. The J-SALT test issues are as follows:

Issue 1: Using new procedures, to what extent are space operators at the operational level able to identify and mitigate laser ASAT threats?

Sub-Issue 1.1: Using new procedures, to what extent are space operators at the operational level able to assess payload susceptibility from laser ASAT threats?

Sub-Issue 1.2: Using new procedures, to what extent are space operators at the operational level able to advise tactical level units of laser ASAT threats?

Issue 2: Using new procedures, to what extent are space operators at the tactical level able to identify and mitigate laser ASAT threats?

Sub-Issue 2.1: Using new procedures, to what extent are space operators at the tactical level able to evaluate payload susceptibility from laser ASAT threats?

Sub-Issue 2.2: Using new procedures, to what extent are space operators at the tactical level able to develop acceptable COAs to mitigate laser ASAT threats?

J-SALT JT Project Master Plan 1-4

1.4 Operational Effectiveness Measures

The J-SALT JT will measure operational effectiveness in terms of satellite availability. This is defined as the amount of time a satellite can perform its mission during a single orbit and still remain within acceptable risk levels. Other measures of accuracy, timeliness, completeness, and usefulness will be used to determine the ability of the TTP to support operational and tactical payload susceptibility assessments, unit notifications, and development of COAs to support the mission. Operational effectiveness will be assessed by comparing results using new procedures to results using existing procedures. The complete dendritic structure that provides the test issues, sub-issues, and all associated measures is provided in table C-1.

1.5 Test Limitations and Assumptions

The following sections describe the current test limitations and assumptions.

1.5.1 Test Limitation and Mitigation

The J-SALT JT has identified the following limitation that impacts testing: ATLAS was designed as an “engineering tool.” As such, ATLAS requires certain technical background and experience to run the program to receive valid outputs. This software configuration is not currently designed for operational use (it was not designed for space operators to make inputs and run the assessment). To mitigate this limitation, the J-SALT JT team will maintain two JEWC personnel trained in operating and running ATLAS to provide dedicated response capability for space operators during the joint test. The LAIM TTP will guide space operators on how to use the output from ATLAS for mission planning, and the mechanics of how space operators obtain that output will not impact evaluation of the LAIM TTP.

1.5.2 Test Assumption

The J-SALT JT assumes that ATLAS is valid and provides acceptable payload susceptibility results. This assumption will be validated by reviewing and documenting verification and validation (V&V) or V&V-like activities accomplished by AFRL or other ATLAS users to support JTD accreditation of the tool for use by the J-SALT JT.

J-SALT JT Project Master Plan 2-1

CHAPTER 2 TEST CONCEPT

2.0 Introduction

This chapter introduces the J-SALT test approach, test articles, test events, test support, test design, test schedule, and risk management envisioned for conducting the overall joint test.

2.1 Test…