Attachment_6_-_JTEProgramHandBook_(02-22-16).pdf

Approved By:

Program Manager

Joint Test and Evaluation

JOINT TEST AND EVALUATION

PROGRAM

HANDBOOK

Revision 8

February 22, 2016

This page intentionally left blank.

JT&E Program Handbook

FOREWORD

The Joint Test and Evaluation (JT&E) Program was instituted to achieve methods for the warfighter to improve mission accomplishment within the constraints of current equipment, organizations, and doctrine. The JT&E Program accomplishes this mission by developing, operationally testing, and evaluating new concepts that address needs and issues in the joint military environment. The JT&E Program consists of two project processes for developing and evaluating products to address warfighter needs: joint test projects and quick reaction test projects.

Department of Defense Instruction 5010.41, Joint Test and Evaluation (JT&E) Program, describes the JT&E Program purpose, identifies the principal participants and their responsibilities, and outlines the framework within which each component or Service supports the JT&E Program. Applicable Service directives describe, in detail, the Service support provided to the JT&E Program.

The proponent of this handbook is the Director, Operational Test and Evaluation (DOT&E), Deputy Director, Air Warfare. The JT&E Program Office reviews and revises this handbook as necessary to address the changing challenges of joint military environments. At a minimum, the handbook is reviewed and revised annually.

Version 8 of the JT&E Program Handbook, including the separately published JT&E Program Style Guide and Standard Operating Procedure for Government Travelers (SOP No. 001-12), replaces all previously issued versions. This version provides the guidance, policy, and general JT&E Program information and procedures to JT&E project Directors, the Services, combatant commands, defense agencies, the Joint Staff, and DOT&E staff relative to the execution of JT&E projects under the JT&E Program.

This version of the handbook incorporates the adjustments and recommendations that have resulted from lessons learned during the past year (2015) as JT&E projects were reviewed, initiated, and completed. The JT&E Program appreciates the time and effort of all those who have provided feedback concerning the current business model and will continue to strive to streamline the process with the goal of improving support to the operational community.

HANDBOOK CHANGE FORM INFORMATION

Please use the Handbook Change Form (as follows) to submit changes for the Joint Test and Evaluation (JT&E) Program Handbook, including its separately published annexes, the JT&E Program Style Guide, and the Standard Operating Procedures for Government Travelers (SOP No. 001-12). Please fill out the Handbook Change Form in its entirety (except JT&E Program Office [JPO] response fields). A change will not be considered without explicit rationale. Upon completion, please send the form to Joy Gibbon, JT&E-Suffolk Technical Advisor, by one of the following methods:

Mail:

JT&E-Suffolk ATTN: Joy Gibbon 7025 Harbour View Blvd.

Suite 105 Suffolk, VA 23435-2762

Facsimile:

757-638-6170

E-Mail:

joy.gibbon.ctr@jte.osd.mil

JPO will revise this handbook on a recurring basis, and approved changes will be included.

HANDBOOK CHANGE FORM

Date Name Organization Contact Telephone No. Contact E-Mail Address

Item

Source (Handbook, Style Guide, and so forth)

Page Para. Comment Rationale JPO Response

JT&E Program Technical Director

Approval Date JT&E Program Manager Approval Date

HANDBOOK CHANGE RECORD

CHANGE RECORD

Revision

No. Date of Revision Requirement for Revision Revision Authority

1 June 29, 2007 Annual review and revision J.H. Thompson

2 December 31, 2008 Annual review and revision J.H. Thompson

3 February 19, 2010 Annual review and revision J.H. Thompson

4 March 31, 2011 Annual review and revision J.H. Thompson

5 April 1, 2013 Annual review and revision;

incorporation of re-engineered business model and processes

J.H. Thompson

6 February 26, 2014 Annual review and revision, and incorporation of revised QRT process J.H. Thompson

7 February 23, 2015 Annual review and revision J.H. Thompson

8 February 22, 2016 Annual review and revision J.H. Thompson

JT&E Program Handbook i

TABLE OF CONTENTS

CHAPTER 1 JOINT TEST AND EVALUATION PROGRAM OVERVIEW .......................... 1-1

1.0 Introduction ............................................................................................................................ 1-1

1.1 Purpose ................................................................................................................................... 1-1

1.2 JT&E Program ....................................................................................................................... 1-1

1.2.1 JT&E Program Office ................................................................................................... 1-2

1.2.2 Joint Test Units ............................................................................................................. 1-6

1.2.3 Federally Funded Research and Development Center .................................................. 1-7

1.3 Sponsor and Operational Endorsers ....................................................................................... 1-9

1.3.1 Sponsor Definition and Responsibilities ....................................................................... 1-9

1.3.2 Operational Endorser Definition and Responsibilities ............................................... 1-10

1.4 JT&E Process ....................................................................................................................... 1-10

1.4.1 JT&E Standing Committees and Boards .................................................................... 1-12

1.4.2 JT&E Contract Support............................................................................................... 1-14

1.4.3 Public Release of Information .................................................................................... 1-14

1.4.4 Foreign Travel ............................................................................................................. 1-15

1.4.5 JT&E Program Outreach ............................................................................................. 1-15

CHAPTER 2 JOINT TEST NOMINATION PROCESS AND JOINT FEASIBILITY

STUDIES ............................................................................................................................... 2-1

2.0 Introduction ............................................................................................................................ 2-1

2.1 Nomination Process ............................................................................................................... 2-1

2.1.1 Nomination Preparation ................................................................................................ 2-2

2.1.2 Appointment of Feasibility Study Director................................................................... 2-2

2.2 Joint Feasibility Study Purpose .............................................................................................. 2-3

2.2.1 Determining if the Proposed Joint Test is Necessary ................................................... 2-3

2.2.2 Determining if the Proposed Joint Test is Feasible and Executable ............................. 2-4

2.3 Joint Feasibility Study Process .............................................................................................. 2-4

2.4 Joint Feasibility Study Immediate Requirements .................................................................. 2-5

2.4.1 Gathering and Reviewing Available Documents .......................................................... 2-5

2.4.2 Establishing the Joint Feasibility Study Coordination Chain ....................................... 2-6

2.4.3 Understanding Joint Feasibility Study Funding ............................................................ 2-6

2.4.4 Determining Joint Feasibility Study Security Requirements ........................................ 2-6

2.5 Establishing and Organizing the Joint Feasibility Study ....................................................... 2-6

2.6 Conducting the Joint Feasibility Study .................................................................................. 2-7

2.6.1 Ensuring the Joint Test is Joint ..................................................................................... 2-7

2.6.2 Refining the Joint Feasibility Study Work Breakdown Structure ................................ 2-8

2.6.3 Developing the Project Master Plan ............................................................................. 2-8

2.7 Reviews and Required Joint Feasibility Study Documentation ........................................... 2-27

2.7.1 Technical Advisory Board Meetings .......................................................................... 2-27

2.7.2 Technical Director Post-TAB Meetings ..................................................................... 2-28

2.7.3 Senior Advisory Council Meetings ............................................................................. 2-28

2.7.4 Required Joint Feasibility Study Documentation ....................................................... 2-28

2.8 Approving and Archiving Documents and Reports ............................................................. 2-30

2.9 Outreach Support ................................................................................................................. 2-30

2.10 Joint Feasibility Study Closedown..................................................................................... 2-30

2.10.1 Contract and Support Agreement Closeout .............................................................. 2-30

JT&E Program Handbook ii

2.10.2 Fiscal Account Closeout ........................................................................................... 2-31 CHAPTER 3 JOINT TESTS ....................................................................................................... 3-1

3.0 Introduction ............................................................................................................................ 3-1

3.1 Establishing and Organizing the Joint Test ........................................................................... 3-1

3.2 Following the Project Master Plan ......................................................................................... 3-2

3.3 Planning and Conducting Test Events ................................................................................... 3-3

3.3.1 Planning a Test Event ................................................................................................... 3-3

3.3.2 Conducting a Test Event ............................................................................................. 3-11

3.4 Conducting Analysis and Evaluation ................................................................................... 3-13

3.4.1 Conducting Analysis ................................................................................................... 3-14

3.4.2 Conducting Evaluation................................................................................................ 3-15

3.5 Identifying Test Products and Test Product Owners ........................................................... 3-15

3.6 Reviews and Required Joint Test Documentation ............................................................... 3-16

3.6.1 JT&E Program Office Reviews .................................................................................. 3-16

3.6.2 Advisory Group Reviews ............................................................................................ 3-19

3.6.3 Required Joint Test Documentation............................................................................ 3-20

3.7 Approving and Archiving Documents, Reports, and Test Products .................................... 3-24

3.8 Outreach Support ................................................................................................................. 3-25

3.9 Joint Test Closedown ........................................................................................................... 3-25

3.9.1 Personnel Departure .................................................................................................... 3-25

3.9.2 Archiving and Destroying Test Data .......................................................................... 3-26

3.9.3 Contract and Support Agreement Closeout ................................................................ 3-26

3.9.4 Fiscal Account Closeout ............................................................................................. 3-26

CHAPTER 4 QUICK REACTION TESTS ................................................................................. 4-1

4.0 Introduction ............................................................................................................................ 4-1

4.1 Normal QRT Process ............................................................................................................. 4-1

4.1.1 Normal QRT Nomination Requirements ...................................................................... 4-1

4.1.2 Normal QRT Nomination Submission.......................................................................... 4-2

4.1.3 Review and Approval Process for a Normal QRT Nomination ................................... 4-2

4.1.4 Planning and Conducting a Normal QRT ..................................................................... 4-5

4.2 Extremely Urgent QRT Process ............................................................................................. 4-6

4.2.1 Extremely Urgent QRT Nomination Requirements ..................................................... 4-6

4.2.2 Extremely Urgent QRT Nomination Submission ......................................................... 4-6

4.2.3 Review and Approval Process for an Extremely Urgent QRT Nomination ................. 4-8

4.2.4 Planning and Conducting an Extremely Urgent QRT .................................................. 4-9

4.3 Test Products .......................................................................................................................... 4-9

4.4 Required Quick Reaction Test Documentation ..................................................................... 4-9

4.4.1 Monthly Report ........................................................................................................... 4-10

4.4.2 Project Plan ................................................................................................................. 4-11

4.4.3 Test Plan...................................................................................................................... 4-11

4.4.4 Detailed Test Plan ....................................................................................................... 4-11

4.4.5 Quick Look Report ..................................................................................................... 4-11

4.4.6 Final Report and Outbrief ........................................................................................... 4-12

4.5 Approving and Archiving Documents, Reports, and Test Products .................................... 4-12

4.6 Contract and Support Agreement Closeout ......................................................................... 4-12

JT&E Program Handbook iii

LIST OF FIGURES

Figure 1-1. JT&E Program Office and Support Locations ......................................................... 1-2 Figure 1-2. Generic Joint Test Unit Supporting JT&E Projects ................................................. 1-7 Figure 1-3. JT&E Project Timelines ......................................................................................... 1-10 Figure 1-4. JT&E Project Process ............................................................................................. 1-11 Figure 2-1. Joint Feasibility Study Milestones ........................................................................... 2-5 Figure 2-2. Typical Joint Feasibility Study Organization ........................................................... 2-7 Figure 2-3. Risk Management Process ..................................................................................... 2-16 Figure 2-4. Example Joint Test Schedule ................................................................................. 2-18 Figure 3-1. Typical Joint Test Organization ............................................................................... 3-2 Figure 4-1. Normal QRT Nomination Review and Approval Process ....................................... 4-4 Figure 4-2. Extremely Urgent QRT Review and Approval Process ........................................... 4-7

LIST OF TABLES

Table 2-1. Types of Measures and Data ................................................................................... 2-11 Table 2-2. Required Joint Feasibility Study Documentation .................................................... 2-29 Table 3-1. Required Joint Test Documentation ........................................................................ 3-20 Table 4-1. Required Quick Reaction Test Documentation ....................................................... 4-10

LIST OF ANNEXES

ANNEX A ACRONYMS AND ABBREVIATIONS ................................................................ A-1 ANNEX B DEFINITIONS OF TERMS......................................................................................B-1 ANNEX C ENVIRONMENTAL CONCERNS ..........................................................................C-1 ANNEX D CONTRACTOR TECHNICAL SUPPORT ............................................................ D-1 ANNEX E GOVERNMENT PERSONNEL ............................................................................... E-1

ANNEX F UTILIZATION OF TRAINING EXERCISES AND DEPARTMENT OF

DEFENSE TEST RANGES AND FACILITIES ................................................................. F-1 ANNEX G LOGISTICS MANAGEMENT ............................................................................... G-1 ANNEX H SECURITY .............................................................................................................. H-1 ANNEX I MODELING AND SIMULATION ............................................................................ I-1 ANNEX J REFERENCES ............................................................................................................ J-1 ANNEX K JOINT TEST AND EVALUATION PROGRAM OUTREACH ............................ K-1

ANNEX L OUTLINES FOR JOINT TEST AND EVALUATION PROJECT

NOMINATIONS AND JOINT FEASIBILITY STUDY REQUIRED

DOCUMENTATION ........................................................................................................... L-1

ANNEX M OUTLINES FOR JOINT TEST REQUIRED DOCUMENTATION ..................... M-1

ANNEX N OUTLINES FOR QUICK REACTION TEST REQUIRED

DOCUMENTATION ......................................................................................................... N-1

JT&E Program Handbook iv

JT&E Program Handbook 1-1

CHAPTER 1 JOINT TEST AND EVALUATION PROGRAM OVERVIEW

1.0 Introduction

The Department of Defense (DOD) Joint Test and Evaluation (JT&E) Program originated in response to the 1970 Blue Ribbon Defense Panel Report, which recommended that continuing responsibility for joint testing be vested in an Office of the Secretary of Defense (OSD) staff element dedicated to test and evaluation (T&E). In December 2002, the JT&E Program was realigned under the Director, Operational Test and Evaluation (DOT&E), who assigned responsibility for the Program to the Deputy Director, Air Warfare (DD,AW). The DD,AW directs the JT&E Program and provides the means to ensure that adequate T&E is accomplished.

The JT&E Program Manager reports to the DD,AW and is responsible for the day-to-day execution of the Program. The DOT&E is the primary source of JT&E Program funding, providing an independent status for the Program and minimizing the influence of Service-specific objectives.

1.1 Purpose

The overarching policies and details of the JT&E Program are set forth in DOD Instruction (DODI) 5010.41, Joint Test and Evaluation (JT&E) Program. The JT&E Program develops potential options for increasing military effectiveness and employs operational test and evaluation techniques for analyzing and validating proposed joint military solutions. The Program complements the acquisition process pursuant to DOD Directive (DODD) 5000.01, The Defense Acquisition System. Specifically, the JT&E Program funds projects that bring two or more military departments or other DOD components together to:

• Assess Service interoperability in joint operations and explore potential solutions to identified problems

• Evaluate joint technical and operational concepts, and recommend improvements

• Validate operational testing methodologies that have joint application

• Improve modeling and simulation (M&S) validity with field exercise data

• Increase joint mission capability, using quantitative data for analysis

• Provide feedback to the acquisition and joint operations communities

• Improve joint tactics, techniques, and procedures (TTP)

A joint test typically uses field testing, as this method allows for testing in realistic operational conditions and, when possible, uses live forces and fielded (or soon to be fielded) systems to provide a high degree of credibility with the evaluation of non-materiel solutions.

1.2 JT&E Program

The JT&E Program administers three types of projects:

• Joint Feasibility Study (JFS). A six-month study to determine the operational necessity and technical feasibility of a proposed joint test. A JFS may culminate in a chartered joint test.

• Joint Test. A test project lasting up to two years in duration and designed to provide solutions to joint operational problems.

• Quick Reaction Test (QRT). A test project lasting up to 12 months in duration and designed to address a joint warfighter critical operational need. The JT&E Program defines a joint warfighter critical operational need as:

ο A high-priority, emergent shortfall identified from ongoing or recent military operations.

JT&E Program Handbook 1-2 ο A high-priority, emergent shortfall based on the results of a field assessment, operational testing, or information gained from joint lessons learned.

ο An identified TTP shortfall resulting from the rapid fielding of a capability in response to a joint urgent operational need (JUON).

1.2.1 JT&E Program Office

The JT&E Program Office (JPO) provides overall management and guidance for the execution of all JT&E Program activities. Management of the JT&E Program includes oversight beginning from the call for nominations letter through test execution and final test product transition. The JT&E Program Manager is supported by government and contractor personnel at four locations. Figure 1-1 depicts JPO support by location with government positions indicated in bold purple font and contractor positions indicated in black font.

Figure 1-1. JT&E Program Office and Support Locations

The JT&E Chief of Staff (CoS) is the JPO staff lead for developing, coordinating, and implementing JT&E policies and procedures. The CoS provides continuity of operations on behalf of the JT&E Program Manager. The JT&E Program Technical Director provides technical observations and recommendations to the JT&E Program Manager and guidance to the JT&E projects concerning technical standards and methodologies.

The JT&E Deputy Program Manager provides budgeting and contracting support to all JT&E projects and serves as the Contracting Officer’s Representative (COR) for all JT&E contracts. The Vicksburg location is the finance and contracting office for the JT&E Program.

The JT&E-Suffolk Director is responsible for the overall operations and management of JT&E-Suffolk and serves as the Director for the joint test unit (JTU) located in Suffolk (JTU-

JT&E Program Handbook 1-3

Suffolk). The JT&E-Suffolk Deputy Director provides the daily management of JT&E- Suffolk. The Deputy Director also serves as the JT&E Program QRT Director, and, as such, provides overall management of the QRT program. The JT&E Action Officers, Technical Advisors, and Joint Test Support Cell (JTSC) provide technical review and programmatic assistance for all nominations and JT&E projects, as well as technical support to all JFS and joint test projects. The JTSC also conducts training for nomination preparation and independently reviews all QRT and joint test nominations for compliance with JPO standards. The specific duties of the JT&E Action Officers, Technical Advisors, and JTSC are contained in sections 1.2.1.1 through 1.2.1.3.

The QRT Coordinator is the primary support for the JT&E Program QRT Director in the performance of day-to-day execution, management, and oversight of QRT projects. In some instances, JT&E Action Officers provide this support.

1.2.1.1 JT&E Action Officers

The JT&E Program Manager assigns a JT&E Action Officer to each JFS and joint test project to facilitate JPO assistance and oversight, and to serve as the primary point of contact (POC) for JPO. The primary roles of the JT&E Action Officer are dependent upon the type of JT&E project supported, as detailed in the following paragraphs.

JT&E Action Officer duties pertaining to a JFS:

• Drafts the JFS directive letter

• Serves as the lead JPO representative to liaison with and provide oversight of assigned JFS

• Serves as the primary POC for all coordination of support by the JTSC with the

Feasibility Study Director (FSD), and mentors the FSD on the JT&E Program and associated JFS processes

• Identifies and coordinates resolution of emerging issues with the FSD to ensure JT&E Program standards (for example, quality and deadlines) are maintained

• Maintains ongoing coordination with the Technical Advisor for technical support and guidance

• Coordinates with the JT&E Program Technical Director on the use of Federally Funded Research and Development Center (FFRDC) Representatives

• Provides the JT&E Program Technical Director with feedback on assigned FFRDC support

• Updates the JT&E-Suffolk Director on the status of the JFS ο Collaborates with the JTSC Team Lead for work breakdown structure (WBS) updates, and briefs the status of the JFS during weekly staff meetings ο Advises of any significant issues or problems that are of concern ο Provides feedback on JFS readiness for Technical Advisory Board (TAB) meetings, Senior Advisory Council (SAC) meetings, and the project master plan (PMP) and consolidated resource estimate (CRE) Red Team meeting

• Serves as the primary POC for coordination of the performance work statement (PWS), evaluation criteria, quality assurance surveillance plan (QASP), and independent government estimate (IGE) for JFS contractor support

JT&E Program Handbook 1-4

• Works closely with the JT&E-Suffolk Resource Manager and the JT&E Program business office and contracting office to update and disseminate the PWS shell to the

JFS

• Coordinates JFS requirements with external agencies as required (for example, Joint Staff J7, Air Land Sea Application Center, and so forth)

• Coordinates with Service Liaison Officers (LNO) for Service support requirements and submission of support requests

• Provides the FSD with previous JFS and joint test lessons learned reports (LLR) and examples of historical JFS and joint test documents and briefings

• Participates in and advises the JFS to help prepare for working group, Joint Warfighter Advisory Group (JWAG), TAB, and SAC meetings

• Reviews JFS monthly reports, and provides a synopsis of the reports to JPO

• Coordinates document reviews and advises the JFS team during development of the

PMP, CRE, LLR, joint feasibility study report (JFSR), and joint test PWS package;

keeps JPO apprised of document status

• Serves as a member of the technical evaluation team for JFS contract award

• Drafts the joint test charter letter

JT&E Action Officer duties pertaining to a joint test:

• Serves as the lead JPO representative to liaison with and support the joint test

• Maintains frequent contact with and advises the Joint Test Director (JTD), and joint test Technical Director

• Ensures the joint test team is knowledgeable of current JPO policies

• Coordinates with the JTD to schedule and conduct joint test training

• Coordinates with cognizant organizations (for example, the Services, Joint Staff, combatant commands [CCMD], OSD, and so forth) to finalize the PMP drafted during the JFS

• Serves as the primary POC for coordination of the PWS, evaluation criteria, QASP, and IGE for joint test contractor support

• Reviews, assesses, and coordinates all documentation (risk reduction plans [RRP], detailed test plans [DTP], closedown and transition plan [CTP], after action reports [AAR], quick look reports [QLR], LLR, and final report) during the joint test

• Coordinates for and participates in JPO in-progress reviews (IPR), coordinates for a JPO pre-brief before travel, documents meeting results, and takes necessary action to address issues and track outstanding actions as directed by JPO

• Coordinates with the Technical Advisor and FFRDC Representative to schedule and participate in test event technical reviews (TETR) and post-test technical reviews

(PTTR)

• Attends and observes JWAG meetings, risk reduction events (RRE), and test events

• Reviews joint test monthly reports, and provides a synopsis of the reports to JPO

• Coordinates with the Joint Staff for:

ο Meetings with and briefings to the Joint Staff ο Joint training events ο Doctrine, organization, training, materiel, leadership and education, personnel, and facilities (DOTMLPF) inputs

JT&E Program Handbook 1-5

• Maintains frequent contact with the assigned FFRDC Representative to ensure awareness of all scheduled events

• Coordinates with the JT&E Program Technical Director and the Technical Advisor for FFRDC Representative’s participation in joint test events

• Coordinates and forwards to DOT&E for review and approval any official joint test project information intended for public release

1.2.1.2 Technical Advisors

The JT&E Program Manager assigns a Technical Advisor to each JFS and joint test project to support the JT&E Program Technical Director in providing technical consultation and advice for the design, development, planning, and implementation of these projects in the areas of test concept, test design, test measures, and analysis techniques. The primary roles of a Technical Advisor are dependent upon the type of JT&E project supported, as detailed in the following paragraphs.

Technical Advisor duties pertaining to a JFS:

• Provides ongoing support to the JT&E Action Officer to guide the JFS execution process

• Provides technical guidance to the JFS team

• Participates in JFS working group meetings to provide technical guidance to the FSD on the problem statement, issues, measures, test concept, and TAB preparation

• Reviews the PMP and CRE to validate test limitations and assumptions, test concept and scenarios, required test resources, and M&S usage

• Provides the JT&E Program Technical Director with feedback on assigned FFRDC support

Technical Advisor duties pertaining to a joint test:

• Provides support to the JT&E Action Officer and JTSC Team Lead to schedule and participate in joint test training

• Reviews joint test documentation for technical compliance

• Provides technical advice to the JTD and/or joint test Technical Director

• Keeps the JT&E Program Technical Director apprised of joint test technical status

• Provides support for scheduling and conducting TETRs and PTTRs

• Observes JWAG meetings, RREs, and test events in coordination with the JT&E

Action Officer

• Provides a technical summary to the JT&E Program Technical Director one week prior to scheduled IPRs, and participates in IPRs when requested

• Maintains frequent contact with the joint test Technical Director, and provides feedback to the JT&E Program Technical Director, JT&E Action Officer, and FFRDC Representative

1.2.1.3 Joint Test Support Cell

JPO established the JTSC to provide a “quick start” capability for a JFS. A JFS historically starts with limited T&E experience and has a steep learning curve. The primary goal of the JTSC, staffed by a core group of full-time technical and operational test experts, is to educate, train, and assist the JFS staff. The JTSC, in close coordination

JT&E Program Handbook 1-6 with the JT&E Action Officer and Technical Advisor, assists and advises the FSD on the JT&E programmatic and technical aspects of conducting a JFS and designing a feasible joint test. The primary roles of the JTSC are dependent upon the type of JT&E project supported, as detailed in the following paragraphs.

In concert with the JT&E Action Officer, JTSC duties pertaining to a JFS:

• Provides an initial WBS to the FSD, and assists in developing executable plans of action and milestones

• Organizes and conducts weekly JFS meetings with the FSD and JT&E Action Officer

• Provides the FSD with support in problem decomposition, issue refinement, scoping, test concept, and required resources

• Develops the first draft of the PMP and CRE, and assists with review and modification of additional drafts

• Assists the FSD in identifying appropriate test venues and test tools

• Provides JFS training

• Assists the FSD on all programmatic aspects associated with startup and execution of a JFS, such as developing TAB and SAC briefs

• Provides coordination and facilitation for working group and JWAG meetings

• Assesses the effectiveness of JTSC support and training through lessons learned and feedback

• Assists in the transition from JFS to chartered joint test

JTSC duties pertaining to a joint test:

• Works with the JT&E Action Officer to provide the JTD with a WBS that reflects joint test activities and events laid out in the PMP

• Provides a Test Planner and Operations Research/Systems Analyst (ORSA) for the first six months of the joint test to provide continuity and assist the JTD in developing the test article, RRP, and/or DTP, and in planning for JWAG meetings and other joint test activities

• Coordinates with the JT&E Action Officer to schedule and conduct joint test training

1.2.2 Joint Test Units

A JTU is an organization established by the Services, in partnership with DOT&E and JT&E project sponsors, for project development and execution. The basic mission of a JTU is to provide DOT&E the capability to conduct joint tests that resolve high priority warfighter issues and problems. The basic functions of a JTU are to host JT&E projects, provide technical and programmatic assistance for nominations, provide closedown and transition assistance, support implementation and integration of joint test products and solutions, and provide facilities, infrastructure, and administrative support. Specifically, this support includes providing all administrative equipment, office furniture, office equipment, expendable office supplies, and security requirements for JT&E projects housed at the JTU location. This support also includes providing the COR and Resource Manager for JT&E projects housed at the JTU location. The JTU locations include Suffolk, Virginia; Aberdeen Proving Ground, Maryland; and Nellis Air Force Base, Nevada. JPO identifies the JTU location of JFS and joint test projects in the joint test call for nominations letter at the start of each cycle.

JT&E Program Handbook 1-7

1.2.2.1 Organizational Management of Joint Test Units and JT&E Projects Each JTU manages its facility and permanent staff. Responsibility for oversight of JFS and joint test projects remains with JPO. Likewise, operational test agencies (OTA) continue to manage all QRT projects. JTDs and Test Directors for QRT projects lead and manage their test teams, including military and government personnel assigned to the JT&E project by the hosting JTU. As illustrated in figure 1-2, the JTU Director and the JTU Deputy Director and/or Technical Director manage execution of JT&E projects in partnership with DOT&E, CCMDs, and Services; provide technical and programmatic oversight in the generation and development of new JT&E nominations; and provide overall management and oversight of all permanent staff.

Figure 1-2. Generic Joint Test Unit Supporting JT&E Projects

1.2.2.2 Personnel Organization within a Joint Test Unit

Service military and government civilian personnel support JT&E projects located at JTUs and are integral to the JTU staff. Locating joint tests at JTUs provides a continuity of effort to reduce infrastructure support costs and the time required to build joint test teams, and it creates stability in military assignments.

1.2.2.3 Organizational Support for JT&E Projects from a Joint Test Unit JTUs are staffed in partnership with the Services, who provide the core members of the JTU. These core members consist of government civilians, officers, non-commissioned officers, and contractor personnel.

1.2.3 Federally Funded Research and Development Center

JPO employs MITRE FFRDC support to provide independent assessments and analytical support for JT&E projects. The JT&E Technical Director, in coordination with the FFRDC lead, assigns a specific FFRDC Representative to each DOT&E-directed JFS and DOT&E-

JT&E Program Handbook 1-8 chartered joint test. The JT&E Program Technical Director may also assign FFRDC subject matter experts (SME), on a case-by-case basis, at the request of the JT&E Action Officer assigned to a JFS. FFRDC Representative duties are dependent upon the type of JT&E project supported, as detailed in the following paragraphs.

FFRDC Representative SME support to a JFS:

• Provides project-specific SME support to the JT&E Action Officer. The JT&E Action

Officer requests this support through the JT&E Program Technical Director.

• Participates in JFS activities, such as attendance at the JWAG and other operationally relevant meetings, as requested by the JT&E Action Officer. Provides internal feedback regarding these activities to the JT&E Program Technical Director and JT&E Action Officer in the form of a written assessment within five working days of the event.

• Notifies the JT&E Program Technical Director and JT&E Action Officer when technical issues are identified.

FFRDC Representative technical support to a JFS:

• Serves as a T&E analyst providing advice in developing a feasible test concept.

• Participates in JFS activities, such as attendance at working group, JWAG, TAB, and technical exchange meetings, as requested by the JT&E Action Officer. Provides internal feedback regarding these activities to the JT&E Action Officer in the form of a written assessment within five working days of the event.

• Notifies the JT&E Program Technical Director and the JT&E Action Officer when potential issues arise.

• Reviews and makes technical comments on the PMP. This review should consider such aspects as suitability of the test concept, proposed venue, and the identification of project risks. The FFRDC Representative provides this review to the JT&E Action Officer and Technical Advisor.

• Attends TAB meetings as requested by the JT&E Action Officer.

FFRDC Representative technical support to a joint test:

• Participates in various test activities in coordination with the JT&E Program Technical

Director and JT&E Action Officer. These activities may include attendance at JWAG meetings, RREs, technical exchange meetings, TETRs, test events, and PTTRs. Provides internal feedback regarding these activities to the JT&E Program Technical Director and JT&E Action Officer in the form of a written assessment within five working days of the event.

• Reviews and makes technical comments on test documentation and associated briefing materials. The FFRDC Representative should consider suitability of the test concept and proposed venue and the identification of project risks during these reviews. The FFRDC Representative provides this assessment directly to the JT&E Program Technical Director and JT&E Action Officer.

• Notifies the JT&E Program Technical Director and JT&E Action Officer whenever potential issues or problems are identified.

• Provides technical assistance with the development of DTPs and final reports when requested. Acts as a technical resource when highly technical issues arise that require

JT&E Program Handbook 1-9 expertise not resident within the joint test team. The JTD requests this support through the JT&E Action Officer.

1.3 Sponsor and Operational Endorsers

This section defines the terms “sponsor” and “operational endorser” with regard to the JT&E Program, and provides guidelines and responsibilities for sponsorship and operational endorsement of JT&E projects. The DD,AW assigns responsibility for conducting a JFS, joint test, or QRT project to a sponsor through the JFS or QRT directive letter or joint test charter letter. These letters also identify organizations considered operational endorsers of the JT&E project. The following sections define these terms and describe the responsibilities of each in support of each type of JT&E project.

1.3.1 Sponsor Definition and Responsibilities

A sponsor is an organization that provides the necessary director and SME personnel for a JT&E project as specified in the directive or charter letter. The responsibilities of the sponsor vary depending on the type of JT&E project supported, as detailed in the following paragraphs.

Sponsor responsibilities for a JFS project:

• Provides a full-time FSD in the military pay grade of O-5 or O-6 (or a General Schedule

[GS] equivalent with prior approval of the DD,AW).

• Identifies and provides access to SMEs during the JFS to assist in understanding the nature of the problem and developing the test concept.

• Provides the facilities, resources, and administrative support for all JFS personnel at the sponsor’s location or site other than the hosting JTU.

Sponsor responsibilities for a joint test project:

• Provides a full-time JTD in the military pay grade of O-6 (or a GS equivalent with prior approval of the DD,AW). The JTD may be located at the sponsor location or at the JTU hosting the joint test.

• Provides the facilities, resources, and administrative support for the duration of the joint test for all joint test personnel at the sponsor’s location or site other than the JTU.

• Provides a Technical Director (Test Engineer or ORSA). The Technical Director may be located at the JTU hosting the joint test or, with prior JPO approval, at the sponsor’s location.

Sponsor responsibilities for a QRT project:

• Designates a Test Director in the military pay grade of O-5 or O-6 (or GS equivalent) responsible for leading and executing the QRT.

• Provides necessary SMEs and operational level guidance to support the QRT team in enabling successful conduct of the QRT project, testing product development, and finalizing test product transition.

• Submits the project plan within 30 working days after directed as a QRT.

• Submits the test plan within 20 working days after task award, but no later than 20 working days before the first test event.

• Advises JPO of issues that affect QRT execution.

JT&E Program Handbook 1-10

• Provides internally developed final test plans and reports to JPO.

• Provides JPO with a copy of all final test products.

1.3.2 Operational Endorser Definition and Responsibilities

An operational endorser is an organization that has interest in a JT&E project and provides specific capabilities (such as test assets or exercise venues) for JT&E project activities.

Operational endorsement of a JT&E project also commits that organization to providing the specific capabilities needed to support the JT&E project.

1.4 JT&E Process

The JT&E project cycle begins with a call for nominations letter that JPO sends to the CCMDs, Services, and other DOD agencies. Nominating agencies develop and refine their nominations and forward them to JPO per the instructions contained in the letter. The process follows one of two paths, depending on whether the nomination is for a joint test or a QRT. Twice each year, JPO conducts joint test and QRT nomination training with a focus on nomination package development. Figure 1-3 illustrates the JT&E process timelines for joint test and QRT projects.

Figure 1-3. JT&E Project Timelines

Figure 1-4 provides an overview of the process for submitting and executing JT&E projects. For joint tests, a six-month JFS is accomplished prior to joint test charter. The joint test call for nominations letter starts the cyclical process that is repeated twice each year. The specific due

May

Normal QRT Nomination

Normal QRT

Quick Reaction Test

= Call for Nominations = QRT Working Group = Planning Committee

= JPO Review = Electronic TAB & TAB

= SAC

= Executive Steering Group = DD,AW Approval = Joint Test = QRT

QRT Call for Nominations e

Jan May Jan MaySep SepSep

Joint Test Nomination

JFS

Joint Test

Joint Test Joint Test Call for Nominations e

Jan May Jan MaySep SepSep

Jan Jan MaySep SepSep e

Extremely Urgent QRT Nomination

Extremely Urgent

QRT

Jan May Jan MaySep SepSep

JT&E Program Handbook 1-11 date for the nomination packages to arrive at JPO is stated in each letter, but may be anticipated to occur in May and November each year. The Planning Committee meets in February and August each year to review the joint test nominations and forward recommendations to the SAC.

If the SAC directs a joint test nomination to proceed, then a six-month JFS is conducted. During this six-month period, the JFS develops the PMP and begins development of the test article. The TAB then assesses the technical feasibility and execution risk of the proposed joint test. The JFS then proceeds to the SAC for a joint test chartering decision. Upon charter, the joint test completes development of the test article, conducts tests, and transitions test products. Chapter 2 contains specific information for the joint test nomination and JFS process. Chapter 3 provides information on the joint test execution process.

Figure 1-4. JT&E Project Process

There are two types of QRT project nominations, normal and extremely urgent. For normal QRT nominations, the QRT call for nominations letter starts the cyclical process that is repeated three times each year. The specific due date for the nomination packages to arrive at JPO is specified in each letter, but may be anticipated to occur in April, August, and December each year. The QRT Working Group will meet in person each February and virtually in May and September to consider each normal QRT nomination and recommend which nominations to forward to the Executive Steering Group (ESG) based on JPO criteria and warfighter necessity.

The ESG then electronically reviews and prioritizes the normal QRT nominations. The ESG recommends to the DD,AW which normal QRT nominations to direct as QRT projects. The conduct of a QRT is very similar to a joint test, except the assigned OTA provides technical

Results

Results

Senior Advisory Council (SAC):

Prioritizes

Senior Advisory Council (SAC):

Prioritizes

Joint Test

Sponsor provides Director, SME support, and facilities for personnel not located at JTU

JTU provides government personnel, facilities, and O&M support

DOT&E provides dollars for test specific support including contractor support

Planning Committee:

Initial Prioritization

Exec Steering Group:

Prioritizes

Normal Quick Reaction Test

Joint Feasibility

Study

Nominations from Services, CCMDs, Joint

Staff, and other DOD Agencies

QRT Working Group:

Initial Prioritization

Technical Advisory Board Assesses Feasibility and

Execution Risk

QRT Program Director

Initial Coordination

DD,AW

Review and Approval

Extremely Urgent Quick Reaction

Test

Up to 2 years

6 months

Up to 12 months

Up to 6 months

Results

Interim Products

JT&E Program Handbook 1-12 oversight to support test planning, conduct, and reporting. Nominating agencies may submit extremely urgent QRT nominations that address a joint warfighter critical and time-sensitive operational need at any time. The JT&E Program defines time-sensitive as the operational need for the test product to be developed, tested, evaluated, and transitioned to the warfighter within six months. All extremely urgent QRT projects will be planned and executed by the JT&E Program QRT Director at the JT&E-Suffolk facility. Chapter 4 provides details on the normal and extremely urgent QRT nomination and execution processes.

1.4.1 JT&E Standing Committees and Boards

JT&E projects undergo reviews at designated milestones as they proceed through the JFS, joint test, and QRT processes. These reviews have three purposes: 1) to ensure the project can yield valid results, 2) to ensure the project uses valid and accepted test methodologies, and 3) to ensure the project expends DOT&E and Service resources wisely. Various standing committees and boards conduct these reviews.

JT&E standing committees and boards consist of senior military and civilian leaders from various DOD components. DOD components also sponsor, endorse, and/or nominate JT&E projects. The possibility of a conflict of interest exists when a voting member’s component has a nomination under consideration. To mitigate this conflict of interest, the voting member’s staff section cannot sponsor a nomination. However, the voting member’s higher command or another staff section may sponsor the nomination. The nomination cannot be briefed by a current voting member or by staff officers assigned to the voting member.

Additionally, representation on JT&E voting boards is limited to government personnel exclusively. If an organization is unable to provide a government representative to a specific meeting, the organization may provide their voting desires to JPO in advance of the meeting.

In this case, a contractor representative may represent the organization on the board to convey the organization’s opinions, but cannot vote during the meeting. The following sections provide more information on the JT&E standing committees and boards.

1.4.1.1 Planning Committee

The Planning Committee consists of representatives from JPO, the Services, Joint Staff, CCMDs, and selected DOD agencies.