Bidders Library Operational Test and Evaluation - DISAI 640-195-1.pdf

DEFENSE INFORMATION SYSTEMS AGENCY

P. O. BOX 549

FORT MEADE, MARYLAND 20755-0549

UNCLASSIFIED//FOR OFFICIAL USE ONLY

DISA INSTRUCTION 640-195-1* 20 January 2017

TEST AND EVALUATION

Operational Test Agency (OTA) Mission

1. Purpose. This Instruction prescribes policy and assigns responsibility for the Operational Test Agency (OTA) mission.

2. Applicability. This Instruction applies to all DISA activities.

3. Authority. This Instruction is published in accordance with the authority contained in DoD Directive 5105.19, Defense Information Systems Agency (DISA), 25 July 2006.

4. References.

4.1 DoD Directive 5000.01, The Defense Acquisition System, 12 May 2003.

4.2 DoD Instruction 5000.02, Operation of the Defense Acquisition System, 7 January 2015.

5. Definitions.

5.1 (U/FOUO) Operational Assessment (OA). An evaluation of operational effectiveness and operational suitability made by an independent OTA, with user support as required, on other than production systems. The focus of an OA is based on significant trends noted in developmental efforts, programmatic voids, risk areas, adequacy of requirements, and the ability of the program to support adequate operational testing. An OA may be conducted at any time using technology demonstrators, prototypes, or Engineering Development Models (EDMs), but will not substitute for the initial operational test and evaluation (IOT&E) necessary to support Full Rate Production (FRP) decisions. An OA is normally conducted prior to, or in support of, Milestone C.

5.2 Operational Test Agency (OTA). An organization that plans, directs, coordinates, and controls operational tests (OTs) for DoD agencies, activities, and combatant commands, as well as other Federal organizations. The Army Test and Evaluation Command, Navy Operational Test and Evaluation Force, Air Force Operational Test and Evaluation Center, Marine Corps Operational Test and Evaluation Activity, and Joint Interoperability Test Command (JITC) are OTAs of DoD.

5.3 Operational Test and Evaluation (OT&E). Determines the operational effectiveness, suitability, and security of a system under realistic operational conditions, including combat;

determines if thresholds in the approved Capability Production Document (CPD) and critical operational issues have been satisfied; and assesses impacts to combat operations.

DISAI 640-195-1

6. Policy. (U/FOUO) The Joint Interoperability Test Command (JITC) shall perform the OTA mission, in accordance with DoD Directive 5000.01 and DoD Instruction 5000.02 (reference documents). The JITC will function as an independent tester and evaluator for all DISA-managed programs and projects, unless otherwise directed by the Milestone Decision Authority (MDA) or the Decision Authority (DA) for projects. The JITC is also authorized to serve as OTA for other DoD Services and Agencies and Federal organizations.

The Commander, JITC, will have the option to report the status of DISA ACAT lA programs, as well as any DISA programs on Office of the Secretary of Defense (OSD) oversight, directly to the Director, DISA.

7. Responsibilities for Commander, Joint Interoperability Test Command (JITC).

The Commander, JITC, will:

7.1 (U/FOUO) Serve as the OTA for all DISA programs and projects, unless otherwise determined by the MDA for programs or the DA for projects, and conduct operational test and evaluation (OT&E), in accordance with the reference documents and applicable Director, Operational Test and Evaluation (DOT&E), memoranda. When assigned, JITC will also serve as OTA for other DoD Services and Agencies and Federal organizations.

7.2 (U/FOUO) Formulate procedures for the conduct of OT&E within DISA and approve OT&E plans and reports.

7.3 Coordinate directly with DOT&E and Commanders of Service OTAs, as required, to obtain approval of test plans and other test artifacts for programs on OSD oversight.

7.4 (U/FOUO) Co-chair the Test and Evaluation Working Integrated Product Teams (T&E WIPTs) for all programs for which JITC is designated the lead OTA.

7.5 Provide input to the appropriate sections of the Test and Evaluation Master Plan (TEMP) for all assigned programs.

7.6 (U/FOUO) Approve and/or concur with TEMPs and test plans for programs and projects for which JITC is the OTA.

7.7 Coordinate and advise program developmental test and evaluation (DT&E) components to ensure integrated test planning for early collection of operational test data.

7.8 (U/FOUO) Accredit all models, simulations, and instrumentation for use in OT&E for all programs for which JITC is designated the lead OTA.

7.9 Prepare an Operational Test and Evaluation Plan (OTEP) or an Operational Assessment Plan (OAP) that ensures test and evaluation (T&E) is adequate to determine operational effectiveness, suitability, interoperability, and security (OESIS) for all programs for which JITC is designated the lead OTA.

7.10 (U/FOUO) Integrate joint interoperability certification and cybersecurity testing into Operational Assessment (OAs) and OT&Es, to the extent possible.

7.11 Coordinate development of the OTEP, Operational Test and Evaluation Report (OTER), and other equivalent testing documents with the Program Manager (PM) or Project Leader (PL).

7.12 (U/FOUO) Provide preliminary test data to the PM or PL and, for oversight programs, to DOT&E to the extent the delivery of data does not disrupt, compromise, or otherwise consume resources during ongoing test activities.

7.13 (U/FOUO) Prepare and coordinate an OTER or an Operational Assessment Report (OAR) that reports the adequacy and validity of the test data; provides an audit trail to the supporting data used to arrive at those conclusions; and, in an OTER, develops a conclusion as to OESIS of the capability for all programs for which JITC is designated the lead OTA.

7.14 Organize and chair Operational Test Readiness Reviews (OTRRs) prior to operational test events, unless MDA directs chairmanship elsewhere.

8. Program Manager (PM), Project Leader (PL), Product Manager, and System Manager (SM) Duties. These individuals will:

8.1 Establish and co-chair a T&E WIPT composed of system developers, user representatives, and testers to optimize test expertise, facilities, and instrumentation; integrate test requirements;

and resolve cost, performance, and scheduling problems.

8.2 Notify JITC, in writing, of upcoming programs with OT&E requirements prior to Milestone A.

8.3 Fund all activities associated with the development, execution, and reporting of the required operational testing for their programs.

8.4 Develop and coordinate the TEMP and developmental test plans.

8.5 Ensure all test data on the system or capability is provided to JITC for evaluation and consideration.

8.6 Ensure draft and final Joint Capabilities Integration and Development System (JCIDS) and related documents (i.e., Initial Capability Documents (ICDs), Capability Development Documents (CDDs), Capability Production Documents (CPDs), Information Support Plans (ISPs), Test and Evaluation Mater Plans (TEMPS), and other equivalent requirements and/or testing documents are provided to JITC.

8.7 Participate and support operational testing activities, as necessary, by coordinating and arranging for users, obtaining site participation, providing subject matter expertise, certifying readiness for test at OTRRs, etc.

9. Resources. Costs for operational tests and assessments conducted by JITC will be paid by the program or project. Costs cover all activities associated with operational test and/or assessment planning, execution, analysis and/or evaluation, and reporting.

MARK E. ROSENSTEIN

Colonel, USA Chief of Staff

SUMMARY OF SIGNIFICANT CHANGES. This revision clarifies that the Joint Interoperability Test Command (JITC) performs as the Operational Test Agency (OTA) for other non-DISA organizations. Statements indicating JITC will fund evaluations have been removed.

*This Instruction replaces DISAI 640-195-1, 13 February 2013.

OPR: JT – disa.huachuca.jt.list.taskings-group@mail.mil

DISTRIBUTION: F