AFLCMC_Det_3_OI_99-108_21_July_2015.pdf

BY ORDER OF THE COMMANDER AFLCMC DET 3 INSTRUCTION

DETACHMENT 3, AFLCMC Operation Instruction 99-108

Test and Evaluation

21 July 2015

FLIGHT TEST PERSONNEL TRAINING AND EVALUATION

COMPLIANCE WITH THIS PUBLICATION IS MANDATORY

OPR: AFLCMC Det 3, Chief of Test Certified by: AFLCMC Det 3/CC

Pages: 39

SUMMARY OF REVISIONS

This is the initial release of the AFLCMC Det 3 test personnel training and evaluation process. It reflects the latest requirements that apply to Test Directors operating within the AFLCMC Det 3.

1. Scope. This instruction specifies the minimum training requirements and qualification standards for personnel conducting flight and ground testing. This instruction applies to all essential test personnel (military, government civilian, and contractor) which are defined as flight test engineers and test directors. It applies to Detachment 3 regardless of the operating location.

1.1. References:

1.1.1. AFLCMC Det 3 Instruction 99-103 Test and Evaluation Process

1.1.2. ASCI 99-103, Test and Evaluation Management

1.1.3. AFFTCI 99-105, Test Control and Conduct

1.1.4. AFFTC Instruction 99-8, Flight Test Control Room Personnel Training and Evaluation

1.1.5. AFRL 711 HPW/RHDO Special Report, Edwards Precision Impact Range Area (PIRA) Certification for the Safe Use of Lasers, Edwards AFB, CA

1.1.6. AFLCMC/WII DET3 OI 11-15, Planning and Scheduling Procedures for Flight Test

1.1.7. AFI 99-103, Test and Evaluation Capabilities-based Test and Evaluation

1.1.8. FAA 7711-1 2012-WSA-92 COA Final AFLCMC (MQ-1)

1.1.9. FAA 7711-1 2012-WSA-94 COA Final AFLCMC (MQ-9)

1.1.10. AFI 91-204, Safety Investigations and Reports

1.1.11. AFI 91-202 AFMC Sup, USAF Mishap Prevention Program

1.1.12. ASI-03938, Flight and Ground Operations Procedures

1.1.13. AFMCPD 99-1, Test Management

1.1.14. AFFTCI 99-101, Test Plans

1.1.15. T.O. 00-35D-54 USAF Deficiency Reporting, Investigation, and Resolution

1.1.16. 703 AESG/DET 3 OI, Modification Process

1.1.17. AFLCMC/WII DET3 OI 11-15 , Planning and Scheduling Procedures for Flight Test

1.1.18. ZEUS 2.0 User Manual

1.1.19. Electronic Flight Bag (FCIF 13-026): electronic file of range procedures and aircraft flight manuals

2. Background. The primary purpose of this OI is to define the training requirements for the test director (TD) position, who is the primary test control and conduct focal point. The TD may be government military or civilian, government support contractor, or prime contractor. The TD position is primarily filled from the assigned Det 3 government flight test engineer (FTE) positions or from the General Atomics – Systems Tests & Qualification (GA-ST&Q) FTE positions. TD’s may also be qualified project aircrew. The training provisions of this OI also apply to newly assigned government FTE’s.

T h e t r a i n i n g curriculum for government and contractor test director trainees will be different based on organizational structure, but final evaluation criteria will be the same for both trainee types. The training and qualifications of test personnel from other test organizations temporarily maybe accepted with the concurrence of the commander. Test director instructors performing test director evaluations are primarily government representatives, but maybe a commander-approved contractor that has a high level of training experience. The level of training can be tailored for specific trainees based on their background, level of experience and demonstrated abilities with proficiencies progression dictated by an approved TD instructor. Final approval/designation, and continued designation as a TD is at the discretion of the Det 3 CC.

The Ground Control Station (GCS) can be defined as the primary control room and cockpit. The aircrew and test director, with assigned support engineers, are located in this facility. The GCS provides two-way communications with the aircrew and real time capability to monitor safety of flight and safety of test information. Essential control room personnel are determined by the test director. This includes personnel that occupy a position in the control room on a routine basis or whose presence is required by an operating instruction, test plan, or safety plan. This instruction does not apply to others that may be present in a control room on an infrequent basis and whose duties do not involve safety of flight. Examples of these personnel are project/system engineers, scribes, technical publication/documentation engineers, and subject matter experts.

3. Responsibilities. AFLCMC DET3 was designated as the Responsible Test Organization (RTO) for ground and flight test operations under their control. The primary Det 3 training responsibilities are as follows:

3.1. AFLCMC, Detachment 3 Commander. The Det 3 CC will: 1) Ensure an appropriate Test Director training process is in place. 2) Approve/designate TD trainees as AFLCMC Det 3 Test Directors.

3.2. AFLCMC, Operating Location – Detachment 3 Commander. The OL-Det 3 CC will: 1) Monitor the Test Director training process and requirements.

3.3. Chief of Test. The Chief of Test (CT) or delegated personnel will: 1) Manage the training process. 2) Recommend qualified candidates to be approved/designated as Test Directors. 3) Identify the TD personnel resources required to execute the unit’s test and evaluation responsibilities. 4) Maintain an approved list of qualified AFLCMC Det 3 Test Directors.

3.4. Test Director (TD). Each TD will: 1) Adhere to the requirements of this process to maintain TD qualifications and mentor TD trainees.

3.5. Test Director Trainee. Each TD trainee will: 1) Adhere to the requirements of this process to progress toward the goal of becoming TD qualified.

3.6. Test Director Instructor (TD-I). Each TD-I will: 1) Adhere to the requirements of this process to maintain TD-I qualifications.

3.7. Government Flight Test Engineer (FTE). Each FTE will: 1) Adhere to the requirements of this process to maintain qualifications.

3.8. GA-ST&Q Flight Test Engineer. Each ST&Q engineer will: 1) Adhere to the requirements of this process to maintain qualifications with respect to the applicable government contract.

4. Test Personnel Training Process. The training process is comprised of several training paths that can culminate with the approval/designation of specific personnel as qualified AFLCMC Det 3 Test Directors.

The paths are defined as the training path for a government FTE and the training path for a ST&Q FTE.

GA-ASI ST&Q has an established company test engineer training curriculum that leads to the test director selection and evaluation phase. The following web tools and training requirements outline the knowledge that government FTE should possess to move forward into TD training and evaluation.

4.1. Government Flight Test Engineer. Specific resources and knowledge requirements to accomplish specific Det 3 test related tasks and test director qualifications.

4.1.1. Web Site Access Requirements

4.1.1.1. GA-ASI VPN: Document Center, DevTrk, SCM Portal, Share Point

4.1.1.2. JDRS: Discrepancy Report (DR)

4.1.1.3. 412th TW/SET Share Point: Military/Government Civilians only, safety package reference material

4.1.1.4. Det 3 S Drive (Share Drive)

4.1.1.5. Medium Altitude UAS Division Share Point Drive

4.1.2. Training Requirements

4.1.2.1. MQ-1 or MQ-9 Concept of operations

4.1.2.1.1. Utilize Det 3 aircrew ground academics to develop systems knowledge of aircraft systems, ground control station interface and data links provide through established new aircrew training program.

4.1.2.1.2. Utilized GA-ASI system academics for in-depth engine and avionics systems knowledge.

4.1.2.2. GA-ASI Software Configuration Management

4.1.2.2.1. Develop an understanding of the GA-ASI software development structure, configuration control, software change request (SCR) and test observation item (TOI) process, and release process.

4.1.2.3. Crew Resource Management (CRM)

4.1.2.3.1. Attend the 412th TW/OG or a USAF-accredited course.

4.1.2.4. Primary Safety Lead (PSL).

4.1.2.4.1. PSL training provides basic safety package development instruction. PSL training is provided by the 412th TW/SET and is required for safety documentation that is submitted to 412th TW.

4.1.2.5. Operations with Airspace and Range Resources

4.1.2.5.1. Familiarization with ZUES system to develop airspace utilization and safety awareness. ZUES user handbook provides airspace awareness tools for displaying air traffic on multifunction workstation (MFW) displays.

4.1.2.5.2. Familiarization with R-2508 Complex including R-2515, R-2505, and R-2524 airspace and range resources. Understanding of resources scheduling processes through the Center Scheduling Enterprise (CSE) process.

4.1.2.6. Unit Test Safety Officer (UTSO).

4.1.2.6.1. Senior level experience responsible for individual safety reviews and administration of safety packages.

4.1.2.6.2. Specifically applicable to safety packages subject to 412th TW safety review.

4.1.2.6.3. 412th TW/SET training course and UTSO approval.

4.1.2.7. Predator Mission Aircrew Training System (PMATS).

4.1.2.7.1. Aircrew training flight simulator to facilitate system knowledge, safety procedures, and test card development.

4.1.2.8. Data Logger Files/Signal Plotter/Falcon View.

4.1.2.8.1. Familiarization with data analysis tools and data logger recorded parameters to accomplish post flight analysis of test results.

4.1.2.9. AFTC Test Plan Workshop.

4.1.2.9.1. Test plan development and review guide.

4.1.2.10. Depot Modification.

4.1.2.10.1. Familiarization with T-2 aircraft and ground control station modification process.

Provide reviews, flight test entries, and approval of T-2 forms. Track modifications for configuration control and test compatibility.

4.1.2.11. Discrepancy Reports (DRs) and Watch Items.

4.2. Test Director Special Qualifications. Additional qualification requirements are based on test plan test objectives, technical and safety review boards reviews, and test director training. The special qualifications are listed below with specific knowledge requirements.

4.2.1. Elevated technical/safety risk

4.2.1.1. Based on technical review board (TRB) or a safety review board (SRB) assigned medium or high technical or safety risk. Will normally be assigned to an experienced TD with detailed knowledge of the system-under-test (SUT) and part of the test project team, rationale for risk assignment, and detailed understanding of the assigned general minimizing procedures (GMPs)and test hazard analysis (THA). May require specialized or new systems training.

4.2.2. Performance and flying qualities (PF&Q)

4.2.2.1. High speed data logger operation.

4.2.2.2. Software “tweekers” operation.

4.2.2.3. Aero performance including flying/handling qualities, flutter, high angle of attack, loads, performance, flight envelope, structural drag, and vibration.

4.2.2.4. WINDAQ parameters monitoring system.

4.2.3. Weapons

4.2.3.1. China Lake control room familiarization.

4.2.3.2. Weapons type theory of operation, guidance parameters, and safety foot prints.

4.2.3.3. Laser operations.

4.2.4. Test Director – Instructor

4.2.4.1. Based on experience and instruction abilities.

4.3. ST&Q Flight Test Engineer. The GA-ASI test training curriculum provides specific training for contractor engineers to enter into the TD evaluation phase. Contractors are responsible for safety package compliance and flight briefing, but not safety package preparation.

4.4. Required Reading. Test personnel shall have a working knowledge of a broad range of subjects to conduct safe, effective, and efficient test programs. This reading encompasses test guidance, safety guidance, flight operations procedures, range procedures and geographic locations, and aircraft systems operation and limitations. The references listed in paragraph 1.1 are defined as required reading and trainees are responsible to become familiar with the material.

4.5. Training Flights. A series of instructional and check ride evaluations leading approval of TD status and qualifications. Specific training syllabus and evaluation forms are in Appendix A.

4.5.1. Observation Flights. Observation flights are the initial formal evaluations of a TD trainee participating in a test flight by observing the test flow. This will normally be a series of five (5) flights. A qualified TD is required for test execution and will provide mentoring through each observation instruction step. The training objectives are listed in the Observation Flight Training Syllabus and trainee performance is documented in the Observation Flight Training Grade Sheet.

The successful culmination of the Observation flights will be a recommendation from a qualified TD that the trainee is ready to participate in Ride-along flights. That determination will be documented on the trainee’s TD Qualification Training Form

4.5.2. Ride-along Flights. Ride-along flights are the next stage to provide TD trainees a hands-on environment to assume test execution responsibilities for a complete test flight. This will normally be a series of five (5) flights. A qualified TD is required to monitor test execution and provide guidance as necessary. The training objectives are listed in the Ride-along Flight Training Syllabus and trainee performance is documented in the Ride-along Flight Training Grade Sheet. The successful culmination of the Ride-along flights will be a recommendation from a qualified TD that the trainee is ready to move to final evaluation phase.

4.5.3. Solo Flights. Solo flights are the final evaluation phase in which the trainee shall execute the entire test flight process with evaluation by a test director instructor, but without instruction assistance. This will normally be a series of five (5) flights. The training objectives are listed in the Solo Flight Training Syllabus and trainee performance is documented in the Solo Flight Training Grade Sheet. The successful completion of will be submission of the completed TD Training form for Det 3 commander’s approval and addition to the TD Letter of X’s.

5. Qualification Records.

5.1. Letter of X’s for commander’s approval letter of all TD’s and respective qualifications.

5.2. Det 3 TD Training Form. Complete training form for each TD with individual completion dates and commander’s approval.

5.3. Evaluation grade sheets. Individual evaluations sheets signed by the instructor for each training event.

APPROVED:

Lt. Col. Christopher Childress

AFLCMC DET 3, Commander

Attachments:

1. Appendix A: Training Syllabus and Evaluation Forms

2. Appendix B: Guidelines for Grade Sheets

3. Appendix C: Letter of X’s Example

APPENDIX A: Training Syllabus and Evaluation Forms

Description Number Of Flights

Page Number

AFLCMC/WII Det 3 TD Training Form

15 9

AFLCMC/WII Det 3 TD Training Form – Elevated Risk

3 10

AFLCMC/WII Det 3 TD Training Form – Weapons

4 11

AFLCMC/WII Det 3 TD Training Form – TD Instructor

3 12

Test Director Observation Flight Training Syllabus

5 13

Test Director Observation Flight Training Grade Sheet

N/A 14

Test Director Ride-Along Flight Training Syllabus

5 15

Test Director Trainee Ride-Along Flight Training Grade Sheet

N/A 16

Test Director Trainee Solo Flight Training Syllabus

5 17

Test Director Trainee Solo Flight Training Grade Sheet

N/A 19

Test Director Elevated Risk Solo Flight Syllabus

3 20

Test Director Elevated Risk Solo Flight Grade Sheet

N/A 22

Test Director Weapons Training Syllabus

4 23

Test Director Trainee Weapons Flight Training Grade Sheet

N/A 25

Test Director Instructor Trainee Flight Training Grade Sheet

3 26

Test Director PF&Q Flight Training Syllabus

N/A 28

Test Director Trainee PF&Q Flight Training Grade Sheet

N/A 29

FTE Flight Training Syllabus

N/A 32

Test Director Training Form AFLCMC DET 3 TD Training Form, 21 July 2015

TEST DIRECTOR TRAINING PAGE OF PAGES

TRAINEE NAME RANK/GRADE TYPE TRAINING

Initial/Requal

TRAINING ITEMS Student Date Trainer Date

REQUIRED TRAINING

1. Test Director Qualification Briefing / Training Form Issue – TD Instructor/CoT

2. Test & Evaluation Briefing – TD Instructor/CoT

3. Required Reading - Self Study

4. Recommended Reading - Self Study

5. Crew Resource Management (CRM) Initial Course – Certified Provider

6. Test Director Qualification Rides

Observation #1 – Qualified TD

Observation #2 – Qualified TD

Observation #3 – Qualified TD

Observation #4 – Qualified TD

Observation #5 – Qualified TD

Ride-Along #1 – Qualified TD

Ride-Along #2 – Qualified TD

Ride-Along #3 – Qualified TD

Ride-Along #4 – Qualified TD

Ride-Along #5 – Qualified TD

Solo #1 – Qualified TD

Solo #2 – Qualified TD

Solo #3 – Qualified TD/Instructor TD

Solo #4 – Qualified TD/ Instructor TD

Solo #5 – Qualified TD/ Instructor TD

7. Special Qualifications

Instructor – TD Instructor

Weapons Test – TD Instructor

Elevated Risk – TD Instructor

Chief of Test – Chief of Test

8. Comments/Recommendation

TRAINEE’S SIGNATURE DATE INSTRUCTOR’S SIGNATURE DATE

TRAINEE’S SUPERVISOR DATE AFLCMC/WII DET 3 CC DATE

Elevated Risk TD Training Form AFLCMC DET 3 TD Training Form, 21 July 2015

TEST DIRECTOR TRAINING – ELEVATED RISK PAGE OF PAGES

TRAINING ITEMS

REQUIRED TRAINING CoT Initial

Chief of Test Concurrence to Begin Training Student Date Trainer Date

1. Special Qualifications

Solo #1 Elevated Risk – Elevated Risk Qualified TD

Solo #2 Elevated Risk – Elevated Risk Qualified TD

Solo #3 Elevated Risk – USAF TD Instructor

8. Comments/Recommendation

Weapons Test Director Training Form AFLCMC DET 3 TD Training Form, 21 July 2015

TEST DIRECTOR TRAINING – WEAPONS PAGE OF PAGES

REQUIRED TRAINING CoT Initial

Chief of Test Concurrence to Begin Training Student Date Trainer Date

1. Special Qualifications

Weapons Test Note: 2 gravity releases and 2 forward- firing employments required. At least 1 flight observed from Range Control Center. A minimum of 2 live-ordinance deployments must be performed.

Solo #1 - Weapons Qualified TD Check all that apply: Live Ordinance RCC Gravity Forward-firing

Solo #2 - Weapons Qualified TD

Solo #3 – Weapons Qualified TD

Solo #4 – Weapons Qualified USAF TD Instructor

USAF Test Director Instructor Training Form AFLCMC DET 3 TD Training Form, 21 July 2015

TEST DIRECTOR TRAINING – USAF TD INSTRUCTOR PAGE OF PAGES

REQUIRED TRAINING CoT Initial

Chief of Test Concurrence to Begin Training Student Date Trainer Date

1. Special Qualifications – USAF Instructor TD

Instructor Solo #1 – USAF TD Instructor

Instructor Solo #2 – USAF TD Instructor

Instructor Solo #3 – USAF TD Instructor

Test Director Observation Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

OBSERVATION FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all that apply

Description Type

Flight Test Facility Operations Discussion

Maintenance Coordinators, Technicians, Mechanics, Documentation, Quality Assurance Discussion Handout

Configuration Sheets Handout/Link Demonstration

Flight Test Card Preparation Discussion

Test Binder Creation Test Plan Test Plan Safety Review Software Version Matrix Configuration Sheet

Discussion/Link

Flight test briefing overview Mission brief Mission debrief Professionalism Customer Relations and Corporate Image

Discussion

GCS Communication System Configuring the CAP system Call Signs Communication Procedures

Discussion Handout

OJT

Software

Watch Items and Test Impacts Known Anomalies list

Discussion Handout

Launch, Recovery, and Test Conduct Airspace and controlling agencies Frequency Management Pilot checklists and timing

Discussion

MQ-9 and MQ-1 Certificate of Agreement (COA) Instrument Flight Rules (IFR) Visual Flight Rules (VFR) Weather impacts

Test Observations and Issues Significant Events Documentation Test Reporting

Discussion

Crew and Resource Management Conduct within GCS Identification of Stakeholders/Subject Matter Experts Data capture and workload management Test Discipline and efficiency

Discussion

Quicklook Generation and Test Reporting Identification of Stake Holders Standard Distribution Lists Customer Notification

Discussion/Link

Test Director Observation Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

TRAINEE INSTRUCTOR DATE

SYLLABUS NUMBER

FLIGHT TEST CONDUCTED UAV TYPE SOFTWARE

RE-FLY INCOMPLETE PASS PROFICEINCY PROGRESS

Below x2 Below x1 Average

Above x1

Above x2

Not Attempted

1. Professionalism (timeliness, attentiveness, cell phone usage )

2. Active team member

MISSION PREPARATION

3. Mission Planning (Observe and Support)

4. Test Card Prep (Observe and Support)

5. Test and support schedule (Observe and Support)

6. Mission Briefing (Observe and Support)

MISSION CONDUCT

7. Checklists (Observe and follow along)

8. Test Cards (Observe and follow along)

9. Flight Operations (Observe and knowledgeable)

10. CRM

11. GCS Communications (Flight ops communication discipline)

12. Situational Awareness

13. Airspace/Range Awareness

14. Emergency Procedures (Knowledge of role and Support if required)

POST-MISSION

15. Debrief

16. Post-Test Report

Feedback: (Required for areas of Exceptional Performance and Deficient Skills)

Test Director Ride-Along Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

RIDE-ALONG FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Flight Test Preparation Test Binder (TP, TPSR, SVM, WITs) Configuration Sheet Flight Test Card Prep (Copies and Currency) Pilot in Command coordination

Discussion/OJT

Flight Test Briefing (active participation) Professionalism Mission Flow and Conduct Data collection plan

Discussion/Briefing Guide Handout and

Additional test points Red Lines Additions Approval process o Prior to flight o During flight

Launch, Recovery, and Test Conduct

Pilot checklists and timing Data collection

Identification Document Understanding test impact (Safety versus Enhancement) Continue or abort

Conduct within GCS Test Discipline and efficiency

Debriefing Leading/Flow Determining if all data was collected Identifying issues and Watch Items Understanding issue severity Collecting additional data Assigning post test tasking

Quicklook Generation and Test Reporting Understanding Feedback process Recognize schedule and time demand for information Transposing issues (Technical writing)

Discussion/Hand out and examples

Test Director Ride-Along Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Below x1 Average

Above x1

Above x2

Not Attempted

17. Professionalism (timeliness, attentiveness, cell phone usage )

18. Active team member

MISSION PREPARATION

19. Mission Planning

20. Test Card Prep

21. Test and support schedule

22. Mission Briefing

MISSION CONDUCT

23. Checklists (Observe and follow along)

24. Test Cards (Observe and Execute)

25. Flight Operations (Observe and knowledgeable)

26. CRM

27. GCS Communications (Flight ops communication discipline)

28. Situational Awareness

29. Airspace/Range Awareness

30. Emergency Procedures (Knowledge of role and Support if required)

POST-MISSION

31. Debrief

32. Post-Test Report

Test Director Solo Flight Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

SOLO FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Mission Planning Test assets coordinated via config sheet 48 hours prior to flight and aircraft is in correct configuration Test objectives flow from one to the next in an efficient and logical manner

Test Card Preparation Test deck contains all required signatures Test deck dates are current Copies of test deck bear “original” stamp from original test deck Copies are made for Aircrew and Subject Matter Experts Test cards are ordered in sequence of completion All aircrew-independent red-lined items are captured prior to flight test brief

Test and Support Schedule

Subject matter experts are identified as key personnel prior to briefing All support staff notified to be present 10 minutes prior to flight test briefing

Mission Briefing Test Binder created containing o Applicable Safety Packages with GMP’s marked for quick reference o Signed test plan with applicable section marked for quick reference o Software version matrix for software in use

Conduct brief smoothly and informatively o Demonstrate knowledge of mission objectives and individual test points without reading test cards verbatim o Cover all areas of test administration

Call signs, phone numbers, test frequencies Mission card Run Cards

Initial conditions Test boundaries/tolerances Exit/success criteria

GCS/UAV Configuration General Minimizing Procedures Test Hazards, if applicable Go/No Go Criteria Crew & Resource Management Communications Plan o Knowledgeable of applicable Watch Items and impact on testing o Knowledgeable of impact of General Minimizing Procedures on test conduct

Conveyed a credible, knowledgeable, and confident presence concerning test objectives and mission conduct

Test Card Execution Re-brief initial conditions, allowing pilot to confirm, prior to starting test card Confirm all initial conditions are within tolerance prior to executing individual test points Use standard test language during test execution indicating clear test progression o “Start Run”, “End Run”, “Test Point Complete”, “Test Card Complete”, “Recover”, “Repeat Test Point”, etc.

Ground Control Station Communications Aware of roles and responsibilities of controlling agencies during ground and flight o Aircraft Crew Chief o Chase Aircraft o Big Bear, Tower, Joshua, SPORT, China Control

SOLO FLIGHT TRAINING OBJECTIVES

Situational Awareness Execute mission in a timely & efficient manner Request status of ground and flight crew when idle Progress testing toward completion at all times Coordinate timing of test points to coincide with airspace considerations Apply GMP’s and THA’s to safely execute test within confines of test safety package Cross-communicate current test point or configuration to keep aircrew abreast of plan of execution

Airspace/Range Awareness

Coordinate timing of test point execution to coincide with airspace considerations

Place “Critical Phase of Flight” placards on doors to indicate launch and recover operations Discourage excessive conversation/distraction during flight testing Prohibit Pilot distraction during critical phases of flight

Emergency Procedures

Decision making is appropriate and contributes to the safe and timely resolution of the emergency, or recovery of the aircraft

Debrief Discuss all aspects of test activities o Completed test points or test objectives o Aircraft or GCS issues encountered on test, as well as pilot inputs and investigation action items o Unexpected test results or behavior o Crew and Resource Management o Lessons learned o Test objectives for follow-on flight testing, if applicable

Test Director Solo Flight Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Below x1 Average

Above x1

Above x2

Not Attempted

33. Professionalism (timeliness, attentiveness, cell phone usage )

34. Active team member MISSION PREPARATION (Execute and Task Delegate)

35. Mission Planning

36. Test Card Prep

37. Test and support schedule

38. Mission Briefing

MISSION CONDUCT

39. Test Cards (Execute and Task Delegate)

40. Flight Operations

41. CRM

42. GCS Communications

43. Situational Awareness

44. Airspace/Range Awareness

45. Emergency Procedures (Knowledge of role and Support if required)

POST-MISSION

46. Debrief (Execute and Task Delegate)

47. Post-Test Report (Execute)

Elevated Risk Flight Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

ELEVATED RISK FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Elevated Risk Process Knowledge Test Kickoff – 10 Days Test Plan Development – 30 Days Test Plan Working Group (if applicable) – 20 Days TRB/SRB – 20 Days o Action items delegated/closed within 20 day period Test Readiness Review – 5 Days o Medium Risk Test/Safety Plan Approval – SQ or GP/CC o High Risk Test/Safety Plan Approval – Wing/CC

Test deck submitted & approved 1 week prior to flight T-1 Brief scheduled with aircrew 48 hours prior to flight

Test assets coordinated via config sheet 48 hours prior to flight and aircraft is in correct configuration Test objectives flow from one to the next in an efficient, logical, and safe manner Visual aids offered to aircrew when required to clarify intent of mission and requested airspace/flight profiles Define clear roles and responsibilities for all aircrew and assign taskers for data monitoring for safety of flight parameters if applicable o Medium Risk – Det 3/CC o High Risk – SQ or GP/CC

Test deck dates are current All tolerances and limits clarified and explained as requested/applicable during T-1 brief

T-1 Mission Briefing Conducted 1 day prior to flight test (T-1 Briefing) GMP’s are clarified by Chief Safety Officer or UTSO prior to brief if unclear, THA’s are briefed verbatim Knock-it-off criteria is clearly defined during flight test brief Contingencies in the event of unexpected test events are clearly defined Demonstrates clear understanding of test objectives and success criteria Tolerances & Limits are explained clearly when required by aircrew

Flight Test Brief Conditions for the day are captured from Motherhood briefing o Weather, airspace, traffic, test resource readiness Contingencies are available if daily conditions prevent test order execution as briefed during T-1 Communications plan clearly defined with contingencies available o Callsigns, roles, and expected timing clearly defined

Confirm all initial conditions are within tolerance prior to executing individual test points “Knock-it-off” or “End Run” is used to clearly define flow o “Knock-it-off” used for safety of flight issues or unexpected test events that require

RTB

o “End Run, Recover” used to repeat test points if tolerances are not met for the maneuver

ELEVATED RISK FLIGHT TRAINING OBJECTIVES

o Aircraft Crew Chief o Chase Aircraft o Big Bear, Tower, Joshua, SPORT, DOWNFALL, China Control, Alpha

Request status of ground and flight crew when idle Progress testing toward completion at all times Apply GMP’s and THA’s to safely execute test within confines of test safety package Cross-communicate current test point or configuration to keep aircrew abreast of plan of

Project frequencies/authorizations are verified prior to flight

Place “Critical Phase of Flight” placards on doors to indicate launch and recovery operations Discourage excessive conversation/distraction during flight testing Prohibit Pilot distraction during critical phases of flight Instances of idle aircrew are kept to a minimum Applicable VITs, WinDaq parameters, or other test monitors are observed for tolerances and safety parameters o Completed test points or test objectives o Aircraft or GCS issues encountered on test, as well as pilot inputs and investigation action items o Unexpected test results or behavior o Crew and Resource Management o Lessons learned

Post-Test Reporting Quick-look generated captured flight test results and applicable debrief items o Completed test points and/or test objectives identified o Appropriate personnel/organizations notified of unexpected test results and behavior so action can be taken

Elevated Risk Flight Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Below x1 Average

Above x1

Above x2

Not Attempted

Professionalism (timeliness, attentiveness, cell phone usage )

Active team member

1. Elevated Risk Process Knowledge MISSION PREPARATION (Execute and Task Delegate)

2. Mission Planning

3. Test Card Prep

4. Test and support schedule

5. T-1 Mission Briefing

6. Flight Test Brief

MISSION CONDUCT

7. Test Cards (Execute and Task Delegate)

8. Flight Operations

9. CRM

10. GCS Communications

11. Situational Awareness

12. Airspace/Range Awareness

13. Emergency Procedures (Knowledge of role and Support if required)

POST-MISSION

14. Debrief (Execute and Task Delegate)

15. Post-Test Report (Execute)

Weapons Flight Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

WEAPONS FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Gravity Release: Guided Bomb Unit Available munitions o Laser Guided (GBU-12, GBU-16) o GPS Guided (GBU-38 JDAM) o Dual Mode (GBU-49 eGBU 54 Laser-JDAM, GBU-48)

FMU-152 Joint Programmable Fuze (JPF)

Discussion, Demonstrated understanding

Forward Firing: Air to Ground Missile

AGM-114 Hellfire (All Variants) Griffin B

Discussion, Gravity Release: Special Projects Vendor Supplied Pylons Safe Separation & Deployment Vendor-supplied controls and interface equipment

Discussion, Suspension Equipment Bomb Rack Unit (BRU) o BRU-15 o BRU-71

M299 (Single and Dual rail configuration) Griffin Smart Launcher (GSL)

Discussion, Stores Management Systems Aircrew interfaces o Validation and Setup o Weapon Setup

Fuzes (Arm Time, Function Delay, HOB) Targets o Weapon Health Monitoring o Emergency functionality

Crypto Key usage and procedures Common Weapons Library

Discussion, Tech Orders TO: -34 Non-Nuclear Munitions Delivery MQ-1 specific checklists Avenger specific checklists

Discussion, Demonstrated

Process Knowledge (Meetings, Reviews, Documentation, SME Interactions)

Weapons Test Planning Strategy [Test Kick Off Briefing] Interface with Project Engineers Test planning [TPWG] o Requirements, Test Objectives and Goals o Shot matrix o Documentation plan (Test Plan, MFR, Amendment)

Weapons Test Preparation Documentation Draft o Shot Matrix o Test Plan o Test Cards (Supplemental Target Pack) o NAWCWD Range inputs (Safety Zone Plot, Targets)

Approval authorities

Decisionals and Approvals Test Kick off (Strategy meeting)

TPWG

TRB/SRB

Test Readiness Review Firing Readiness Review (NAWCWD) Range Hazard maps

WEAPONS FLIGHT TRAINING OBJECTIVES

Weapons Test Execution

Flight – Captive Carry System objectives o All objectives up too release/launch Test administrative objectives o Procedures o Practice o Test equipment val/ver (Telemetry, Glite, SES Bus recorder, high speed cameras)

Brief and Debrief the flight Comsec usage Guest / Non-test aircrew interaction

Flight – Live Fire CALA / LOLA operations o CONOPS o Ordnance preflight o Arming procedures (Loaders, EOR checks) o Launch and recovery restrictions (Airfield specific)

Free fall ordnance Forward firing ordnance

Test Admin o Telemetry, G-LITE, SES Bus recorder, High speed cameras o Range restrictions

Air space limitations Launch Envelope (Range Plots) o Execution window o Launch, re-arm, re-fuel, re-attack

Brief and debrief the flight Live Fire Execution o Normal procedures (Checklists) o Normal indications

GSMS, WEZ, LAR, WFP (Display setup) Avenger o Laser versus GPS guided munitions o Tactical employment

Buddy Lase Self Lase

Post fire o Aircraft Maneuvers o Laser versus GPS guide o Tracking tools and impact observation

Abnormal procedures o Abnormal indications o Emergency or abnormal Checklists o Unexploded ordnance (DUD) o Hung store

RTB

o With remaining ordnance o Winchester

Flight – Multi-Ship tactical employment THA/GMP/GMC usage Tactics Development SME support for safe execution Tactics o Buddy Lase (Shooter Laser roles, Goalie Options) o Self Lase

Weapons Flight Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Program Type & Role (Check all that apply)

Live Ordinance RCC Observation Gravity Release Forward-firing

Below x1 Average

Above x1

Above x2

Not Attempted

Professionalism (timeliness, attentiveness, cell phone usage )

Team Leadership

Support Boards and Reviews (TRB/SRB/TRR/FRR) MISSION PREPARATION (Execute and Task Delegate)

1. Mission Planning

2. Test Card Prep

3. Test and support schedule

4. T-1 Mission Briefing

5. Flight Test Brief

MISSION CONDUCT

6. Checklists (Observe and follow along)

7. Test Cards (Execute and Task Delegate)

8. Flight Operations

9. CRM

10. GCS Communications

11. Situational Awareness

12. Airspace/Range Awareness

13. Emergency Procedures (Knowledge of role and Support if required)

POST-MISSION

14. Debrief (Execute and Task Delegate)

15. Post-Test Report (Execute)

USAF Instructor Flight Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

USAF INSTRUCTOR TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Instructor Observation of a TD-I trainee monitoring the mission conduct of a TD trainee Instructional and training abilities Timely corrective action and guidance Oversight of TD trainee accomplishing the TD syllabus

Test assets coordinated via configuration sheet 48 hours prior to flight and aircraft is in correct configuration Test objectives flow from one to the next in an efficient and logical manner

Test deck dates are current Copies of test deck bear “original” stamp from original test deck Copies are made for Aircrew and Subject Matter Experts Test cards are ordered in sequence of completion

Applicable Safety Packages with GMP’s marked for quick reference Signed test plan with applicable section marked for quick reference Software version matrix for software in use Conduct brief smoothly and informatively Demonstrate knowledge of mission objectives and individual test points without reading test cards verbatim Cover all areas of test administration Call signs, phone numbers, test frequencies Mission card Run Cards Initial conditions Test boundaries/tolerances Exit/success criteria GCS/UAV Configuration General Minimizing Procedures Test Hazards, if applicable Go/No Go Criteria Crew & Resource Management Communications Plan Knowledgeable of applicable Watch Items and impact on testing Knowledgeable of impact of General Minimizing Procedures on test conduct Conveyed a credible, knowledgeable, and confident presence concerning test objectives and

Confirm all initial conditions are within tolerance prior to executing individual test points Use standard test language during test execution indicating clear test progression “Start Run”, “End Run”, “Test Point Complete”, “Test Card Complete”, “Recover”, “Repeat

Test Point”, etc.

USAF INSTRUCTOR TRAINING OBJECTIVES

Aircraft Crew Chief Chase Aircraft Big Bear, Tower, Joshua, SPORT, China Control

Request status of ground and flight crew when idle Progress testing toward completion at all times Coordinate timing of test points to coincide with airspace considerations Apply GMP’s and THA’s to safely execute test within confines of test safety package Cross-communicate current test point or configuration to keep aircrew abreast of plan of

Discourage excessive conversation/distraction during flight testing

Completed test points or test objectives Aircraft or GCS issues encountered on test, as well as pilot inputs and investigation action items Unexpected test results or behavior Crew and Resource Management Lessons learned Test objectives for follow-on flight testing, if applicable

Completed test points and/or test objectives identified Appropriate personnel/organizations notified of unexpected test results and behavior so action can be taken

USAF Instructor Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Below x1 Average

Above x1

Above x2

Not Attempted

INSTRUCTION POINTS - KNOWLEDGE

1. Mission Preparation

2. Mission Conduct

3. Post-Mission

4. Test Planning (Kickoff/TRB/SRB/TRR)

INSTRUCTION POINTS - STYLE

1. Instinctive vs. Directive

2. Detailed vs. General

3. Positive Feedback

4. Corrective Feedback

INSTRUCTION POINTS - TRAITS

1. Assertiveness/Leadership Skills

2. CRM/Cooperation

3. Preparedness

4. Decision Making

5. Situational Awareness

6. Conflict of Interest

7. Chain of Command Notifications

8. Professionalism

9. Teamwork

PF&Q Flight Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

PF&Q FLIGHT TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Test assets coordinated via configuration sheet 48 hours prior to flight and aircraft is in correct configuration Test objectives flow from one to the next in an efficient and logical manner Performance and Flying Qualities Tests o Pitot Static o Drag Index o Cruise performance o Climb performance o Control systems o Longitudinal static stability o Longitudinal maneuvering stability o Lateral directional stability o Stall o High angle of attack (AOA) o Takeoff and landing o Closed loop handling qualities o Aerostatic o Flutter o Vibration

Test deck dates are current Copies of test deck bear “original” stamp from original test deck Copies are made for Aircrew and Subject Matter Experts Test cards are ordered in sequence of completion o Applicable Safety Packages with GMP/THA o Signed test plan with applicable section marked for quick reference o Software version matrix for software in use

Conduct brief smoothly and informatively o Demonstrate knowledge of mission objectives and individual test points without reading test cards verbatim o Cover all areas of test administration

Call signs, phone numbers, test frequencies Mission card Run Cards

Initial conditions Test boundaries/tolerances Exit/success criteria

GCS/UAV Configuration General Minimizing Procedures Test Hazards, if applicable Go/No Go Criteria Crew & Resource Management Communications Plan o Knowledgeable of applicable Watch Items and impact on testing o Knowledgeable of impact of General Minimizing Procedures on test conduct

Conveyed a credible, knowledgeable, and confident presence concerning test objectives and

Confirm all initial conditions are within tolerance prior to executing individual test points Use standard test language during test execution indicating clear test progression o “Start Run”, “End Run”, “Test Point Complete”, “Test Card Complete”, “Recover”, “Repeat Test Point”, etc.

o Aircraft Crew Chief o Chase Aircraft o Big Bear, Tower, Joshua, SPORT, China Control

Request status of ground and flight crew when idle Progress testing toward completion at all times Coordinate timing of test points to coincide with airspace considerations Apply GMP’s and THA’s to safely execute test within confines of test safety package Cross-communicate current test point or configuration to keep aircrew abreast of plan of

Coordinate timing of test point execution to coincide with airspace considerations Demonstration

Discourage excessive conversation/distraction during flight testing o Completed test points or test objectives o Aircraft or GCS issues encountered on test, as well as pilot inputs and investigation action items o Unexpected test results or behavior o Crew and Resource Management o Lessons learned o Completed test points and/or test objectives identified o Data analysis of data logger files o Appropriate personnel/organizations notified of unexpected test results and behavior so action can be taken

PF&Q Flight Grade Sheet AFLCMC DET 3 TD Training Form, 21 July 2015

SYLLABUS NUMBER

Below x1 Average

Above x1

Above x2

Not Attempted

1. Professionalism

2. Active Team Member

3. PF&Q and Elevated Risk Process Knowledge

MISSION PREPARATION

1. Mission Planning

2. Test Card Preparation

3. Test Support and Schedule

4. T-1 Mission Briefing

5. Flight Test Brief

6. Applicable Safety Package(s)

MISSION CONDUCT

7. Test Cards (Execute and Task Delegate)

8. GCS Communications

9. Situational Awareness

10. Airspace/Range Awareness

11. CRM

12. Emergency Procedures (Knowledgeable)

POST MISSION

13. Debrief (Execute and Task Delegate)

14. Post-Test report (Execute)

AFLCMC DET-3 FTE Syllabus AFLCMC DET 3 TD Training Form, 21 July 2015

AFLCMC/WII DET-3 TRAINING OBJECTIVES

TRAINEE: INSTRUCTOR: DATE:

Check all

Flight Test Facility Operations Maintenance Coordinators Technicians Mechanics Integration Documentation Quality Assurance

FOD

Configuration Sheets Big Bear

GA-ASI VPN

Access Document Center DevTrk SCM Portal Share Point/Conjunction Drive

GA-ASI Software Software structure o CSCI o CSC

Configuration control SCRs TOIs

SVM

SVD

Form 217 ICD Equivalency Matrix Third Party Software

T-2 modification Approvals Flight test entries Posting Tracking

COOL

FCIF

Schedules Report generation Links

EAFB Weather Balloon data

Share Point & Share (S) Drive

Organization Posting

AFLCMC/WII DET-3 TRAINING OBJECTIVES

MQ-1 and MQ-9 theory of operations Flight manuals Ground academics Aircraft o Engine o Avionics

GCS

o Intercom

Data links o Ku o C band o Frequency approvals

Payloads o Frequency approvals

Weapons

PMATS

MQ-9 and MQ-1 FAA Certificate of Agreement (COA) Instrument Flight Rules (IFR) Visual Flight Rules (VFR) Weather impacts o DD Form 175-1 Zeus

Crew and Resource Management Class

Test overview Test concept kickoff

TPWG

Specifications o Software Requirements Specification (SRS) o Hardware specification/requirements

Test plan o Test objective o MOP o Evaluation criteria o Success criteria o Test points

Technical review board (TRB) o Technical risk

Test cards

PMATS

Test readiness review (TRR) Mission brief Mission debrief Reporting

Test Safety

TPSR

AFFTCI 91-105

o AFFTC 5028 o Det 3 Interface o SET o PSL training o UTSO responsibilities o Safety review board (SRB)

Significant Events Documentation Test Reporting Watch Items and Test Impacts JDRS – DRs SCR/TOI investigation

APPENDIX B: Guideline for Grade Sheets

General Guidance:

Above x 2: Exemplary performance well above expectations of a qualified Test Director. Multiple instances of this rating may warrant proficiency progression to next phase of certification.

Above x 1: Qualified as a test director in this area.

Average: Marginally qualified, needs practice but can operate as a test director at current capacity.

Below x 1: Marginally unqualified, need more experience/training.

Below x 2: Grossly unqualified, needs review of required materials and mentoring before next reattempt at evaluation. Multiple instances of this rating during the same flight may warrant reattempt of flight.

1.0 Mission Preparation

1. Mission Planning

Above x 1: Aware of all aspects of test logistics

a. Test assets were coordinated via configuration sheet 24 hours prior to mission

b. Test objectives flowed from one to the next in an efficient and logical manner

Below x 1: Was not aware or did not coordinate above items

a. Aircraft was in incorrect configuration

b. Test objectives were not organized, resulted in wasted test time

2. Test Card Preparation

Above x 1: Ensured flight test deck is valid and ready for testing

a. Test deck contained valid signatures from required approving stakeholders

b. Test deck dates were current

c. Copies of test deck bear “original” stamp from original test deck

d. Copies were made for aircrew and support staff

e. Test cards were ordered in sequence of completion

f. All aircrew-independent red-lined items were captured prior to flight test brief

Below x 1: Was not aware or did not coordinate above items

a. Test deck lacked signatures

b. Test deck had expired

c. Missing “original” stamp

d. Test cards were not in order of execution

3. Test and support schedule

Above x 1: Ensured all support staff are aware of scheduled brief, flight, and land times

a. Subject matter experts are identified as key personnel prior to briefing

b. All support staff present at flight test briefing location 10 minutes prior to brief.

Below x 1: Required subject matter experts or support staff not present during flight test brief.

4. Mission Briefing

Above x 1: Demonstrated qualities indicative of prior research, test preparation, and organization

a. Test Binder created containing:

i. Applicable test safety packages with GMP’s marked for quick reference

ii. Signed test plan with applicable section marked for quick reference

iii. Aircraft Configuration sheet

iv. Software version matrix for software in use

b. Conducted brief smoothly and informatively

i. Demonstrated knowledge of mission objectives and individual test points without reading test cards verbatim

ii. Covered all areas of test administration

1. Call signs, phone numbers, test frequencies

2. Mission Card

3. Run Cards

a. Initial conditions

b. Test boundaries/tolerances

c. Exit/success criteria

4. GCS/UAV Configuration

5. General Minimizing Procedures

6. Test Hazards, if applicable

7. Go/No Go Criteria

8. Crew & Resource Management

9. Communications plan

iii. Knowledgeable of applicable Watch Items and impact on testing

iv. Knowledgeable of impact of General Minimizing Procedures on test conduct

c. Conveyed a credible, knowledgeable, and confident presence concerning test objectives and mission conduct.

Below x 1: Did not display one or more of the above attributes, or lacked required materials

a. Test binder not created, or was disorganized

b. Could not expand on mission objectives when more information was requested during question and answer by aircrew

c. Lacked knowledge of GMP’s or WIT’s impact on test conduct

d. Sections of test administration skipped/omitted

e. Clear entry/exit criteria not presented for run cards

2.0 Mission Conduct

1. Test Card Execution

Above x 1: Demonstrated all of the following:

a. Re-briefed initial conditions, allowing pilot to confirm, and prior to starting test card.

b. Confirmed all initial conditions were within tolerance prior to execution of individual test points.

c. Used standard test language during test execution indicating clear test progression

i. “Start Run”, “End Run”, “Test Point Complete”, “Test Card Complete”, “Recover”, “Repeat Test Point”, etc.

d. Recorded values, or allocated aircrew, required for test documentation.

Below x 1: Ineffective test conduct attributed to:

a. Vague/ineffective communication of test objectives or required maneuvers.

b. Operated outside of test data band due to lack of confirmation of initial conditions.

c. Required values missed due to inattention or compressed workload.

d. Repeated test points or incomplete test cards as a direct result of poor test execution or efficiency errors.

2. Ground Control Station Communications

Above x 1: Knowledgeable of ground and flight communications within the GCS as it applied to flight test execution

a. Aware of roles and responsibilities of controlling agencies during ground and flight

i. Aircraft crew chief

ii. Chase aircraft

iii. Big Bear, Tower, Joshua, SPORT, China Control

b. Kept radio synchronized with aircrew to prevent stepping on controlling agencies.

c. Maintained communication with ground crews (if applicable)

i. Status updates/queries when 15 minutes have lapsed since last transmission

d. Communications over ICS were politically-correct and profanity-free.

e. Communications over ICS were as clear and concise as possible to cut down radio chatter.

Below x 1: Was not aware or did not observe one or any of the above

a. Radio not synchronized with pilot resulting in missed controlling agency call.

b. Situational awareness lost between aircrew and ground operations.

c. Verbose radio calls: employed 10 words when 3 would have sufficed.

d. Inappropriate/offensive material discussed during flight test.

3. Situational Awareness

Above x 1: Demonstrated a driving force in test preventing the occurrence lost test time or repeat test points

a. Executed mission in a timely & efficient manner.

b. Requested status of ground and…