PWS_Attachment_(1)_737_TRG_Supp_1_AETCI_36-2640.pdf

DEPARTMENT OF THE AIR FORCE 737 TRG SUPPLEMENT 1

737th Training Group (AETC)

Lackland Air Force Base, Texas 78236-5511 AETC INSTRUCTION 36-2640

PREVIOUSLY AETC INSTRUCTION 36-2201

2 March 2012

Personnel

TECHNICAL AND BASIC MILITARY TRAINING EVALUATION

ACCESSIBILITY: This publication is only available directly from the OPR

RELEASABILITY: There are no releasability restrictions on this publication

OPR: 737 TRG/CTE (Mr. B. Wilson) Certified by 737 TRG/CD (Lt Col M. DelVecchio)

Supersedes: 737 TRG Supplement 1, 15 Nov 2010 Pages: 14

SUMMARY OF REVISIONS: This document is in the process of revision to update and reflect requirements outlined in the publication AETCI 36-2640.

AETCI 36-2201, 13 Sep 2010, is supplemented as follows:

2.0. (ADDED) The 737th Training Group (737 TRG) assesses the quality of training through a comprehensive system of internal and external feedback, a standardization and evaluation program, and special studies for commanders and training personnel to make program improvements.

2.1. (ADDED) The 737 TRG Training Evaluation Program (TEP) consists of internal/external feedback, a standardization evaluation preprogram (Stan Eval).

3.0 (ADDED) Internal Feedback.

3.1 (ADDED) The 737 TRG uses a comprehensive attitudinal BMT Departure Survey and an optional Lackland Air Force Base (LAFB) Form 133, Trainee Comment Sheet to obtain internal program feedback. The BMT Departure Survey measures trainee attitudes on various aspects of their training experience at the end of training. The optional Trainee Comment Sheet provides an opportunity for trainees to comment on any aspect of their training, at any time, during the training cycle.

3.1.1. (ADDED) 737 TRG/CTE will provide trend data and quarterly analysis of the internal feedback for group, squadron, training development, and standardization and evaluation leadership; identifying suspected special causes for deviations of 5% or greater and specifically addressing items with a poor response rate.

3.2. (ADDED) 737 TRG/CTE is responsible for overseeing the proper administration of the

BMT Departure Survey by War Skills and Military Studies (WSMS) instructors who administer it to all trainees at the end of training, with the exception of those few trainees with scheduled appointments at the time of the survey. WSMS instructors will offer trainees the opportunity to complete on bond paper, at the time of the survey, any additional comments they would like to include concerning the survey questions. To assist in trainee understanding, the BMT Departure

Survey contains two questions that cover the motivational training question “Did motivational training practices used in the course improve your motivation/discipline?” This is to assist trainee understanding. The first question determines if motivational training practices were used

(Question: "My MTI(s) used push-ups, flutter kicks, or four count squat thrusts as motivation?"), while the second question determines if motivational training practices were successful (Question: "I believe the motivation exercises helped me to become more motivated or helped to correct my deficiencies?"). The BMT Departure Survey only includes questions from the sample survey which are applicable to BMT. Questions are re-worded/combined to fit the BMT training environment and to increase trainee comprehension.

3.2.2. (ADDED) A trainee may submit a Trainee Comment Sheet at any time for feedback;

however, scheduled course chart hours will not be interrupted for this purpose. The Trainee

Comment Sheet may be used to critique any aspect of the training program, to include base support facilities and services. Only the 737 TRSS or 737 TRG/ CTE open and process the comment sheets after recovering from locked drop boxes, to ensure anonymity. Trainee

Comment Sheets are available at drop box locations in Recruit Housing and Training (RH&T) dining facilities, field training encampment, 737 TRSS Transition Flight, the Gateway Chapel and future Airman Training Complex (ATC). Blank Trainee Comment Sheets are included in the Basic Military Training Study Guide each trainee receives and at each drop box location.

Trainees need not sign the Trainee Comment Sheet; however, identification is necessary for personal replies.

3.2.2.1. (ADDED) 737 TRG Internal Feedback Procedures.

3.2.2.1.1. (ADDED) 737 TRG/ CTE Responsibilities

3.2.2.1.1.1. (ADDED) Oversees 737 TRSS personnel processing of Trainee Comment Sheets and WSMS administration of the Departure Survey.

3.2.2.1.1.2. (ADDED) Will provide commanders a quarterly report, which includes analysis, along with the associated trend data by group and training squadron on internal feedback.

3.2.2.1.2. (ADDED) WSMS personnel will administer the Departure Survey

3.2.2.1.3. (ADDED) 737 TRSS Responsibilities:

3.2.2.1.3.1. (ADDED) Collect Trainee Comment Sheets from locked containers for

RH&T/ATCs on Monday, Wednesday, Friday and the field training encampment and Gateway

Chapel on Wednesday.

3.2.2.1.3.2. (ADDED) Upon collection of the Trainee Comment Sheets, 737 TRSS will electronically scan comment sheets (by date) and provide an e-mail copy to the appropriate squadron commander/squadron superintendent/first sergeant/feedback monitor, the 737 TRG deputy commander and 737 TRG/CTE within 24 hours of pickup. In addition, they will classify comments sheets as “URGENT” and immediately forward (hand-deliver and e-mail) the original copy of any Trainee Comment Sheets containing comments involving suicide, alleged maltreatment, maltraining, sexual harassment, hazing, fraternization, solicitation or such information to 737 TRG/CTE for action and feedback. All other critiques are classified as

“ROUTINE”. All personnel handling trainee comment sheets will maintain strict confidence and will not divulge sensitive information.

3.2.2.1.3.3. (ADDED) Enter summarized internal feedback data into analysis software for statistical accounting, as appropriate.

3.2.2.1.4. (ADDED) 737 TRG/CD Responsibilities:

3.2.2.1.4.1. (ADDED) Review all LAFB Forms 133 upon receipt.

3.2.2.1.4.2. (ADDED) Immediately inform the 737 TRG commander of URGENT comments such as those involving alleged maltreatment, maltraining, sexual harassment, hazing, fraternization, solicitation or such information and require feedback from the squadron commander for all URGENT trainee comment sheets and forward results of this feedback to the

737 TRG/CC and 737 TRG/CD.

3.2.2.1.5. (ADDED) Squadron Commander Responsibilities:

3.2.2.1.5.1. (ADDED) Squadron commanders brief trainees on the 737 TRG Trainee Feedback

Program during the Squadron Commander’s Time briefing. They assure trainees that they may submit comments at anytime without fear of prejudice or reprisal, and advise them that their comments should be specific.

3.2.2.1.5.2. (ADDED) Squadron commanders and their squadron superintendents serve as squadron reviewing officials for Trainee Comment Sheet. They take action, as appropriate, and track their status. Squadron feedback monitors assist in tracking, disposition, and responding to trainees. Feedback monitors will ensure all Trainee Comment Forms that are turned-in directly to squadron personnel are copied with the original forwarded to 737 TRG/CTE.

3.2.2.1.5.3. (ADDED) Squadron commanders will appoint, in writing, a primary and alternate feedback monitor to assist in tracking and ensure replies to Trainee Comment Forms are provided to trainees, when required.

3.2.2.1.5.4. (ADDED) Squadron commanders review and investigate Trainee Comment Sheet for validity and action, if needed, and provide direct feedback to the trainee upon request. If feedback involved URGENT comments (maltreatment, maltraining, sexual harassment, fraternization, hazing or solicitation, etc.), they inform the trainee of the investigation findings.

3.2.2.1.5.5. (ADDED) Squadron commanders will annotate the findings/corrective action, and forward a reply by e-mail or MFR to the 737 TRG/CD on unfavorable trainee comment sheets as required by 737 TRG/CC.

3.2.2.1.5.6. (ADDED) The squadron commander provides 737 TRG/CTE with necessary documentation and trainee information required for conducting approved training evaluation projects and special studies.

4.0. (ADDED) External Feedback

4.1. (ADDED) The 737 TRG uses the BMT Airman’s Performance Survey (APS) to obtain external feedback on the quality of its graduates.

4.1.1. (ADDED) The Basic Training Management System (BTMS) automatically generates the

APS which consists of two letters (one for the military training leader or MTL and one for the

Academic Instructor or AI), for a minimum of 25 percent of randomly selected graduates.

BTMS normally electronically forwards such letters to the gaining technical training group;

however, when accomplished manually, military training instructors (MTIs) provide those selected Airmen these letters to hand-carry to their first technical training station.

4.1.1.2. (ADDED) If hand carried, MTIs direct trainees to deliver one letter to their MTL and one letter to their AI. The letters, as well as electronically generated instructions direct the MTL and AI to where they may accomplish the BMT APS. Specific questions are tailored to MTLs and AIs and are designed to reflect the effectiveness of the BMT program and where it may be improved. MTLs and AIs complete these surveys after the trainees have been assigned to technical training for approximately four weeks.

4.1.2. (ADDED) 737 TRG/CTE responsibilities:

4.1.2.1. (ADDED) If necessary, upon receipt, provide squadron commander responses to specific requests for information or clarification generated from the BMT APS.

4.1.2.2. (ADDED) Provide group, squadron, and standardization and evaluation leadership a quarterly analysis report of the external feedback collected, identifying suspected special causes for deviations of 5% or greater and specifically addressing items with a poor response rate.

4.1.3. (ADDED) Squadron commander responsibilities:

4.1.3.1. (ADDED) Squadron commanders review APS quarterly feedback results to determine possible program improvements.

4.1.3.2. (ADDED) Squadron commanders ensure they or their designated representative respond to specific requests for information or clarification generated from the Airman Performance

Survey (APS) as soon as possible, but not later than five workdays after receipt of written inquiry. If a phone answer is appropriate, the person preparing the answer calls the requester with the reply.

4.1.4. (ADDED) Military Training Instructor (MTI) responsibilities:

4.1.4.1. (ADDED) MTIs respond to specific requests for information or clarification generated from the BMT APS as soon as possible but not later than five workdays after receipt of written inquiry.

5.1.4.1. (ADDED) The 737 TRG Standardization and Evaluation (Stan/Eval) Program assesses the professional qualifications of MTIs and programs to ensure the quality of BMT training. (see Attachment 13).

5.1.4.1.1. (ADDED) The fundamental principles of the Stan/Eval program are to promote effective instruction, application and evaluation of training and determine quality of training through recurring instructor/trainee performance inspections.

5.1.4.1.2. (ADDED) 737 TRG Stan/Eval Flight (737 TRG/CCV) evaluates all training group activities for standardization and compliance with current directives. CCV prepares formal inspection reports and evaluation responses to higher headquarters inspections, and ensures corrective action is initiated for each finding.

5.1.4.1.3. (ADDED) On average each squadron will receive a minimum of one evaluation per month in each of the five BMT training proficiency areas: instructor teaching evaluations, subject matter proficiency verification testing, safety, faculty records and student records. Stan

Eval may conduct a military training proficiency observation in any monthly reporting period. (see

Attachment 13). Note: if assigned to an active duty BMT squadron,433 TRS MTIs are eligible for evaluations/observation.

5.1.4.1.4. (ADDED) Scheduling and selection of evaluations and observations is determined by

AETC requirements, the 737 TRG/CC, based on deficient areas/trends or the discretion of 737

TRG/CCV.

5.1.4.1.5. (ADDED) The 737 TRSS is exempt from the evaluations listed in attachment 13 except for test control and training development due to their support function role. NOTE: the

MTI School (CCAF Accredited) receives BMT training proficiency evaluations scheduled IAW attachment 13. In addition, only designated/qualified Stan Eval evaluators will inspect MTIS.

5.1.4.1.6. (ADDED) Faculty records and trainee records are evaluated by taking a random sampling. Trainee training records are maintained and evaluated using the Basic Training

Management System (BTMS).

5.1.4.1.7. (ADDED) 737 TRG/CCV conducts random safety and risk management observations based on the Risk Management Annex in the course training plan, plans of instruction and lesson plans along with safety related activities (i.e. physical training, entry controller, evacuation procedures, etc.) (see Attachment 13).

5.1.4.1.8. (ADDED) Instructor evaluations and subject matter testing:

5.1.4.1.8.1. (ADDED) For instructor evaluations, 737 TRG/CCV may:

5.1.4.1.8.1.1. (ADDED) Provide squadrons with the MTI name and subject being evaluated, one hour prior to allow for the individual to prepare for the class/evaluation.

5.1.4.1.8.1.2. (ADDED) Use the BMT weekly activities schedule to randomly select instruction to evaluate.

5.1.4.1.8.1.3. (ADDED) Coordinate with squadrons to evaluate scheduled instructor evaluations or scheduled subject matter qualification evaluations.

5.1.4.1.8.1.4. (ADDED) Coordinate with 737 TRSS/ Deliberate Development to conduct

Teaching Qualification (TQ) evaluations.

5.1.4.1.8.2. (ADDED) 737 TRG/CCV notifies the squadron superintendent to decertify the MTI on any evaluations below a satisfactory rating.

5.1.4.1.8.3. (ADDED) Follow-up evaluations on below satisfactory ratings will be conducted within 30 days of the original failure by 737 TRG/CCV.

5.1.4.1.8.4. (ADDED) Follow-up evaluations are assessed a grade of satisfactory or unsatisfactory.

5.1.4.1.8.5. (ADDED) All follow-up evaluation failures remain decertified and the evaluation information is forwarded to the 737 TRG/CC.

5.1.4.2. (ADDED) Quarterly and semi-annual reports:

5.1.4.2.1. (ADDED) 737 TRG/CCV will design a report consisting of a trend analysis of all five of the BMT training proficiency evaluations along with military training evaluations and compliance evaluations (if performed during the report time frame), including recommended improvement areas, deficiencies, best practice, and strengths (see Attachment 15 for sample).

5.1.4.2.2. (ADDED) 737 TRG/CCV semi-annual reports should be coordinated through 737

TRG/CD/TA/CCC/CTE prior to release.

5.1.4.2.3. (ADDED) Internal and external feedback is reported in the quarterly feedback report completed by 737 TRG/CTE and should be coordinated through 737 TRG/CD/TA/CCC/CCV prior to release.

5.1.4.3. (ADDED) 737 TRG/CCV Responsibilities:

5.1.4.3.1. (ADDED) Conducts formal evaluations on military training and compliance, evaluates MTI instruction, and performs other evaluations as directed by the 737 TRG/CC.

5.1.4.3.2. (ADDED) Validates all discrepancies at the conclusion of an evaluation. This process includes an out brief with the MTI evaluated and supervisory personnel.

5.1.4.3.3. (ADDED) Provides the subject matter expertise (SME) for parades/reviews and special ceremonies; AFMAN 36-2203, Drill and Ceremonies and 737 TRGI 36-2, Ceremonies.

5.1.4.3.4. (ADDED) Coordinates on directives, guidance memorandums and interim guidance when new policy is introduced.

5.1.4.3.5. (ADDED) Publishes a Quarterly/Semi-Annual Evaluation Report to provide trend data relating to training and forward it to the 737 TRG/CC.

5.1.4.3.6. (ADDED) Monitors the group self-inspection program. Reviews and ensures checklists are standardized throughout the 737 TRG and coordinates with 737 TRG/CCR for checklist development and annual reviews.

5.1.4.3.6.1. (ADDED) Squadrons forward a formal quarterly report for all open discrepancies from their self-inspection program to 737 TRG/CCV. Squadrons send follow-up reports every

30 days until items are closed.

5.1.4.3.6.2. (ADDED) 737 TRG/CCV validates open discrepancies and ensure squadron replies indicate corrective and preventive measures.

5.1.4.3.6.3. (ADDED) 737 TRG/CCV tracks open discrepancies until closed.

5.1.4.4. (ADDED) Augmentation of 737 TRG/CCV:

5.1.4.4.1. (ADDED) 737 TRG/CCV forwards augmentation requests to all 737 TRG squadron/flight commanders. Commanders nominate the most experienced and strongest performing MTIs and functional subject matter experts to augment 737 TRG/CCV.

5.1.4.4.2. (ADDED) The Superintendent, 737 TRG/CCV reviews all nominations to ensure they are qualified to perform assigned duties.

5.1.4.4.3. (ADDED) Once 737 TRG/CCV has approved augmentees, 737 TRG/CCV will provide and document evaluator training for all individuals who have not been previously trained as an evaluator using AF Form 797 Job Qualification Standards Continuation/Command JQS or other computer generated forms.

5.1.4.4.4. (ADDED) Augmentees will not be used to perform 281 instructor evaluations and are exempt from the formal course training listed in AETCI 36-2202 Attachment 3 and may specialize solely on one training area for augmentation purposes.

5.1.4.5. (ADDED) 737 TRG/CCV Selection Criteria.

5.1.4.5.1. (ADDED) Program success depends on candidates possessing the highest standards of

AF core values and BMT competence.

5.1.4.5.2. (ADDED) Candidates may be a Master Military Training Instructor (Blue Rope).

5.1.4.5.3. (ADDED) Candidates must have at least one-year retainability.

5.1.4.5.4. (ADDED) Candidates compete for hire. The Superintendent, 737 TRG/CCV recommends the best candidate for 737 TRG/CC final approval.

5.1.4.5.5. (ADDED) CCV will provide and document evaluator training for all individuals using

AF Form 797 Job Qualification Standards Continuation/Command JQS or other computer generated forms.

10.4.1.1. (ADDED) 737 TRG/CTE and 737 TRG/CCV develop evaluation instruments for collecting meaningful data according to Instructional Systems Development (ISD) and testing/surveying principles, and review/validate them annually; and use additional training data, inspection reports and 737 TRG requirements, as appropriate.

10.4.1.2. (ADDED) 737 TRG/CTE and 737 TRG/CCV oversee administration of evaluation instruments to the target population.

10.4.1.3. (ADDED) 737 TRG/CTE collects all other training data that may have an impact on the evaluation results.

10.4.1.4. (ADDED) 737 TRG/CTE and 737 TRG/CCV analyze the data collected according to the evaluation criteria and prepare narrative reports on the findings, and monitor positive and negative trends.

10.4.1.5. (ADDED) 737 TRG/CTE and 737 TRG/CCV conduct briefings on the 737 TRG evaluation program, as required.

10.4.1.6. (ADDED) 737 TRG/CTE and 737 TRG/CCV respond to reports from higher headquarters.

10.4.1.7. (ADDED) The 737 TRG Commander will task or approve 737 TRG/CTE and 737

TRG/CCV projects, special studies and reports.

10.5.1. (ADDED) 737 TRG/CTE completes a comprehensive trend analysis feedback report including both internal and external feedback and submits no later than 45 days at the conclusion of the quarter (i.e.: 15 Feb, 15 May, 15 Aug, 15 Nov) to HQ AETC/A3T, HQ AETC/A3PV, HQ

AETC/A3P and 2 AF/TTOC.

///signed, gep, 2 Mar 2012///

GLENN E. PALMER, Colonel, USAF

Commander

Attachments:

13. Evaluation Guide

14. The Rating System and Definitions

Attachment 13

EVALUATION PLAN

A13.1. Evaluation Plan. The following information outlines requirements for BMT evaluations based on category and type of evaluation.

Table A13.1. Evaluation Plan.

A. BMT TRAINING PROFICIENCY

An average of no less than one evaluation per area (instructor teaching evaluation, subject matter proficiency testing, safety, faculty records and student records) will be inspected per month per squadron.

Instructor evaluations and subject matter proficiency testing may be NO-NOTICE or scheduled based on

737 TRG/CCV discretion. NOTE: 737 TRG/CCV conducted teaching qualification evaluations may fulfill this requirement.

1. Instructor Teaching Evaluations

Type Evaluation Tool Notes

a. Dorm Instruction AETC Form 281 Note 2.

b. Drill Instruction AETC Form 281

Note 2

c. Lecture AETC Form 281 Note 2. including but not limited to: WSMS, BMT

Weapons Familiarization, FEST, SABC and CBRNE

Instruction

2. MTI Subject Matter Proficiency Verification Testing (Subject to change based on course requirements as determined by the group training director IAW AETCI 36-2202)

a. MTI Drill Control BMT Checklist

b. Dormitory Insp Procedures (DIPS) BMT Checklist

c. Trainer Weapon PC BMT Checklist

d. Physical Training (PT) PC BMT Checklist

e. Reporting BMT Checklist

f. End of Course Testing

IAW AETC

Standard

WSMS and MTI School

Instructors only

3. Safety (Items listed below should be No-Notice based on 737 TRG/CCV discretion)

a. Physical Training Program BMT Checklist

b. MTI Responsibilities (MTIR) BMT Checklist

c. Trainer Weapons Issue BMT Checklist

d. Risk Management CTP RM Annex, POI Part I & II

Evaluated during any activity identified on the course training plan, risk management annex and in the POI Part 1 & II

4. Faculty Records (Items listed below should be No-Notice based on 737 TRG/CCV discretion)

a. MTI Training Records BMT Checklist Random sampling

b. Instructor Lesson Plans BMT Checklist Random sampling

5. Student Records (Items listed below should be No-Notice based on 737 TRG/CCV discretion)

a. Trainee Records BMT Checklist Random sampling/Note 3.

B. COMPLIANCE OBSERVATIONS

In addition to BMT Training Proficiency areas identified in Section A, the 737 TRG/CCV may conduct the following observations in any monthly reporting period.

1. Military Training Proficiency

Type Evaluation Tool Notes

a. MTI Proficiency

1) Evaluator Effectiveness

(Instructor supervisor or qualified trainer)

BMT Checklist Note 1.

2) Weekly Activity Schedule Compliance BMT Checklist

3) Airman’s Time Observation BMT Checklist

4) Dining Facility Observation BMT Checklist

5) U.S. Mail Observation BMT Checklist

6) Classroom/EOC Test Administration BMT Checklist WSMS Instructors only

b. Trainee Proficiency

1) Trainee Bearing & Discipline w/Questions BMT Checklist

2) Open Ranks w/Questions BMT Checklist

3) Entry Controller Procedures/Questions BMT Checklist

4) Fire/Gas/Bomb Drill BMT Checklist

5) Duty Dorm Observation BMT Checklist

6) Non-Duty Dorm Observation BMT Checklist

7) Flight Drill Observation BMT Checklist

2. Other Observations

A comprehensive review of these items will be conducted at least once every 12 months or as directed by the 737 TRG/CC.

Type Evaluation Tool Notes

1. Motivational Training BMT Checklist Random sampling

2. Resource Management Applicable SI

Checklists

3. Training Development Test Control BMT Checklist

4. Training Development/Management AETCI 36-2203 737 TRGCCV will ensure a qualified evaluator conducts assessment

Notes:

1. 737 TRG/CCV may elect to evaluate the MTI’s instructor supervisor and assess their ability to evaluate MTI performance either in conjunction with an MTI’s evaluation or individually.

2. Squadrons may be given the MTI name and subject being evaluated one hour prior to a no-notice instructor evaluation, to allow for the individual to prepare for the class/evaluation.

3. Transition flight trainee training records evaluations are modified to fit their records maintenance policies/storage.

Attachment 14

THE RATING SYSTEM AND DEFINITIONS

A14.1. Military Training Evaluations

A14.1.1. 737 TRG/CCV evaluates and grades using prescribed measurement tools, i.e. AETC

Form 281 or checklist.

A14.1.2. Any evaluations rated below meets/satisfactory require 737 TRG/CCV follow-up with-in 30 days, re-evaluating the deficient area(s).

A14.2. The Rating System.

A14.2.1. 737 TRG/CCV uses a two, three or five tier rating system, defined below, to assign ratings to inspected units. Expectations are that squadrons operate at exceeds/excellent or higher level. 737 TRG/CCV evaluates each line item and determines the functional area rating from the ratings assigned to each subject.

A14.2.2. The 737 TRG/CC approves all ratings.

A14.2.3. Findings discovered during an inspection that equal or exceed the severity of findings from the previous report, regardless of being asterisked or not, are identified as a repeat discrepancy.

A14.2.4. 737 TRG/CCV base ratings on total management effectiveness and will not release ratings for line items or the overall squadron rating until the formal out brief.

A14.2.5. Fraud, Waste and Abuse (FWA) is not a separately rated item. Any FWA finding is identified in the formal report as a double asterisk item and labeled as potential FWA. Also, major safety awareness discrepancies in any area impact the overall rating of the unit’s Safety

Program.

A14.2.6. Rating Definitions

A14.2.6.1. Five-tier ratings:

A14.2.6.1.1. OUTSTANDING: Program performance or operations far exceed mission requirements - a potential benchmark in the group. Operating procedures and activities are very efficient and highly effective; few, if any, deficiencies exist.

A14.2.6.1.2. EXCELLENT: Program performance or operations exceed mission requirements.

Operating procedures are efficient and effective; relatively few deficiencies exist.

A14.2.6.1.3. SATISFACTORY: Program performance or operations meet mission requirements. Operating procedures are sufficient and practical; minor discrepancies exist, but they do not significantly impede or limit mission accomplishment.

A14.2.6.1.4. MARGINAL: Program performance or operations do not meet some mission requirements. Operating procedures are inadequate or inappropriate; deficiencies that impede or limit mission accomplishment exist.

A14.2.6.1.5. UNSATISFACTORY: Performance or operations do not meet mission requirements. Operating procedures are non-existent or completely inappropriate; deficiencies that preclude or seriously limit mission accomplishment exist.

A14.2.6.2. Three-tier ratings:

A14.2.6.2.1. EXCEEDS: Program performance or operations far exceed mission requirements

- a potential benchmark in the group. Operating procedures and activities are very efficient and highly effective; few, if any, deficiencies exist.

A14.2.6.2.2. MEETS: Program performance or operations meet mission requirements.

Operating procedures are sufficient and practical; minor discrepancies exist, but they do not significantly impede or limit mission accomplishment.

A14.2.6.2.3. DOES NOT MEET: Performance or operations do not meet mission

A14.2.6.3. Two-tier ratings:

A14.2.6.3.1. MEETS: Program performance or operations meet mission requirements.

Operating procedures are sufficient and practical; minor discrepancies exist, but they do not significantly impede or limit mission accomplishment.

A14.2.6.2.2. DOES NOT MEET: Performance or operations do not meet mission

Attachment 15

SAMPLE SEMIANNUAL TREND ANALYSIS REPORT

737th TRAINING GROUP

SEMIANNUAL TREND ANALYSIS REPORT

(1 Jan XX – 30 Jun XX or 1 Jul – 31 Dec XX)

1. Activities:

a. Units/functions evaluated this period and any ratings assessed (if used)

Number of

Evaluations

Sat

Unsat

BMT Training Proficiency Evaluations

1. Instructor Evaluations

2. Subject Matter Testing

3. Safety

4. Faculty Records

5. Student Records

Military Training Observations

Compliance Observations

b. Follow-up conducted

c. Staff assistance provided (if applicable)

d. Special projects (if applicable)

Description:

Provide an overview of the evaluations, follow-up evaluations, staff assistance visits and special projects accomplished during the reporting period.

Example:

HHQ and commander directed inspections were conducted during this period. The XX evaluated, were rated as ―Met the Standard, XX were rated as―Did Not Meet the Standard, and

XX was not rated.

Follow-up evaluations were conducted on all deficiencies; of the XX deficiencies that were open, only XX remain(s) open. A total of XX deficiencies were assessed in the various reports this year. Of that number, XX were closed and XX remain open with no overdue responses.

SAVs were conducted on two units at the direction of the 737 TRG/CC. One special project was conducted.

2. Trend Analysis (cumulative to cover 6-month period):

a. Instructor Evaluations

b. Subject Matter Testing

c. Safety

d. Faculty Records

e. Trainee Records

f. Military Training Observations (see Attachment 13)

g. Compliance Observations (see Attachment 13)

Description:

Trend analysis is a study of common problems observed in organization evaluations and identification of causes and solutions applicable across organizations. Therefore, each area includes (if applicable) "Recommended Improvement Areas" and "Deficiencies" categories.

Identify the trend, number of cases cited (or percentage of total deficiencies) and problems encountered in correcting deficiencies, correlate trends with problems cited in previous trend analyses, and provide a root cause analysis. Identify Best Practices, strengths as defined in AFI

90-201. Best Practices must be validated IAW AFH 38-210 before including in report. Other items may be added as deemed appropriate.

Example:

f. Military Training

BEST PRACTICE: Utilized an Excel spreadsheet to automate the AETC Form 668 to track high miss test items. Automatically highlights items with a XX percent or more miss rate per class. Encompasses separate tabbed areas for instructor, instructor supervisor, and TDE comments and review. Use of this product facilitated a one-stop-shop approach to quick and accurate tracking and reporting of high miss test items.

GROUP COMMANDER SIGNATURE

cc:

TRW/CC