TMCR_Attachment_4_TOLCVP_(DVES).pdf

TOLCVP PAGE 1

UNITED STATES AIR FORCE

HH60G

WEAPON SYSTEM

TECHNICAL ORDER LIFE CYCLE

VERIFICATION PLAN

(TOLCVP)

For

(Installation of Degraded Visual Environment System (DVES)

On HH-60G Helicopters)

NOTE

IAW TO 00-5-3, the TOLCVP is mandatory for ALL TO programs, unless otherwise justified in writing and approved by the Program Manager (PM). The AF Rotary Wing TOLCVP containing overall verification requirements for modification efforts and quality assurance for

TOs sustainment within AFLCMC/WIUB.

PREPARED BY: AFLCMC/WIUBC TOMA

DATE: 1 DECEMBER 2017

TOLCVP PAGE 2

TABLE OF CONTENTS

Paragraph

Number Title Page

1 Introduction 3

2 Purpose 3

3 Scope 3

4 References 3

5 Annexes 3

6 Verification Plan General Provisions 3

6.1 General 3

6.2 Organizational Structure 4

6.3 Definitions 4

6.4 Policy 4

6.5 Prototyping 4

7 Responsibilities 4

7.1 TO Management Agency (TOMA) 4

7.2 Technical Content Manager/Equipment Specialist (ES) 5

7.3 MAJCOM Responsibilities 6

7.4 Verification Team Manager (VTM) 6

7.5 Contractor Personnel 7

7.6 Using and Participating Agencies 8

7.7 Technical Order Review Board (TORB) 8

7.8 Flight TORB (FTORB) 8

8 Procedures for Verification 8

8.1 Program Manager (PM) 8

8.2 Verification 8

8.3 Verification Updates 12

8.4 TORB & FTORB 12

9 Procedures for Quality Assurance (QA) 13

10 Administrative Procedures 13

10.1 RC and Comment Sheet Control and Tracking 13

10.2 AFTO Form 27 13

10.3 AFTO Form 82 14

10.4 Verification Records 14

TOLCVP PAGE 3

1. INTRODUCTION.

This Technical Order Life Cycle Verification Program (TOLCVP) plan establishes policy, defines terminology, assigns responsibility, and specifies schedules for the (Installation of Degraded

Visual Environment System (DVES) On HH-60G Helicopters). Verification of Time

Compliance Technical Orders (TCTOs) and related Technical Order (TO) updates, with or without kits, is mandatory. The purpose of TCTO/TO verification is to ensure that technical guidance is complete, any associated kits are adequate and parts fit properly, skill levels are properly identified, designated support equipment performs satisfactorily, tooling requirements are provided, proper modification marking instructions are included, the modification can be installed within the intended environment, and associated or affected TOs are updated and correct. This TOLCVP applies to all verification activities, including the using command, Air Combat Command (ACC) bases, remote sites, depots, and contractor facilities. This plan was developed by

AFLCMC/WIUBC Technical Order Management Agency/Agent (TOMA) and is based on the most current information available at the time of publication. From this point forward the term

“TO” represents a TCTO or TO, a maintenance TO and/or Flight Manual (FM). The TOMA represents the Technical Order Management Agency or Agent.

2. PURPOSE.

This plan was developed in accordance with the requirements established in TO 00-5-3, 00-5-15 and is mainly focused on the modification efforts in support of the (Installation of Degraded

Visual Environment System (DVES) On HH-60G Helicopters). The purpose of this plan is to determine Air Force (AF) objectives, requirements, responsibilities, schedules and procedures for the HH-60G aircraft during the modification development process.

3. SCOPE.

This plan applies to the verification method for TO development efforts within the (Installation of Degraded Visual Environment System (DVES) On HH-60G Helicopters) program. In addition, this plan applies to contractor-generated government-approved Organizational or Depot level Preliminary Technical Orders (PTOs) and the Interactive Electronic Technical Manual

(IETM).

4. REFERENCES.

See Technical Order Life Cycle Management Plan (TOLCMP), paragraph 5.

5. ANNEXES.

5.1 Newly developed TOs will be listed within the contractor’s tailored Technical Manual

Contracts Requirement (TMCR) TM-86-01.

5.2 All currently sustained HH-60G TOs are listed within the TOLCMP, in Annex A.1: TO

Listing.

6. VERIFICATION PLAN GENERAL PROVISIONS.

6.1 General. This plan establishes the management relationships between the TOMA, MAJCOM, Using Commands , Program Managers (PM), Technical Content Managers

(TCM), Verification Team Manager (VTM) and Contractors who are associated with all TO actions within the (Installation of Degraded Visual Environment System (DVES) On HH-60G

Helicopters) program. Military system, subsystem, support equipment, weapons and munitions, and depot TO verifications shall be managed in accordance with the applicable references and this verification plan.

TOLCVP PAGE 4

6.2 Organizational Structure. The TO sustainment organization structure consists of a TOMA, FMM, PM, TCM, Verification Team, Technical Order Review Board (TORB) and a Flight TO

Review Board (FTORB).

6.2.1 The verification team consist of a TOMA, Verification Team Manager (VTM), MAJCOM, using command representative (TCTO VTM) and contractor.

6.3 Definitions. See TOLCMP paragraph 6.

6.4 Policy. TO verification policy is defined in TO 00-5-3 and TO-5-15. Unless otherwise specified, the TOMA has the authority to co-chair all TO meetings in accordance with approved schedules. During the modification process, TOs require In-Process Reviews (IPRs) and contractor certification completion to ensure technical data is accurate, usable, and safe prior to proceeding to the verification IAW this plan and the TMCR. The TOMA or VTM is responsible for the verification of TOs during kit proof and shall approve/disapprove the verification utilizing

AFTO Forms 27 and 82. The goal is to have 100% verification of all procedures prior to initial deployment of the system or commodity. TO verification of task-type procedures shall be accomplished on contractor-tested or certified data by performance unless otherwise authorized by the PM, VTM, or TOMA. Partly-verified TOs will include a Verification Status Page (VSP) when certain maintenance procedures cannot be verified during TO verification.

6.4.1 Verification of TOs shall be evaluated in accordance with the TO Review/Evaluation

Checklist (Attachment 3) of the TMCR. All TO discrepancies, comments and changes during the

TO verification shall be documented by the contractor on an AFTO Form 158 and reviewed by the TOMA or TORB/FTORB for approval/disapproval.

6.5 Prototyping. Preliminary TCTOs developed for the Air Force by a contractor must be

“prototyped” prior to acceptance for Government verification. Prototyping as used here includes contractor certification of the TCTO and any required TO updates and should involve actual installation of the prototype TCTO kit. Under this situation, the contractor uses the preliminary

TCTO instructions and any associated TO task changes to perform the prototype modification.

6.5.1 Prototyping and Verification. The PM, in conjunction with the Lead Command, may authorize concurrent prototyping and verification when in the interests of the Air Force.

7 RESPONSIBILITIES.

7.1 TOMA.

7.1.1 Develop and tailor the TMCR and Integrated Master Schedule (IMS) to meet specific verification program efforts, requirements, and suspense dates.

7.1.2 Provide overall management for the acquisition of TOs required for the operation and maintenance of the military system and associated commodities to include the IETM.

7.1.3 Develop or assist in developing TO Performance-Based Work Statement (PWS) or

Statement of Work (SOW) with all necessary TO policies, schedules, and procedures needed to have 100% verification of TOs.

7.1.4 Update this plan as required.

7.1.5 Initiate agreements with between the contractor and support activities to resolve all TO deficiencies in a timely manner.

7.1.6 Ensure TO Quality Assurance (QA) is being performed by the contractor prior to integrating source data and formalizing the TO.

TOLCVP PAGE 5

7.1.7 Monitor the activities of the verification team to ensure that verification is proceeding as scheduled.

7.1.8 Serve as the Verification Team Manager (VTM) or task the MAJCOM to appoint a

VTM to control the overall management of the TO verification.

7.1.9 Keep an accurate up-to-date record of AFTO Forms 27s, 82s,158s, and/or AF Forms

847s to reflect the approved/disapproved status of the verification.

7.1.10 Serve as the focal point for sustainment matters once TO source data has been delivered and accepted as final.

7.1.11 Ensure verified Preliminary Technical Orders (PTOs), AFTO Form 82, along with the approved PTO waiver letter (if required), are made available to the unit upon aircraft modification completion prior to TCTO/TO formalization.

7.1.12 Support the VTM as needed, to ensure all resources required for verification are scheduled and available.

7.1.13 Approve/disapprove recommendations for TO updates that the TORB/FTORB cannot resolve.

7.1.14 Provide disposition on TORB/FTORB recommendations which impact the contract.

7.1.15 Approve transition of PTOs to formal TOs based on TORB/FTORB recommendations.

7.2 Technical Content Manager (TCM)/Equipment Specialists (ES). At the written direction of the PM/CE, the TCM/ES is an individual or office responsible for the accuracy, adequacy, modification, classification and review of TO procedures, engineering data and the related technical contents of a TO. For new acquisitions or major modifications, the TCM role is usually performed by a PM-designated logistician, TOMA or prime contractor, assisted by an Integrated

Product Team (IPT) of engineers, ESs and users. The TCM role for TOs supporting equipment in the sustainment phase is usually performed by the ES responsible for the equipment. TCMs will:

7.2.1 Manage TO content by evaluating and coordinating recommended changes, deficiency reports, accident/incident reports, and other source data. In conjunction with program engineers, ensure approved changes will not negatively affect system or equipment OSS&E IAW AFMCI

63-1201.

7.2.2 Act as the Verification Team Manager (VTM) or task the MAJCOM to appoint a VTM to control the overall management of the TO verification.

7.2.3 Verify TO procedural changes and ensure updates do not alter the distribution or security restrictions of the parent manual.

7.2.3.1 In conjunction with the TOMA, perform a Pre-publication Review on Change/Revision packages before they are reproduced and/or distributed.

7.2.3.2 Manage the content of assigned TOs, and apply the most appropriate Distribution

Statement (AFI-61-201 & DoDI 5230.24) to control the content’s dissemination.

7.2.3.3 Ensure newly-developed TO procedures prevent pollution by reducing the use of hazardous materials and the release of pollutants into the environment. TO contents should comply with AFPD 32-70, Environmental Quality, Air Force 32-70 series instructions and Federal

Acquisition Regulations (FAR).

7.2.3.4 Evaluate Recommended Changes (RCs) for assigned TOs.

TOLCVP PAGE 6

7.2.3.5 In coordination with the TOMA and lead/MAJCOMs, verify all procedure, maintenance or operation task changes. This includes TOs in acquisition and the sustainment phase of the TO program life cycle.

7.2.4 Evaluate Commercial-Off-The-Shelf (COTS) manuals for effectiveness and content IAW

MIL-PRF-32216.

7.3 MAJCOM Responsibilities. Both the technicians for the verification team and the site for verification are normally provided by the MAJCOM. The selection of qualified personnel to perform verification depends on the type and level of maintenance established for the military system or commodity being covered. Different teams and verification locations may be required to cover all maintenance types and levels (on- or off-equipment, field or depot) for TO verification.

The verification team normally consist of the VTM, technicians, QA and Safety personnel, other support agency personnel, and the contractor. The technicians should include the lowest grade and skill level (5-level minimum) projected for day-to-day use of the TO. MAJCOM may use support contractors as part of the Government verification team.

7.3.1 Coordinate with using command units to schedule personnel, aircraft, equipment and other support required for verification of TOs in accordance with plans and schedules established by the using command, TOMA, and this TOLCVP.

7.3.2 Prioritization. The TCTO/TO verification schedule must be prioritized based on critical operational and maintenance tasks that affect safety, operational readiness and supportability of the system and commodity during initial deployment. Personnel, hardware, consumables and support equipment will be scheduled to ensure availability for each verification effort IAW TO

00-5-3.

7.3.3 Combining Contractor Certification and Verification. Contractor certification and

Government verification processes may be combined when the following conditions exist and the option is approved by the PM and MAJCOM:

7.3.3.1 Formally resolve the question of liability for damage to equipment or injury to personnel between the contractor and the Government before joint performance of procedures. The contractor is responsible for any damages or injuries caused by following faulty procedures.

Establish a negotiation process to resolve and document any disputes over liability during the combined effort (request assistance from the Contract Law Office if necessary).

7.3.3.2 Tasks should be reviewed for complexity and hazardous nature of the procedures. Highly complex or hazardous procedures should be certified by the contractor prior to delivery for verification. Each case must be evaluated and agreed upon by the PM and MAJCOM.

7.3.3.3 Personnel will perform the TO procedures with the guidance and assistance of contractor technicians. The procedures must be in TO final deliverable format.

7.4 Verification Team Manager (VTM).

7.4.1 Implement this TO Life Cycle Verification Plan (TOLCVP) for all verification team members, contractors and support personnel.

7.4.2 Serve as the focal point on all TO verification matters.

7.4.3 Assist TOMA as test site liaison as applicable.

7.4.4 Determine if all required systems, munitions, support/special equipment, and personnel are available to support each verification task listed on the TO verification schedule.

TOLCVP PAGE 7

7.4.5 Convene pre-verification meetings to plan actions and assign taskings.

7.4.6 Supervise TO verification to ensure maximum completion of TO verification prior to formalization.

7.4.7 Convene a post-verification meeting to discuss and resolve discrepancies.

7.4.8 Supervise the generation of Rapid Changes (RCs) resulting from verification and forward them to the TOMA or TORB/FTORB.

7.4.9 Chair meetings when requested as the TOMA representative.

7.5 Contractor Personnel.

7.5.1 Contractor Certification Requirements. Prior to the Government verification of TOs, the contractor shall be responsible for the certification of the TO development process; that is, for delivery of adequate, safe, current and accurate TOs which conform to Government requirements

IAW TO 00-5-3. The data must be fully compatible in depth and scope with the established maintenance concept and the approved logistics support plan. The data must be checked for security classification, distribution restrictions, and Reading Grade Level (RGL). The contractor may use any or all of the previously mentioned procedures as part of their TO certification process.

These requirements also apply to sub-contractors.

7.5.1.1 Performance Certification. When the proposed certification process includes task performance, the following guidance will be followed:

7.5.1.1.1 Nondestructive malfunctions may be introduced for the purpose of checking procedural and fault isolation tasks or systems tests. Procedures which could cause damage to the hardware or injury to personnel should be simulated.

7.5.1.1.2 Only support equipment listed in the TO should be used in testing procedures. The

TOMA/TCM will be consulted if substitution of support equipment is required. The contractor must identify and request any Government Furnished Equipment (GFE) required to support the

TO development effort. The TOMA will coordinate with applicable PMs, if necessary, to provide

GFE and ensure the equipment will be available to support the weapon system or commodity in the operational environment.

7.5.1.1.3 Locally fabricated tools or test equipment listed in the TO should be used during testing. Procedures for fabricating these items shall be included in the TOs.

7.5.1.1.4 Tasks will normally be performed at the contractor facility during system or commodity development testing. If required, and GFE is not available, tasks may be performed at an operational or test site when approved by MAJCOM, PM, or TCM managing activity. The contractor will coordinate requirements with any affected agencies.

7.5.1.1.5 When the contractor cannot perform some tasks due to non-availability of GFE resources, the TOMA shall be notified. The TOMA shall notify the MAJCOM who may provide the required resources (if available) to the contractor or suggest use of a field location. In some cases, combining contractor certification with Government verification may be authorized. As a last resort, the TOMA may authorize use of simulation or desktop analysis of the procedures.

7.5.1.1.6 Task performance or simulation may be unnecessary for existing manuals and source data that is applicable to the current configuration of the equipment, if a desktop analysis or publication review proves the manuals are current, adequate, accurate, and conform to contract requirements.

TOLCVP PAGE 8

7.5.1.1.7 The contractor shall notify the TOMA/TCM when the certification has been completed and the TOs are ready for verification.

7.5.2 The contractor shall provide a representative to the TORB/FTORB with contractor signature authority for technical updates.

7.5.2.1 Provide necessary support personnel at verification site(s).

7.5.2.2 Review each RC before TORB/FTORB discussion and be prepared to present the contractor position on the proposed update.

7.5.2.3 Assist in resolving problems with contractor equipment or TOs as a member of the

TORB/FTORB.

7.5.2.5 Prepare TO updates as required.

7.5.2.6 Verification. The contractor(s) will support and follow necessary verification steps within this plan, their tailored PWS, SOW, and/or TMCR.

7.6 Using and Participating Agencies.

7.6.1 See TOLCMP, paragraph 7.3.

7.6.2 Assign a 7-level or higher skill level to act as the VTM, to supervise the TCTO verification.

7.6.3 Assign the lowest skill level (5-level minimum) to perform the TCTO procedures exactly as written.

7.7 Technical Order Review Board (TORB).

7.7.1 The TORB shall conduct meetings as scheduled by the TOMA to take action on RCs as follows:

7.7.1.1 Review and approve/disapprove recommended updates.

7.7.1.2 If technical assistance is required, forward the RC as necessary for engineering/policy evaluation. After evaluation, the recommendations shall be returned to the review board for action.

7.7.1.3 Return reviewed RCs to the contractor for disposition.

7.7.1.4 Board members shall be prepared to discuss recommendations when the board convenes. Members or the chairperson may bring advisors to contribute to the consideration of a recommendation.

7.7.2 The TORB will recommend formalization of PTOs after verification has been completed to the maximum extent possible.

7.8 Flight TORB (FTORB. The FTORB performs the same functions as the TORB for

Flight Manuals. The FTORB must include at least three flight-rated members (AFI 11-215).

8 PROCEDURES FOR VERIFICATION.

8.1 Program Manager (PM). The PM has overall responsibility for the (Installation of

Degraded Visual Environment System (DVES) On HH-60G Helicopters) TO verification during kit proof. The PM will be assisted by the responsible TOMA, TCM and VTM.

8.2 Verification. Verification is the formal process by which Air Force personnel evaluate and prove TCTOs and TO updates during acquisition and sustainment are accurate, adequate, safe, and usable in the operational environment to support the program. Current Air Force policy requires that all tasks in TCTOs and TO updates be 100% verified and that all new and updated technical

TOLCVP PAGE 9

data be verified unless waived by the HH-60G PM. This includes data that has been formalized and is in the sustainment phase of the TO life cycle. Technical data for Contractor Logistics

Support (CLS) programs need not be verified unless the data will be used by Government personnel.

8.2.1 Scheduling. The TOMA, PM and MAJCOM will work with the contractor to develop a verification schedule that accounts for the overall availability of trained technicians and production configured assets to conduct verification. Furthermore, verifications should be completed in sufficient time to permit correction, publication, and distribution of formal TOs to field operations prior to or concurrent with delivery of the hardware and software to support Operational Test and

Evaluation (OT&E). When this is not possible, with command approval, use Interim Contractor

Support or authorize use of partially-verified PTOs until verification can be completed in accordance with TO 00-5-3. Additionally, the TOMA shall ensure the TOLCMP reflects the latest

TO verification schedule.

8.2.2 Use of PTOs during Sustainment. The TOMA, with approval from the PM in coordination with the Lead and Using Command, may issue a waiver to distribute PTOs to operational units or depot repair facilities for verification using production equipment. The use of preliminary data shall not exceed 180 days unless readdressed.

8.2.3 Partly-Verified TOs. The inability to verify certain specific maintenance procedures, such as aircraft wing or missile canister removal and replacement should not delay formalization and distribution of TOs. If a partly-verified TO is issued, the TO will include a Verification Status

Page (VSP) or screen, and the first field unit or depot facility required to use an unverified procedure will perform using command verification IAW TO 00-5-1. Other reasons for issuing partly-verified TOs include lack of equipment or other required support to perform verification.

When the destructive nature of the procedures prevents verification by performance, use simulation or desktop analysis IAW TO 00-5-3.

8.2.4 Participation. Participation in verification efforts by MAJCOM and other affected agency personnel is critical to the development of TOs. Verification activities will not be halted due to lack of attendance by other support agency personnel.

8.2.5 Contractor Support. Contractor support for the verification effort should be part of every contract for the acquisition and/or sustainment of TOs. The support usually consists of a writer and/or engineer. This support is required to minimize delays caused by faulty procedures, lack of spare parts, etc.

8.2.6 Verification Waivers. The TOMA, with approval of the PM, may waive verification by performance/simulation when procedures are similar to other, previously-verified procedures on like equipment. The waiver will be documented on the AFTO Form 27, Preliminary Technical

Order (PTO) Publication Change Request (PCR)/TO Verification Record/Approval, or on the form creating a TO update. Verification of minor updates to previously-verified procedures may be accomplished by simulation or Desk-Top Analysis, whichever the TOMA and TCM deem more appropriate, without a waiver.

8.2.7 Use of Substitute Items. The TOMA or VTM may authorize the use of substitute equipment, facilities, or draft procedures. This authorization may be given when the required items are not available and there will be no appreciable difference in procedures. Any such substitution must be coordinated and documented on the AFTO Form 27, the form creating a TO update or in the verification minutes.

TOLCVP PAGE 10

8.2.8 Verification Methods. Verification can take any one or a combination of three acceptable methodologies for accomplishment, depending on the type of equipment or instructions being verified. Verification of Electronic Technical Manuals (ETM) and Interactive Electronic

Technical Manuals (IETM) S1000D based TOs must be performed on the Maintenance Data

Digital Viewer (MDDV) electronic viewing device or e-tools designated for use.

8.2.8.1 Performance. Actual performance on production-configured hardware or Government-approved inert versions (for explosive items) is the only acceptable means to verify certain tasks.

Tasks to be verified by performance include, but are not limited to, all operating and maintenance procedures.

8.2.8.2 Simulation. In some instances, actual hands on demonstration of procedures duplicates similar tasks already demonstrated, needlessly subjects equipment to damage, activates one-time items such as Electro-Explosive Devices (EED) or exposes the technician to personal injury. In these cases, the procedures may be simulated by observing the operational configuration of the equipment while studying the task to ensure that procedures are logical, effectively descriptive and can be accomplished.

8.2.8.3 Desktop Analysis. Desktop analysis involves side-by-side comparisons of source data with TO data (text, links, illustrations, etc.). Non-procedural data and any procedural data where verification by performance/simulation has been waived will be verified by desktop analysis.

Desktop analysis is usually performed during IPRs or (especially during sustainment) pre-publication reviews. When an IPR is waived or new data is incorporated after the IPR, a separate desktop verification will be required. Illustrated parts breakdowns (IPB), Illustrated parts data

(IPD), theory of operation, and other non-procedural data may be checked by desktop analysis during IPRs.

8.2.9 Verification Site. The site selected for any particular verification effort will be jointly determined by the TOMA/TCM and MAJCOM/Depot Maintenance Activity, based on the availability of support functions, the type of procedure being verified, the level of maintenance, etc. The site should provide facilities as similar as possible to the operational locations where the

TO procedures will be used.

8.2.10 Verification Team Manager (VTM). The TOMA or TCM shall act as, or request that the

MAJCOM appoint a VTM to control verification. Specific roles and responsibilities of the VTM shall be documented in this plan. The VTM will coordinate with all affected agencies to ensure the availability of facilities, equipment and personnel to conduct the verification. When the data or procedures are delivered and all required hardware, support equipment, personnel, supplies and data are available, the VTM will schedule and supervise the verification effort, including pre- and post-verification meetings.

8.2.10.1 Pre-Verification Meeting. The VTM will conduct a pre-verification meeting with the verification team to ensure team members are aware of responsibilities and duties. Subjects to be covered during the meeting include the maintenance concept, any reference documentation available, the specific TOs and procedures to be verified, safety precautions, documentation required and individual team member assignments. Team members will review the procedures prior to beginning any task verification.

8.2.10.2 Verification Tasks. The VTM will supervise the actual verification effort. The VTM will make every effort to resolve problems on-site to prevent delaying or canceling verification.

Checklists will be verified simultaneously with the parent manual. An AFTO Form 82 will be completed to reflect the verification of the TCTO. A separate AFTO Form 27 will be completed

TOLCVP PAGE 11

on each TO or portion of a TO and checklist verified to document discrepancies and the overall results of the verification. The TO VSP (if required) will be updated to reflect the verified status.

Verification of TO updates may be recorded on the document creating the update (AFTO Forms

27, 82, or AF Form 847). Verification of ETM and IETM S1000D based TOs must be performed on the MDDV or electronic viewing devices (e-tools) designated for use and shall be documented utilizing the AFTO Form 27. Specific verification tasks include:

8.2.10.2.1 Performing the procedures to verify usability by personnel with the planned skills and training, ensuring the arrangement of material and method of presentation support the operations or maintenance concept.

8.2.10.2.2 Observing and reporting any safety violations or hazardous conditions. STOP operations if necessary.

8.2.10.2.3 Performing TO RGL computations, if not documented by the contractor on newly developed TOs.

8.2.10.2.4 When a new TO is developed organically or when updates meet the criteria specified herein, Government personnel will document RGL checks using the AFTO Form 124, Computation of Technical Order Reading Grade Level. A copy of the AFTO Form 124 or contractor equivalent will be included in the TO documentation package for each TO maintained by the TOMA.

8.2.10.2.5 RGL computations may be computer-generated or performed manually using any accepted computation procedure. The actual RGL can be computed automatically by many word processing and publishing software packages. If online resources are used, the web address and method used should be included in the RGL documentation for review and filing. Computations will be reviewed during IPRs.

8.2.10.3 Verification of the IETM data modules utilizing the MDDV, will ensure all Warnings, Cautions, Notes, illustrations, functionalities and links are contained in the IETM and that all links are executable. During the performance of the verification effort, the verification team shall perform tasks in accordance with appropriate TOs and the following instructions:

8.2.10.3.1 Read aloud the step to be performed.

8.2.10.3.2 Perform the step. For IETMs, use the appropriate links to access additional information for the task.

8.2.10.3.3 Annotate discrepancies in the Government master copy of the TO. For IETMs, use an internal bookmark function when available.

8.2.10.3.4 The contractor shall note discrepancies in the contractor master copy and shall advise and assist in the preparation of RCs to correct the discrepancies.

8.2.10.3.5 Participating agency representatives shall coordinate on discrepancies and corrective actions during the post- verification meetings.

8.2.10.3.6 Ensuring all actions and suggested or required TO changes are fully documented.

8.2.10.3.7 Contractor shall use the master copy and the TORB/FTORB-approved RC to incorporate the recommended updates in the TO.

8.2.10.3.8 The VTM shall maintain a master copy of the TO and TO updates from the contractor. A new RC shall be submitted to the contractor when verification comments are not fully incorporated or adequately rebutted.

8.2.10.4 TORB/FTORB approved changes and recommendations for improvements shall be forwarded to the contractor.

TOLCVP PAGE 12

8.2.10.5 Disapproved recommendations shall be returned to the originator with reason for disapproval.

8.2.10.6 Unresolved or contractual issues shall be sent to the TO Manager for disposition.

8.2.10.7 When a PTO is determined to be suitable for use, the TORB/FTORB shall approve or disapprove the AFTO Form 27 recommendation and send the form to the TOMA. The VTM or

TORB/FTORB shall advise the TOMA on the need for a pre-publication review.

8.3. Verification Updates. The TOMA must ensure updates due to verification are accomplished on an expedited basis. Expedited updates should be restricted to those of a technical nature affecting operation and maintenance procedures. Expedited editorial changes will be restricted to those affecting comprehensibility. Changes based on personal preference must be submitted through the normal TO change process.

8.3.1 Verification Teams’ Membership. The following paragraphs outline the verification teams’ membership.

8.3.1.1 Flight TO Verification Team Organization. This verification team will consist of the

TOMA, FMM, VTM and flight operations personnel selected by ACC Directorate of Operations

(A3). The VTM will be appointed IAW this plan, in coordination with HQ AAC/A3, to supervise the team members during verification of TCTO and associated TO changes. This team will be supported by contractor personnel as outlined in the TMCR. Verification will be conducted at a site mutually agreed upon by the MAJCOM, Using Command and the PM.

8.3.1.2 O-Level, D-Level (Maintenance) TO Verification Team Organization. This verification team will consist of the TOMA, TCM, VTM and maintenance personnel selected by ACC

Directorate of Logistics (A4). The VTM will be appointed IAW this plan, in coordination with

HQ ACC/A4, to supervise the team members during verification of TCTO and associated TO changes. This team will be supported by contractor personnel as outlined in the TMCR. The

Verification will be conducted at a site mutually agreed upon by the MAJCOM, Using Command and the PM.

8.4 TORB & FTORB.

8.4.1 The TORB shall conduct meetings as scheduled by the TOMA to take action on RCs for the verification as follows:

8.4.1.1 Review and approve/disapprove recommended TO updates.

8.4.1.2 If technical assistance is required, forward the RC as necessary for engineering/policy evaluation. After evaluation, the recommendations shall be returned to the TORB for action.

8.4.1.3 Return reviewed RCs to the contractor for disposition.

8.4.1.4 Board members shall be prepared to discuss recommendations when the board convenes. Members or the chairperson may bring advisors to contribute to the consideration of a recommendation.

8.4.1.5 The TORB will recommend formalization of PTOs after verification has been completed to the maximum extent possible.

8.4.1.6 The FTORB performs the same functions as the TORB for Flight Manuals Program manuals.

TOLCVP PAGE 13

8.4.1.7 The FTORB must include at least three flight-rated members (AFI 11-215).

8.4.2 Post-Verification Meeting. The VTM will conduct a post-verification meeting to resolve any problems, generate the minutes, and assign action items as required. VSPs will be updated as required. The Verification Record section of an AFTO Form 27 or 82 will be used to document any discrepancies found in the TO or procedures during verification, and recommend either further verification or formalization of the TO. The form will be submitted to the TOMA

(or TORB/FTORB) for approval. When approved by the TOMA or TORB/FTORB, the AFTO

Form 27 or 82 recommending formalization will be used as authority to prepare the formal TO.

Discrepancies found during verification of TO updates may be recorded on the document creating the update.

8.4.3 Verification Review Boards. All comments and changes developed as a result of verification must be approved by a review panel, normally a TORB or FTORB, prior to incorporation in the TO. This review panel should consist of personnel from activities involved in the acquisition or modification program, as determined by the TOMA and documented in the

TOLCVP, including verification team members and the contractor. The flight manual review panel must include at least three rated officers. After review, coordination and approval, the changes will be sent to the contractor for update of the TO involved, and if verification was completed successfully, preparation of the formal manual. Review boards are not required for TO updates provided the Chief Engineer (CE) approves the changes.

8.4.4 Verification Documentation. Each verification effort requires complete documentation, including minutes and any forms generated. For concurrent contractor/government testing, contractor records will be included with verification documentation. Verification activities and results of TOs under development or being updated as part of a modification program will be documented using an AFTO Form 27 or 82. (See TO 00-5-3, Chapter 4 for verification during sustainment). The TOMA will maintain a file of all verification documentation issued for the life of the TO covered.

9 PROCEDURES FOR QUALITY ASSURANCE (QA).

9.1 QA is the process by which the contractor and Government ensure TOs and source data are technically accurate, adequate, safe and readily understandable. The contractor QA program will be specified in the Integrated Master Plan (IMP). The primary Government QA process is verification IAW TO 00-5-3. QA may include process controls which include actual task performance, simulation (when performance could cause hazards to personnel or equipment) or desktop analysis (for non-procedural data). TO source data QA shall be performed effectively and efficiently while being integrated.

9.2 The contractor QA process will be specified within the contractor’s tailored PWS, SOW, and/or TMCR.

10 ADMINISTRATIVE PROCEDURES.

10.1 RC and Comment Sheet Control and Tracking. (See contractor’s tailored PWS, SOW, and/or TMCR)

10.2 AFTO Form 27, Preliminary Technical Order (PTO) Publication Change Request

(PCR)/TO Verification Record/Approval. (See contractor’s tailored PWS, SOW, and/or TMCR)

TOLCVP PAGE 14

10.3 AFTO Form 82, TCTO Verification Certificate. (See contractor’s tailored PWS, SOW, and/or TMCR)

10.4 Verification Records. (See contractor’s tailored PWS, SOW, and/or TMCR)