Attachment 9 Quality Assurance Surveillance Plan.docx

14 Flying Training Wing AETC Maintenance Authority

COLUMBUS AFB MS 39710

Quality Assurance Surveillance Plan (QASP)

AIRCRAFT MAINTENANCE CONTRACT (FA3002-11-R-0007)

COMPLIANCE WITH THIS PUBLICATION IS MANDATORY

OPR: 14 FTW/MAQ

Certified by: 14 FTW/MA Supersedes 14 FTW/MAQ OI 21-1 Dated ________________ Pages:

Section I ---Performance Assessment Planning & Preparation Page

Section II --- Performance Assessment

Section III --- Performance Assessment Results Analysis

Section IV --- Performance Assessment Reporting

Section V --- Performance Assessment Follow-up

Section VI ---Performance Assessment Report Closure

I. Performance Assessment Planning & Preparation

1. Responsibilities. The Contracting Officer Representative (COR) function is responsible for a wide range of surveillance requirements. To that end, the objective of this QASP is to establish responsibilities, and methods that will provide the COR a planned process that will effectively measure contractor performance, determine conformity with requirements of the contract, and initiate corrective action requests for substandard performance and/or unfavorable trends. The key COR contribution is comprised of professional, non-adversarial relationships, which include positive and open communications with the Administrative Contracting Officer (ACO), Functional Commander (FC), Chief COR, CORs, and the contractor. The foundation of this relationship is built upon objective, fair, and consistent COR evaluations of contractor performance against contract requirements, and the ability to discuss inspection results, trends, and items of mutual interest with the Contractor. CORs may meet periodically with the contractor to exchange information and discuss items of importance. The meeting may be conducted in a group setting or members of leadership only. Topics of discussion may include, but are not limited to, information from staff meetings, safety, noted weak/problem areas, standardization in surveillance technique/procedures, inspector problems, and any reported customer complaints. To ensure adequate surveillance coverage, a primary and alternate COR will be assigned for each surveillance area. The COR uses methods in this QASP to achieve this goal.

1.1. Functional Commander Responsibilities. The FC is the government’s functional authority for the contracted function. The FC retains all responsibility for the success or failure of the contracted function, the same as if the contracted function was an organic activity. The functional area includes all maintenance activities as defined in the contract. In addition to the duties and responsibilities outlined in MP 5301.695-2(d), the FC shall be responsible for those duties and responsibilities outlined in AFI 21-101 & AETC Supplement.

1.2. Administrative Contracting Officer Responsibilities. The ACO is the ONLY individual with the authority to enter into and modify government contracts. The ACO, with contracting staff, works closely with the functional area in developing requirements to include establishing a clear and enforceable PWS and QASP. The ACO delegates quality assurance responsibilities to CORs, giving them the authority to formally evaluate and accept contractor services. In addition, the ACO reviews the Contractors’ quality control plan for acceptance with input from COR. Finally, the ACO provides the FC with input as to how well COR’s are able to perform the quality assurance function.

1.3. Chief COR Responsibilities. The Chief COR is directly responsible to the FC. The Chief COR will ensure surveillance of the contractor’s performance and report findings to the FC and ACO.

1.3.1. Specifically, the Chief COR will ensure the responsibilities identified in AFI 21-101 & AETC Supplement, this QASP, and those delegated by the FC are met.

1.3.2. In coordination with the FC and ACO, clarifies issues between CORs and the Contractor concerning the validity of documented discrepancies.

1.4. COR Superintendent Responsibilities. The COR Superintendent is directly responsible to the Chief COR to ensure the complete implementation of AFI 21-101 & AETC Supplement, and this QASP. The Superintendent is responsible for:

1.4.1. Assisting the Chief COR with tasks associated with responsibilities delineated in AFI 21-101 & AETC Supplement.

1.4.2. Performing the duties of the Chief COR in his/her absence.

1.4.3. Assisting the Chief COR, FC and ACO, with clarification of issues between CORs and the Contractor concerning the validity of documented discrepancies.

1.5 Lead Inspector Responsibilities. In addition to those COR responsibilities identified in AFI 21-101 & AETC Supplement, the Lead Inspector will be responsible for leading the COR function in the implementation of the QASP by all CORs. The Lead Inspector will:

1.5.1. In coordination with the Analysis COR, formulate a draft copy of the monthly inspection/Assessment schedule based on requirements contained in AFI 21-101 & AETC Supplement and this QASP.

1.5.2. Focus COR efforts, and standardize surveillance and documentation methods.

1.5.3. Evaluate COR qualifications and identify to the Chief COR individuals for specialty and cross-utilization training and additional proficiency training.

1.5.4. In coordination with the Analysis COR, perform oversight of formulation of the draft copy of the monthly summary of COR surveillance activities in accordance with (IAW) AFI 21-101 & AETC Supplement, this QASP and coordinate with the Superintendent, Chief COR, and FC prior to submission of the report.

1.5.5. Lead Inspector will review previous day COR discrepancies contained in the COR data base and Contractor Quality Control (CQC) inspection data.

1.6. COR Responsibilities. COR responsibilities are identified in AFI 21-101 & AETC Supplement, and this QASP. Individual areas of responsibility are identified in this QASP, appointment letters, and designated COR computer drive.

1.6.1. CORs are the “eyes and ears” of the FC and ACO relative to the actual implementation of the contract; however, they are not a quality control function. CORs will not direct work, direct the re-accomplishment of work, assist the contractor during maintenance, advise the contractor on how to perform maintenance, change the contract, or formally interpret the contract. The ACO resolves these types of issues.

1.6.2. CORs will maintain technical competency in their primary and alternate functional areas, maintain proficiency in contract surveillance techniques, and assist with formulating the PWS and observation area inspection guides. CORs will accomplish contract surveillance by evaluating and documenting Contractor performance and inform the Chief COR and COR Superintendent when Contractor performance does not meet performance thresholds or there is a negative trend developing.

1.6.3. In coordination with the Lead Inspector, the Analysis COR will compile performance data, analyze and formulate a draft monthly summary of COR surveillance activities. After coordination and approval, the Analysis COR will distribute the monthly summary IAW AFI 21-101 & AETC Supplement.

1.6.4. The Analysis COR performs evaluations of statistical information provided by the Contractor relating to mission performance thresholds and coordinates with Lead Inspector, COR Superintendent, Chief COR and FC for final validation and signature.

1.6.5. The Government Furnished Equipment/Property (GFE/P) Monitor COR will monitor/surveil the Contractor GFE/P management program to include processes for purchase, control/disposal of GFE/P and perform review of contractor monthly updates. The GFE/P Monitor COR will review contractor requests for GFE/P and verify/ensure a valid requirement exists prior to concurring with the request. Upon request from the GFE/P Monitor COR, other CORs with subject matter expertise will assist with special requests and, if required, assess and verify Contractor requirement.

1.6.6. All CORs will be issued a COR number stamp by hand receipt and tracked by the superintendent on the COR stamp roster. The stamp will be used on AFTO Forms to identify discrepancies/request checks noted by COR inspectors. The stamp will be returned when the COR is no longer assigned to the work center.

1.7. COR Training. Training will be conducted IAW the COR training plan and consist of the mandatory requirements identified in IAW AFI 21-101 & AETC Supplement and requirements locally determined by the FC, Chief COR and Superintendent. Individual training records will be maintained IAW AFI 21-101 & AETC Supplement & AFI 36-2201, Vol. 3.

1.7.1. Newly assigned CORs must complete DAU COR 222, Contracting Officer’s Representative course and CLM 003, Ethics Training for Acquisition Technology and Logistics, Phase I, General COR Orientation Training and Phase II, Contract Specific training prior to performing surveillance.

1.7.2. The AETC COR School (Course 393AETC0066-002) will be scheduled for newly assigned COR as soon as possible and must be successfully completed no later than 90 calendar days after assignment to COR duties.

1.7.3. To ensure adequate coverage, CORs are also trained in areas of responsibility, and duties outside their normal AFSC by cross utilization training (CUT). AF & AETC directives and technical orders will be used to complete on the job training (OJT) in areas where the individual COR lacks extensive knowledge. Alternate CORs will maintain currency on those evaluation guides they are assigned as alternate inspector.

1.7.4. Newly assigned COR’s will study the required directives and perform the observation guide under the supervision of a qualified trainer before being certified in a specific area. The trainer will conduct OJT until the new COR demonstrates satisfactory knowledge of each work area and surveillance techniques. Training will be documented on Individual Training Plan (ITP) in the automated Training Business Area (TBA).

1.7.5. All CORs, Superintendent and Chief COR will complete the periodic refresher and recurring training prescribed by AFI 21-101 & AETC Supplement. The FC /Chief COR will ensure required TDY funding is projected in the unit budget.

1.8. Surveillance Methods. CORs will evaluate contractor performance using the basic periodic surveillance method, augmented with guidance contained in AFI 21-101 & AETC Supplement, terms contained in the contract and this QASP. This method provides periodic evaluation of selected tasks (services) performed by the contractor. These tasks include actual aircraft/equipment maintenance tasks (Technical Inspections) and management of organizational work-centers (Observation Area Inspections). Minimum task and frequency of evaluations are identified in AFI 21-101 & AETC Supplement and this QASP. Examples of these tasks are: CORs will perform a minimum of one Technical Evaluation of contractor performed T-1, T-6,and T-38 Periodic Inspection each month and will perform Area Observation of the T-6 Flight line, Avionics Back shop, Egress, and Munitions each quarter. Note: Performance Assessment (surveillance) procedures/processes are further addressed in Section II of this QASP.

1.8.1. Inspections (Technical or Observation Areas) may be scheduled, unscheduled, or as observed; however, only scheduled inspections (IAW AFI 21-101 & AETC Supplement, and QASP) may be used to determine or apply a rating for acceptable performance according to contract standards. Unscheduled inspections are specific inspections CORs perform outside or above the inspections listed in the schedule.

1.8.1.1. Technical Inspections (TI). Any maintenance task accomplished in accordance with technical guidance, (TO, work-card, etc.) qualifies for COR surveillance under the technical inspection concept. Inspections may be performed over the shoulder or after the fact. CORs perform TIs on all aircraft, engines, support equipment, associated forms documentation and Maintenance Information Systems (MIS). Inspections will be accomplished as specified in AFI 21-101 & AETC Supplement, this QASP, contract, and the monthly schedule. CORs will perform scheduled Technical Inspections at the first available opportunity, taking in consideration COR workload. Each COR is responsible for ensuring that their assigned inspections are completed no later than the last day of the month.

1.8.1.2. Observation Area Inspections. These inspections are similar to IG inspections, where CORs assess the contractors work centers/areas ability to manage program areas they are contractually responsible for. Minimum observation work area surveillance requirements are established in AFI 21-101 & AETC Sup, and this QASP. To ensure complete and comprehensive surveillance, each area is covered by a work center specific Observation Guide and a General Guide. The Munitions COR will ensure the critical items required by AFI 21-101 & AETC Supplement, are incorporated in the Munitions Evaluation Guides.

1.8.1.2.1. Administration and Planning. Observation Guides will be maintained on the designated COR computer drive and will be reviewed and updated annually by the CORs. Baselines for Observation Areas have been developed in accordance with AFI 21-101 & AETC Supplement, this QASP and included in Attachment I of this QASP. The ACO will notify the contractor of COR inspection baselines by an official memorandum. COR’s area of responsibility (Observation Area Guides) will be assigned by appointment letter and approved by the Chief COR or COR Superintendent.

1.8.1.2.1.1. Observation Area Guide Changes. Required updates, changes, additions and deletions, may be accomplished as needed, to include while in-use during surveillance. Sources of material for changes will be current directives, The Inspector General (TIG) Briefs, noted weak/problem areas, incoming correspondence, IG reports, etc. The Chief COR or Superintendent will approve all changes to Observation Guides. Updated copies of guides will be provided to the ACO.

1.8.1.2.1.2. General Guide. The General Guide contains the minimum requirements listed in AFI 21-101, AETC Supplement, and PWS and applies to all work centers. The General Guide includes requirements to regularly, sample supply management aids for evidence of proper supply discipline and effectively monitor compliance with the contractor’s training plan. The General Inspection Guide also establishes procedures to effectively monitor the contractor’s compliance with federal, state, and local laws as well as DOD and Air Force directives, the installation’s applicable environmental plans, programs, and vehicle condition. The General Guide will contain those Work Area Inspection Critical Items prescribed by AFI 21-101 & AETC Supplement. The Chief COR will approve material or items to be included in guides.

1.8.1.2.1.3. Local Observation Guides. In addition to mandatory observation guides, locally determined guides will be developed to cover local organizational arrangements and services not delineated in AFI 21-101 & AETC Supplement. These guides are identified by alpha characters. See attachment I of this OI for inspection frequencies and baselines. Local guides, AB – AFREP Mgt and AC- GOV Property, will be accomplished by surveilling the office responsible for these programs and a random sampling of shops that are involved with the program.

1.8.1.3. As-Observed Inspections. These inspections are considered unscheduled inspections. They are discrepancies that are observed by COR and are not part of the specific inspection performed, whether it is scheduled or unscheduled. They occur when discrepancies are observed or discovered that are not directly associated with another inspection. As Observed (ASOB) identified discrepancies do not determine levels of performance of the contractor, but are used to identify an existing concern/problematic issue.

1.8.1.3.1. CAT II Minor Discrepancies. CAT II minor discrepancies are obvious minor defects that could have been readily detected by the technician/supervisor, but are not considered to be a specific workcard item or TO step and do not count against the Acceptable Quality Levels (AQL). CAT II minor discrepancies will be identified on the AETC Form 447 that the inspection was annotated on and loaded in the CAT II discrepancy database. CAT II minors will be tracked for trends by the analysis COR each quarter. Any trend identified may result in increased surveillance in the identified problem area.

1.8.1.4. Customer Complaints. This method provides customer feedback (complaints) using a locally devised Customer Complaint Record. CORs validate the complaint against contract requirements; valid complaints are routed to the Contractor for resolution. These forms become a permanent part of COR surveillance records.

1.9. Surveillance Schedule Preparation. Technical and Observation area surveillance will be programmed into a monthly surveillance/assessment schedule to meet the minimum inspection requirements established in AFI 21-101 & AETC Supplement, and attachments to this QASP. If any area is/has had concerns or problematic issues, additional surveillances, above minimum requirements should be scheduled IAW AFI 21-101 & AETC Supplement. Adjustments will be annotated in the monthly Summary of Contractor Services. It is discouraged to accomplish 100 percent surveillance unless it is a critical safety issue and should not be scheduled for an extended period of time. Work schedules/duty hours for the COR workforce (military and civilian) will be developed and posted in the COR Section. Work schedules will ensure surveillance coverage of all contractor performance periods. Due to potential conflicts in data tracking between the aircraft maintenance contract and the COMBS contract, the COMBS (T-1, T-6, & T-38), COR will be responsible for scheduling and data tracking separately from the aircraft maintenance contract.

1.9.1. Draft Schedule. The Analysis COR in coordination with the Lead Inspector will be responsible for development and coordination of a monthly schedule in accordance with time lines specified in AFI 21-101 & AETC Supplement and this QASP. The Analysis COR will coordinate a draft monthly schedule with CORs, Lead Inspector, Superintendent, Chief COR, FC and ACO, before finalization of the schedule. ACO coordination on the draft schedule is required to determine ACO surveillance of the COR and the coordinated schedule dates will be entered for those inspections required by the ACO. To minimize schedule disruption due to adverse weather, flying schedule changes and work load changes; all other observation guides will be considered open and will be accomplished in the applicable month and will not have dates entered. The Analysis COR will formulate and maintain a tentative long range yearly schedule for Observation Guides to assess contractor’s performance and prevent predictability.

1.9.1.1. Contractor Quality Control (CQC) follow-up Technical Inspections will be scheduled monthly. CQC TI’s will be identified as “CQC TI’s” on the schedule. The number of Technical CQC TI’s scheduled will equate to no less than 12 percent of regularly scheduled aircraft and equipment technical inspections. The Chief COR will identify specific CQC follow up inspections to be accomplished each month and annotate them on the monthly schedule in the CQC follow up section of the schedule. These inspections may be adjusted as necessary.

1.9.1.2. A minimum of one work center evaluation will be scheduled and accomplished behind CQC each month. The Lead Inspector will coordinate with CQC to obtain information on planned CQC Area Walk through/Observation Area inspections and assign a COR to perform the CQC Observation Guide as appropriate. The contractors CQC guide, the appropriate COR Observation Area Guide and the COR General Guide will be used in the evaluation. Government baselines will apply.

1.9.1.3. The Weekend Duty Observation Area Guide is performed once each month. To accommodate planning for contingencies, weekend flying, holidays, and heavy cross country returns, the monthly schedule will reflect the dates of the weekend surveillance. The normal weekend duty work day will be on Sunday however, weekend duty surveillance may be conducted any time the contractor performs services. CORs will perform weekend duty on a rotational basis. CORs will perform, as a minimum, one security check of flight line and hangar areas. An open scheduled TI may be accomplished to sample maintenance being performed on weekends.

1.9.1.4. Each COR will review the schedule for their areas of assigned inspection responsibility and make necessary inputs to ensure no areas are missed and inspections are performed in a manner that prevents predictability. Primary CORs are responsible for coordinating any planned absences with the alternate COR to prevent schedule disruption and/or missed surveillance. Ultimately, it is the responsibility of all CORs to ensure that all required inspections are accomplished.

1.9.1.5. During development of the draft schedule, contractor functional areas receiving non conformance ratings in previous surveillance periods will be identified to the Chief COR. Based on provisions in AFI 21-101 & AETC Supplement and the Performance Assessment Analysis Section of this QASP, surveillance activities may be adjusted with the approval of the FC and ACO. No observation area will be considered for reduced surveillance for more than one prescribed surveillance period (monthly/quarterly) in any option year.

1.9.2. Final Schedule. Upon completion of draft schedule coordination, the Analysis COR/Lead Inspector will incorporate all changes and coordinate a final schedule with the Chief COR. The Chief COR will perform a final review and send to the FC not later than 5 duty days prior to the beginning of the period it covers for approval. After receipt of approved schedule, the Analysis COR/Lead Inspector will provide a copy to the ACO before the start of the surveillance period and place the original in the COR Inspection Log Book. The Chief FCF pilot will be notified of scheduled, no notice engine run evaluations and FCF technical inspections.

1.9.3. When additional special inspections (Technical) are required during the month (above those scheduled as “open”), to meet requirements in AFI 21-101 & AETC Supplement (such as TCTOs, AETC Special Inspections, Performance Assessment Follow-up, or Local Special inspections), they will be manually added to the COR inspection schedule. These additions will include a brief justification and will be coordinated through the Chief COR, or Superintendent then forwarded to the ACO for coordination/approval and then courtesy copied to the FC. Each of these inspections will be considered unscheduled inspections per AFI 21-101 & AETC Supplement and will be annotated on the monthly contract services summary.

1.9.4. Other proposed changes to the approved monthly surveillance schedule will be coordinated, as they occur, with the Chief COR, FC and forwarded to the ACO for review and concurrence. If approved, manual changes will be made on the signed monthly schedule and will include a brief justification and be addressed in the monthly summaries. This process will be used to increase surveillance (AFI 21-101 & AETC Supplement) in poor performance areas after the monthly schedule is finalized and being executed. These will be considered as unscheduled inspections per AFI 21-101 & AETC Supplement.

1.10. Cost Reimbursable Items. The FC will appoint a primary and alternate COR, by letter, to conduct appropriate research/validation for all contractor claims/invoices/vouchers and travel expenses.

1.10.1. Travel. The appointed COR will ensure the expenses are valid and in accordance with the contract, current Joint Travel Regulations and other regulatory guidance as applicable prior to inspecting invoice.

1.10.2. Monthly Payment Invoices. Using Wide Area Work Flow system (WAWF), the Chief COR and Superintendent will ensure costs are validated in coordination with the ACO, ensure proper CLIN assignment, proper Cost Center, Funds Cite and Accounting Classification Reference Numbers (ACRN) are used.

1.11. Contractor Proposals. When tasked by the HQ AETC Program Manager, the responsible COR will assist with evaluation of all contractor proposals affecting their assigned area and when required, formulate a "Government Estimate" for contractor proposal comparison/evaluation. COR Government Estimates and Evaluations will be documented and reviewed by the Chief COR and Superintendent prior to being forwarded to the FC, ACO and Program Manager.

1.12. Value Engineering Proposals. This program is an incentive plan that encourages civilian maintenance contractors to develop and engineer new and innovative ways to save the government money. By submitting cost-reduction methods to the government under the value engineering program, contractors can help the government cut costs and, at the same time, share in the savings. See AFI 63-101, Acquisition and Sustainment Life Cycle Management, and maintenance contracts for submission criteria and procedures for value engineering change proposals.

1.12.1 When requested to review contractor-submitted value engineering change proposals (VECP), the Chief COR will either review or assign the most qualified COR to review the proposal for technical accuracy and provide a recommendation for adoption IAW AFI 63-101, Acquisition and Sustainment Life Cycle Management and FAR 48.103, 48.104 and 48.105 as applicable. After the evaluation, the proposal will be fully coordinated with other agencies, as applicable. All proposals will be evaluated, coordinated as applicable and returned to the contracting officer within the prescribed time limits.

II. Performance Assessment

2. Surveillance/Assessment. It is essential that CORs accomplish sufficient in-depth inspections in all areas to measure the quality of contractor performance and provide an effective measurement/assessment to ensure overall performance meets contract requirements. Compliance with applicable directives prescribed by the PWS, Contract Sections, and contractor-developed plans/regulations will be part of the surveillance. The Lead Inspector will review the previous days COR/CQC report data. Maintenance data will be reviewed for accuracy, and adverse trends. Contractor performance and mission reports, higher headquarters logistic reports, and AETC maintenance summaries will be reviewed for possible indications of negative trends. In addition, previous COR inspection reports/data will be checked for repeat or recurring discrepancies. During daily reviews of COR reports, the Lead Inspector will brief all CORs on any previous day’s discrepancies that are determined to be of a serious nature and require further action.

2.1. Technical Inspections (TI). TI's consist of 7 sub-inspection items that will be accomplished to the maximum existent possible; (a) aircraft/equipment checks, (b) aircraft/equipment forms checks, (c) Maintenance Information Systems (MIS) checks (applicable to the job being surveilled), (d) tech order currency and proper usage, (e) proper tool usage and accountability, (f) individual training records checks, (g) after maintenance FO checks. Discrepancies found in these areas are considered part of the TI and counted in the basic TI baseline.

2.1.1. MIS/ Forms discrepancies that, in the judgment of the COR, are not clearly associated with the TI will be identified separately as an AS OBSERVED.

2.1.2. CORs will use Technical Orders (TO) while performing surveillance. Technical inspections are limited to the same TO/work cards/checklist required for the task. CORs must inspect at least 50 percent of the task/inspection items for the task/area selected for evaluation. Contractor personnel must have TO’s at the job site and opened to the page for reference as required. Work cards must be open and referred to as each inspection item is accomplished. Checklists must be open, in-hand, and items performed in the prescribed sequence. Exceptions to this policy are launch/recovery checklists which must be in the immediate area of the aircraft parking/launch spot.

2.1.3 Aircraft Periodic Inspection (PE) TI's are normally inspected by area, and one or more areas may be inspected, but CORs must inspect at least 50 percent of the inspection items for each area selected.

2.1.4. While performing aircraft TI’s, FO discrepancies are defined as any object/extraneous matter (hard or soft), which has the potential to damage or interfere with operation of aircraft equipment. Further clarified; FO in an aircraft will always result in an non-conformance rating if the FO is near/has the potential to migrate to control rods, cables, actuators, hinges or any other operating mechanism, or the FO is conductive and has the potential to migrate into electrical/electronic components.

2.1.5. Contractor Training Program Technical Evaluations. The COR will perform Technical Inspections to effectively monitor compliance with the contractor's training plan to ensure that training provided meets applicable qualification and training standards. CORs will place special emphasis on the adequacy of the training provided. In addition to the rating criteria listed in AFI 21-101 & AETC Supplement, discovery of the following conditions will be categorized as a major discrepancy; failure of trainer to identify and explain critical elements of a task being taught; failure of trainer to properly document aircraft and equipment forms; failure of trainer to practice/demonstrate proper FOD control procedures; failure of trainer to use proper Tech Data and test compromise. Surveillance will include a random monthly over-the-shoulder observance of task qualification and certification training, to include training associated with special certification tasks and a random monthly over-the-shoulder observance of recurring maintenance training requirements. In addition, the surveillance will include a review of training documentation, individual training records, and plans of instruction.

2.1.6. During the performance of task certification/qualification training TIs, the following discrepancies will be categorized as major discrepancies; failure of trainer to identify and explain critical elements of a task being taught; failure of trainer to properly document aircraft and equipment forms; failure of trainer to practice/demonstrate proper FOD control procedures; failure of trainer to use proper Tech Data or test compromise.

2.1.7. TI Minor Discrepancy Baselines. A non-conformance rating will be assigned when the number of minor discrepancies exceeds the baseline of a like inspection contained in the PWS. If no like inspections exist then a non-conformance rating will be assigned when the number of discrepancies exceeds 3. TCTO baselines will be determined during the TCTO planning meeting. (NOTE: If the baseline for a like inspection is less than 3 then the like inspection baseline will apply).

2.1.7.1. Documentation File Baseline. Evaluation will include a review of MIS. A non-conformance rating will be assigned when a major discrepancy or more than three minor discrepancies for each ten pages (e.g., 1 to 10 pages. three minors; 11 to 20 = six minors) is discovered. The Chief COR may lower the minor discrepancy baseline for support equipment.

2.2. Foreign Object (FO) Inspections. Foreign object inspections are performed as part of technical inspections on aircraft, engines, equipment, Observation Area Inspections and independent area FOD Walk inspections.

2.2.1. FO walks will be performed no later than 30 minutes after Contractor has performed their FO walk in the following areas:

· Zone 1 – T-1 Flight Line

· Zone 2 – Base Operation/TA Ramp

· Zone 3 – T-6 Flight Line

· Zone 4 – T-38 Flight Line

· Zone 5 – All areas around Hangar 1 & 2 to mid point of center apron

· Zone 6 – All areas around Hangar 3 & 4 to mid point of center apron

· Zone 7 – All areas around Hangar 6, AGE & Paint Barn/PMB areas

· Zone 8 – T-6 & T-38 Trim Pad areas

2.2.2. FO within 50 feet of aircraft flight line parking or engine operating areas or within 10 feet of an aircraft or engine in a maintenance area (i.e., hangars, hangar aprons, phase docks, wash rack, etc.) is considered a major discrepancy. In addition FO within 10 feet of a designated aircraft towing route is considered a major discrepancy. Major FO is any hard object capable of causing damage and should be considered a Major discrepancy. FO found in tool boxes or in support equipment is not considered a major discrepancy.

2.3. Observation Area Inspections. To ensure a complete and comprehensive surveillance program, each area is covered by a specific observation guide as identified in AFI 21-101 & AETC Supplement, and this QASP. Surveillance will be accomplished utilizing the appropriate Observation Guide in conjunction with the General Guide. Any quarterly observation area inspection receiving a consecutive non conformance ratings may, at the FC’s or Chief COR’s discretion, be rescheduled the next month. The rescheduled inspection will utilize the complete observation area guide with emphasis on those areas that caused the non conformance rating. All discrepancies will be documented on AETC IMT 447. FOD walks will also be performed in the aircraft parking/maintenance areas during performance of the regular assigned observation area inspection. Baselines established in Attachment II of this QASP will be used.

2.3.1. Aircraft appearance/cleanliness. During observation area inspections applicable to the T-1, T-6, and T-38 areas, a random sample of a minimum of four aircraft will be inspected for appearance/cleanliness in accordance with the PWS. All discrepancies will be grouped into one minor write-up on the observation guide. Discrepancies noted that were not part of the observation guide will be documented as AS OBSERVED.

2.3.2. Tool and Equipment Management inspections. CORs will accomplish Tool and Equipment Management inspections in conjunction with observation area inspections. The COR will inspect dispatchable composite tool kits (CTK’s), and non-dispatchable CTK’s to surveil Tool and Equipment Management listed in AFI's, AETCI's, AETC Supplement's and contractor regulations. As a minimum, inspections will consist of the CTK inventory process, lost/missing tools, and overage of tools, etched tools, shadowed tools, special tools storage and calibration. FO found in tool boxes is not considered a major discrepancy.

2.3.3. Major and Minor Discrepancies. Always refer to AFI 21-101 & AETC Supplement, and this QASP to ensure consistency when determining major/minor discrepancies. CORs will use sound judgment and experience when determining classification of discrepancies. As a minimum, consider the following as possible major discrepancies:

· Missing/un-chitted tool/double etched tool with different CTK numbers

· Dispatchable CTK’s with unreadable etching/un-etched tool/double etched tool with different CTK numbers

· Unserviceable tools (if replacement is required to preclude potential FO or damage to equipment)

· Missing/un-etched/uncontrolled chits

· Unattended tools – no oversight by anyone in the area

· Uncontrolled/un-etched/unmarked Personal Protection Equipment (PPE)

· Uncontrolled rags including bird’s-eye cloth, canopy cloth or any other material used as a rag

· Master contents listing not available for CTK (Criteria IAW AFI 21-101 & AETC Supplement)

· Master contents listing does not match contents of CTK

· Potential fraud, waste and abuse

2.4. Other Surveillance Methods. In addition to Technical and Observation area inspections, performance assessment includes the following;

2.4.1. As Observed discrepancies. These discrepancies will be documented on AETC IMT 447. These reports will not be classified as conform/non-conform and discrepancies will not be categorized as major/minor. These reports occur when discrepancies are observed or discovered that are not directly associated with a scheduled inspection.

2.4.2. Customer Complaint. Customer feedback on the aircraft maintenance contract will be registered on a Customer Complaint Form. The Chief COR, Superintendent or Lead inspector will assign a COR to validate the customer’s feedback and will ensure the applicable technical order and/or contract reference is properly annotated on the customer complaint form. The COR will validate the actual occurrence and/or the results of the investigation in the validation block. CORs will sign their name, grade/rank and the date/time the Contractor was informed of the complaint in the validation block and give the completed form to the Superintendent or Lead Inspector. The package will be formalized and routed to the Contractor for action. The Chief COR or Superintendent will consider the actions taken by the Contractor, and if the response is expected to solve the customer’s feedback, document concurrence in the actions-taken-by Contractor block, sign and print duty title in the last block. Forward finalized copies as follows: copy one to customer, copy two for COR files, copy three to the contractor, and copy four to the ACO. If the action fails to address the problem or inadequate, the Chief COR or Superintendent will contact the ACO for further actions.

2.4.3. Documentation file inspections. CORs will evaluate aircraft, support equipment (powered AGE), and engine historical documents to include MIS. Always refer to AFI 21-101 & AETC Supplement, to ensure consistency when determining major/minor discrepancies.

2.4.4. Safety Violations. CORs will only document violations of Occupational Safety and Health Administration (OSHA) or Air Force Occupational Safety and Health (AFOSH) standards that clearly present a potential to damage or harm government resources and/or government personnel. Violations that present a potential for damage or harm only to contractor personnel or equipment will be informally reported to the site supervisor and then reported via email to the ACO, FC, Chief COR, and Superintendent (AFI 21-101 & AETC Supplement).

2.4.5. Mishap Investigation Surveillance: CORs will monitor and evaluate the contractors compliance with the PWS, AFI 91-204, local requirements, Contractor OI’s and checklists during mishap investigations. Emphasis will be placed on actions taken during the initial phase of securing aircraft/equipment data. Discrepancies will be recorded on AETC IMT 447 as an AS OBSERVED.

2.4.6. Functional Check Flight Contracting Officer Representative (FCF COR) Pilot Responsibilities: FCF/COR pilots must complete DAU COR 222, Contracting Officer’s Representative course and CLM 003, Ethics Training for Acquisition Technology and Logistics, Phase I, General COR Orientation Training and Phase II, Contract Specific training prior to performing surveillance, perform 2 contract surveillance functions: Evaluation of the aircraft FCF process and no-notice engine run evaluations. FCF COR pilots will perform one MDS FCF inspection per month to evaluate the contractors’ FCF process as prescribed in AFI 21-101 & AETC Sup. This Technical Inspection (TI) will start when the FCF COR aircrew is briefed by CQC FCF manager and will end after completion of FCF COR aircrew debriefing. Once the FCF is completed, the FCF COR aircrew will fill out AETC IMT 447 and process it though the COR office IAW Paragraph 2.5. of this QASP. FCF COR pilots will perform no-notice engine operation inspections as prescribed in AFI 21-101 & AETC Supplement. An APG COR will accompany the FCF COR pilot on the engine run evaluation to observe ground-man operations. During the performance of FCF COR duties, FCF COR pilots may also document “as observed” deficiencies. No-notice engine run evaluations may also be performed utilizing the aircraft flight simulator. An APG COR is not required to accompany the FCF COR when utilizing the aircraft flight simulator for no-notice engine run inspections.

2.4.7. Government Furnished Equipment/Property Surveillance (GFE/P). The Government property inventory from the beginning of the contract is maintained in the COR Office. In accordance with the PWS, an updated master inventory is maintained by the contractor and is located on the MX (contractor) server which is accessible by all CORs.

2.4.7.1. All CORs will surveil management of GFE/P during routine performance of area observation guides. Contractor work center GFE/P will be checked for proper item identification/labeling and identification on the master inventory located on the MA server. Surveillance will include checks for evidence of fraud waste, abuse, or poor supply discipline by random sampling of supply management aids; i.e., D04, M-30, D23, D18, etc., Lost Tool reporting program, and custodian files (CA/CRL)

2.4.7.2. The COR GFE/P Monitor will monitor/surveil the contractor GFE/P management program to include processes for purchase, control and disposal of GFE/P using a locally developed observation area guide. The GFE/P Monitor COR will validate inventory updates provided by the contractor, maintain a copy of the validation sheets and report the results of the validation via a memorandum to the ACO.

2.5. Performance Assessment Documentation. All Technical/Observation areas, AS OBSERVED inspections and discrepancies discovered during these inspections, will be documented on an AETC IMT 447. The date the inspection was performed and contract references will be entered in all reports. Specific references for T.O.’s, AFI's, AETCI's, AETC Supplement’s etc., will be entered for each discrepancy cited. Discrepancies discovered during technical inspections will be documented on the applicable AFTO series forms. Any annotation on the associated AFTO Forms will also require the COR’s number stamp. Repeat discrepancies from previous COR inspections will be identified and annotated on the AETC IMT 447. When aircraft forms are documented, the COR will ensure the status-of-the-day block is updated and ask the senior, lead-man, or supervisor to review the forms and ensure MIS documentation is accomplished. All AETC IMT 447's requiring corrective action by the contractor will be routed with a 5 duty day suspense by the Lead Inspector (after documentation verification of inspection schedule and AETC IMT 447.) to the contractor for cause, corrective actions, and preventive actions. To aid in accurate and timely performance assessment reporting, CORs will ensure accurate documentation of the evaluation, correct routing of the AETC IMT 447 and use clear/concise entries in the COR data base. Stand alone terms such as "see 447 for discrepancies" or "training program requires attention" will not be used in the COR data base.

2.5.1. Contractor Quality Control (CQC) Evaluations. CQC over-the-shoulder or CQC after-the-fact inspections may be accomplished with other scheduled inspections. Both inspections will be documented on separate AETC IMT 447's and will be entered in the COR computer database as separate reports.

2.5.2. Request Checks. Items may include extensive maintenance or dynamic leak checks, or may entail fine measurement of allowable tolerances. If COR notices a potential discrepancy but cannot determine if it is within tolerances, a Red Dash write-up will be entered in the equipment forms for a request check. COR will ensure contractor enters request checks in MIS.

2.5.2.1. If the result of a request check will affect the categorization of an AETC IMT 447 report (Conform or Non-Conform); for example, the first major discrepancy or an additional minor discrepancy over the baseline), the AETC IMT 447 report will be left open pending the results of the request check. Normally the AETC IMT 447 will not be held open longer than close of business (COB) the next duty day. The Chief COR, Superintendent, or Lead Inspector will be informed immediately of an open AETC IMT 447. Do not have the contractor representative initial the AETC IMT 447 until the report is categorized. CORs will enter all other discrepancies into the applicable equipment forms immediately.

2.5.2.2. Normally, the COR discovering the discrepancy will follow up on all request checks. This may be as simple as reviewing the equipment forms, but the COR should make a determined effort to observe the maintenance evaluation of the discrepancy when practical. The contractor’s production effort will not be delayed by a COR in an effort to observe a maintenance action without prior approval of the ACO.

2.5.2.3. The Chief COR, Superintendent, or Lead Inspector will inform the ACO if a request check has not been accomplished by COB the next day. If contractor delays will affect close out for formulation of monthly reports or Award Fee compilation, with consent of the ACO, the report will be finalized, to include contractor initial , the request check item will be considered a minor discrepancy, rated accordingly and entered in the COR data base. Upon completion of the request check, the report and COR database will be adjusted as necessary.

2.5.3. Safety Violations. These violations can be documented as part of the inspection being performed, or if appropriate, "as observed." provided the violation clearly indicates the potential to damage government resources. CORs do not document violations of OSHA or AFOSH standards that do not present the potential to damage/injure government resources; these violations will be reported via email to the ACO with Cc to the FC, Chief COR and Superintendent. (See paragraph 2.4.4.this QASP)

2.5.4. MIS Inspection Documentation (Performed with a TI). When performing a MIS inspection as part of a TI, the intent is to accomplish the entire 7 part TI at that time. However, there may be occasions when the COR duty day may not accommodate the MIS documentation inspection (Due to contractor not completing MIS till end of shift). If this occurs the COR will annotate the start date on the inspection schedule in the hold over date column for the TI being accomplished. On the COR’s next duty day the MIS inspection will be accomplished. The COR will annotate the COR inspection schedule to show that the TI is completed. Proper documentation includes lining through the holdover date, and documenting the AETC IMT 447 using criteria in AFI 21-101 & AETC Sup. The forms database located on the LGM shared drive will be annotated (as a minimum) with the number of MIS JCN items checked and the number of errors found. If there are discrepancies recorded, the COR will obtain the contractor’s representative initial. COR will ensure all parts of TI's are completed to prevent delays that affect close out of monthly reports or Award Fee compilation. If a TI is performed on a piece of equipment that does not require forms or MIS inspection, annotate this fact on the basic AETC IMT 447.

2.5.5. Aircraft Status Reporting Inspection. Aircraft status reporting inspections are those aircraft status evaluations not associated with any other TI and identified in AFI 21-101 & AETC Supplement. Review aircraft status of 10 aircraft per MDS (T-1, T-6, T-38). As a minimum, the Flight line expediter board, MOC Board and IMDS will be reviewed for each evaluation and normal TI baselines (no major/3 minor) apply.

Note: T-38’s, two out of the 10 aircraft required for aircraft status reporting inspection will be IFF designated aircraft

2.6. Stand-Alone MIS Technical Inspections. Stand-Alone MIS Technical Inspections are those MIS evaluations that are not associated with any other TI and identified in AFI 21-101 & AETC Sup. A minimum of 15 days of history will be reviewed for each evaluation and normal TI baselines (no major/3 minor) apply. Using criteria in AFI 21-101 & AETC Supplement, the AETC IMT 447 and the spread sheet located in the COR inspection schedule folder will be annotated with the number of MIS items checked and with the number of errors found. The following are minimum items to be checked during each evaluation;

III. Performance Assessment Results Analysis

3. Analysis: Statistical charts on pass/fail data for current year COR…