ATTACHMENT 2 QASP ATS.doc

Attachment 2

Quality Assurance Surveillance Plan Aviation Training System (ATS)

NOTE: This is a living document and is subject to change when necessary.

1. Objective. This Quality Assurance Surveillance Plan (QASP) serves as the principal basis for assessing overall performance quality associated with the Training and Education Command (TECOM) Aviation Standards Branch (ASB)’s Aviation Training System (ATS) services. This document will be used by the Government to assess the effectiveness of the Contractor’s quality with respect to management and technical services provided. This QASP provides the methodology by which the Contractor's performance will be monitored to determine compliance with established performance objectives and to establish performance benchmarks that ensure a quantifiable basis for measuring effectiveness. The plan is designed so that surveillance is limited to that which is necessary to verify the Contractor is performing management and technical services satisfactorily and relates directly to performance objectives of the performance objectives delineated in the PWS.

2. Government Surveillance. The Contracting Officer’s Representative (COR) will serve as the administering authority for this contract, and his authority will be limited to administering specific technical aspects of the contract. The COR will not provide direction that is outside the scope of responsibilities delineated under this contract and task orders and will defer any conditional interpretations to the Contracting Officer. The COR will:

· Maintain a detailed knowledge of the technical requirements of the contract;

· Document Contractor performance in accordance with the QASP;

· Identify and immediately forward notifications of deficient, or non-compliant performance to the Contracting Officer;

· Approve priorities of support, resources, and associated schedules.

3. Surveillance Methods. Surveillance of Contractor performance is the method used by the Government to determine whether the contractor is effectively and efficiently complying with all terms and conditions of the contract. In addition to statistical analysis, the functional expertise of the COR plays a critical role in adequately evaluating contractor performance. The below listed methods of surveillance shall be used in the administration of this QASP:

Demonstration - A qualification method that is carried out by operation and relies on observable functional operation. It does not require the use of instrumentation or special test equipment;

Analysis. A qualification method that is carried out by examining and assessing the application of techniques in order to determine if they are appropriate and sufficient. The quality of performance can be determined from government or contractor task-based or Management Information System (MIS) reports, contractor ISO 9000 techniques and procedures, or from government observation of completed tasks. In some instances, reports may be available in the form of information on a contractor's performance against contract requirements. Reports generally provide information regarding various characteristics of tasks and can, therefore, be used to determine acceptability of a contractor's performance.

Inspections: A qualitative inspections can be accomplished through one of the following techniques:

· Random/Stratified Sampling: With random sampling, services are sampled to determine if the level of performance is acceptable. Random sampling works best when the number of instances of the services being performed is very large and a statistically valid sample can be obtained. Stratified sampling focuses on selected parts of total contractor output for sampling. Computer programs may be available to assist in establishing sampling procedures.

· Periodic Inspection, Judgmental Inspection or Planned Sampling: This method, sometimes called "planned sampling”, consists of the evaluation of tasks selected on other than a 100% or random basis.

4. Performance Requirements. The performance requirements set forth in this section correspond to the material content cited in the PWS and the evaluation factors. Corresponding ratings will be generated for each of the weighted performance areas and aggregated monthly. The COR will track performance using a moving average and reconcile performance with the Contractors Program Manager and Task Leads. This information will also be shared with the Contracting Officer and included in CPARs reports and any past performance assistance requests:

Acceptable / Meets: .85 - .94

Unacceptable: <.85

Acceptable / Meets: .85 - .94

Unacceptable: <.85

Factor 2 - Management Approach Excellent / Exceeds: >.95

Acceptable / Meets: .85 - .94

Unacceptable: <.85

Factor 2 – Management Approach Excellent / Exceeds: >.95

Acceptable / Meets: .85 - .94

Unacceptable: <.85

The criteria that will be used to accomplish the evaluation ratings is derived from the RFP and from the elements of performance determined to be most influential to performance.

PERFORMANCE REQUIREMENTS SURVEY (PRS)

Quality of Work Performed: Use of resources to provide acceptable or better results through the following:

- Technical accuracy, thoroughness of reporting;

- Effective balancing of resources to accomplish work requirements without sacrificing priorities; and

- Qualified personnel to meet performance objectives < 5% rejection rate of all formal deliverables submitted under the performance provisions of the contract;

<5% staff replacement due to substandard performance;

95% availability of subject matter expertise to meet requirements >95%

>95%

>95%

- Monthly reconciliation by COR/CPM and tracked as a 3-mos. moving average.

- Quarterly reconciliation between the COR, PCO, and Contractor to ensure that any negative trends are identified and mitigated CPARS Rating

Responsiveness: Effective use of prime and subcontractor resources to meet ongoing work requirements including:

- Providing effective responses to requirements / reallocations of labor within the Work Breakdown Structure (WBS)

- Using suitable benchmarking to establish staff allocations and work packages Response provided to COR within 24-hrs of staffing requirements or reallocation with, strategy provided to COR <48-hrs. including:

- WBS review;

- Approach agreement;

- Deliverables; and

- Availability of staff.

>95%

- Periodic assessment by the COR, for the thoroughness of the response.

- Reconciled monthly by COR / Contractor Program Manager and tracked as a 3-mos. moving average

- Quarterly reconciliation between the COR, PCO, and Contractor to ensure that any negative trends are identified and mitigated CPARS Rating

Planning: Includes the effective use of resources as a principal management tool, assignment of staff to work priorities and tasks therein delineated, and effective management, including:

- Coordination with COR;

- Thoroughness of resource assessments;

- Effectiveness of labor usage; and

- Effectiveness of benchmarking.

Stability and forecast use of labor resources to meet quality standards without increasing current performance scope (e.g., change orders <5%); and

<5% vacancy based upon scheduled departures (e.g. 30-days’ notice) for backfill of staff

- Reconciled monthly by COR / CPM and tracked as a 3-mos. moving average.

- Quarterly reconciliation between the COR, PCO, and Contractor to ensure that any negative trends are identified and mitigated CPARS Rating

Staffing: Includes selection of qualified staff to meet requirements:

- Adequacy of skills, experience of staff to meet program requirements

- Use of team members, subcontractor staff to ensure most qualified capabilities are applied

- Responsiveness and use of staff workload management

- Staff stability maintained at >95% of target allocation

- New hires within 30-days of notification of vacancy

- Subcontractor staffing pulls <10-days from notification of vacancy and <14-days backfill for unscheduled staff departures.

-Quarterly reconciliation between the COR, PCO, and Contractor to ensure that any negative trends are identified and mitigated CPARS Rating

Management and Administration:

Includes the following measures of performance and compliance:

- Deliverables shall be complete, accurate, and prepared to a professional standard

- Quality of the Contractor’s overall technical management strategy

- Ability to identify and preclude problems, or resolve issues

- Effectiveness of their use of corporate quality practices, resolution of invoice anomalies,

- WBS compliance and effectiveness of their overall subcontract management.

Aggregation of subordinated areas assessed using progressively more objective criteria – ratings considered:

Excellent – Exceeded performance expectations as defined in the PWS to the Governments benefit, and abated, or immediately mitigated known problems;

Acceptable – Met performance expectations and generally responded to problems in a satisfactory manner; and

Unacceptable – Areas of inconsistent performance, prolific problems remain unresolved, and two or more performance areas are noted as substandard.

>95%

- Performance evaluation at TBD milestones;

- Reconciled monthly by COR / CPM and tracked as a 3-mos. moving average.

-Quarterly reconciliation between the COR, PCO, and Contractor to ensure that any negative trends are identified and mitigated

CPARS Rating

� Numerical values for the adjectival ratings are: >.95 – Excellent – Exceeds standard compliance; .85 - .94 standard compliance – Acceptable; and <.85 – unacceptable.

Source Selection Information – FAR 2.101 and 3.104 For Official Use Only