Attachment_J.7_Quality_Assurance_Survelliance_Plan_(QASP).docx

The purpose of the QASP is to provide the Government and contractor with evaluation criteria that determines whether or not the performance standards for a specific contract have been met.

QUALITY ASSURANCE SURVEILLANCE PLAN

For Corporate Enterprise Learning & Development Contract Number: < TBA> Contract Description: Support to agency-wide learning and development over the development, delivery, and evaluation cycle.

Contractor’s name: < TBA > (hereafter referred to as the contractor).

1. PURPOSE.

This Quality Assurance Surveillance Plan (QASP) is a Government developed and applied document used to make sure that systematic quality assurance methods are used in the administration of the performance based service order. The intent is to ensure that the contractor performs in accordance with the performance metrics and the Government receives the quality of services called for in the order.

This contract requirement is for support and services to establish, deliver, improve, and evaluate an innovative, effective learning program for MCC. The Contractor shall provide all labor, supervision, project management, materials, and support across four elements of: development, planning, implementation, and communications for a corporate enterprise learning and development program. The Contractor must demonstrate deep technical expertise in current learning practice, program evaluation, and program management as well as strategic acumen in innovating in application of that expertise to meet the needs of a small, heterogeneous, pool of federal employees.

The resulting Task Order (TO) will be under a contract inclusive of CLINS for Labor-Hour and ODCs. A properly executed QASP will assist the Government in achieving the objectives of this procurement.

2. GOVERNMENT ROLES AND RESPONSIBILITIES.

The following personnel shall oversee and coordinate surveillance activities.

a. Contracting Officer (CO) - The CO shall ensure performance of all necessary actions for effective contracting, ensure compliance with the contract terms, and shall safeguard the interests of the United States in the contractual relationship. The CO shall also assure that the contractor receives impartial, fair, and equitable treatment under this contract. The CO is ultimately responsible for the final determination of the adequacy of the contractor’s performance.

Assigned Contracting Officer: Maxwell Sarpong Organization or Agency: Millennium Challenge Corporation Telephone: 202-521-7212 Email: sarpongmb@mcc.gov

b. Contract Specialist (CS) - The CS acts as an acquisition consultant and serves as liaison between the Contracts and Grants Management (CGM) Division and the requesting program office.

Assigned Contract Specialist: Michelle Nwoha Telephone: 202-772-6309 Email: nwohamd@mcc.gov

c. Contracting Officer’s Representative (COR) - The COR is responsible for administration of the contract and shall assure proper Government surveillance of the contractor’s performance. The COR shall keep a quality assurance file. At the conclusion of the contract or when requested by the CO, the COR shall provide documentation to the CO. The COR is not empowered to make any contractual commitments or to authorize any contractual changes on the Government’s behalf. The contractor shall refer any changes they deem may affect contract price, terms, or conditions to the CO for action.

Assigned COR: TBD Telephone: 202.521.xxxx Email: xxxx@mcc.gov

d. Other Key Government Personnel – Technical Expert Rita Hilton

Title: Director, Talent & Organization Development Telephone: 202.521.2658 Email: hiltonrm@mcc.gov

3. CONTRACTOR REPRESENTATIVES:

The following employees of the contractor serve as the contractor’s Program Manager and Task Manager for this contract. <Communication should occur with them during QASP development. It will help if they review the draft QASP and accept the final version.> N/A for now

a. Program Manager - <upon award, enter name> Telephone: <enter number> Email: <enter address>

b. Task Manager - <upon award, enter name> Telephone: <enter number> Email: <enter address>

c. Other Contractor Personnel - <upon award, enter name or delete these lines if not applicable> Title: <enter title> Telephone: <enter number> Email: <enter address>

4. METHODS OF QA SURVEILLANCE

a. Contractor Performance Assessment Report System (CPARS) – The market place for learning program services is very competitive. As such, the successful offeror has a vested interest in the Government generated CPARS rating under this contract. Additionally, an evaluation using the CPARS format will be performed at the midpoint of each period of performance. This evaluation will be one determinant in exercising an option. The Government for this procurement will address the quality of product or service, schedule, cost control, business relations, management, and other important areas. As this information may affect future source selections throughout MCC, and the continuation of the TO, the annual Government assessment will be used appropriately as an additional performance oversight and communication tool with the QASP.

b. QASP - The below listed methods of surveillance shall be used by the COR in the technical administration of this QASP. In addition to the below instructions, the form to be used for documentation of quality assurance surveillance is the Surveillance Activity Checklist provided herein.

Enclosures (1) and (2) set forth the performance standards, incentives, and surveillance methods for the contractor and COR while enclosure (3) provides the checklist and means for the COR to document on a monthly basis the results of the surveillance and shall be provided to the Contracting Officer on a quarterly basis.

5. DOCUMENTATION

In addition to providing quarterly reports to the Contracting Officer, the COR will maintain a complete Quality Assurance file. The file will contain copies of all reports, evaluations, recommendations, and any actions related to the Government’s performance of the quality assurance function, including the originals of the Quality Assurance Checklists. All such records will be maintained for the life of the TO. The COR shall forward these records to the Contracting Officer at termination or completion of the TO.

Performance standards define desired services. The Government performs surveillance to determine if the contractor exceeds, meets or does not meet these standards.

The Performance Requirements Summary Matrix, paragraph 9.0 in the Performance Work Statement includes performance standards. The Government shall use these standards to determine contractor performance and shall compare contractor performance to the Acceptable Quality Level (AQL).

6. ENCLOSURES

Enclosure (1) – Performance Standards Enclosure (2) – Incentives Enclosure (3) – Surveillance Activity Checklist

TECHNICAL STANDARDS

See enclosure 3.

· Utilization rates

Delivery of high-quality learning content across modalities (ILT, VILT, blended) appropriate for adult learners and target MCC audience

· Average participant scores indicate individuals as effective (in subject) via an average score of 4 or higher on a 5 point ascending evaluation scale

See enclosure3.

· Review of evaluations and contractor reports

· Review contractor reports

· Review of qualifications and performance

· Progress and delivery schedule monitoring

· Review of contractor reports

· Learner feedback

95332419Q0040 Attachment J.9

FOR OFFICIAL USE ONLY

Page of

INCENTIVES

The following incentives shall apply to performance under this order.

Base:

Not more than 2 of the measurement areas rated below “Satisfactory”. None of the measurement areas are rated below “Marginal”.

See below.

Midpoint of the assessment period (6 month) evaluation using the CPARS format covering the previous 6 months.

(+) Meet the acceptable performance definition as a condition for exercise of option 1.* (-) Does not meet the acceptable performance definition as a condition for exercise of an option 1.*

Option 1:

Not more than 2 of the measurement areas rated below “Satisfactory”. None of the measurement areas are rated below “Marginal”.

See below.

Midpoint of the assessment period (18 month) evaluation using the CPARS format covering the previous 12 months.

(+) Meet the acceptable performance definition as a condition for exercise of an option. 2.* (-) Does not meet the acceptable performance definition as a condition for exercise of an option. 2.*

Option 2:

Not more than 2 of the measurement areas rated below “Very Good”. Not more than 1 of the measurement areas rated below “Satisfactory”. None of the measurement areas are rated below “Marginal”.

See below.

Midpoint of the assessment period (30 month) evaluation using the CPARS format covering the previous 12 months.

(+) Meet the acceptable performance definition as a condition for exercise of option 3* (-) Does not meet the acceptable performance definition as a condition for exercise of exercise of option 3*

See below.

(-) Does not meet the acceptable performance definition as a condition for exercise of option 4*

See below.

(-) Did not meet the acceptable performance definition as a condition for exercise of option 4.

* The Government will not exercise option unless all regulatory requirements are met and the contractor meets the acceptable performance definition.

FOR OFFICIAL USE ONLY

Page of

All PWS tasks will be assessed focusing on the following:

Quality of Product or Service – Assess the contractor’s effort to transform operational needs and requirements into an integrated solution. Areas of focus may include the planning and management of program tasks, the quality of support provided throughout all phases of contract execution, the integration of program management specialties, management of interfaces, and the management of a totally integrated effort of all program management concerns to meet cost, performance, and schedule objectives. Assess how successfully the contractor meets program quality.

Schedule – Assess the contractor’s adherence to the required delivery schedule by assessing the contractor’s efforts during the assessment period that contribute to or effect the schedule variance. Also address significance of scheduled events discuss causes, and assess the effectiveness of contractor corrective actions.

Cost Control – Assess the contractor’s effectiveness in forecasting, managing, and controlling contract cost. Is the contractor experiencing cost growth or underrun? If so, discuss the causes and contractor-proposed solutions for the cost overruns. For contracts where task or contract sizing is based upon contractor provided person-hour estimates, the relationship of these estimates to ultimate cost should be assessed. In addition, the extent to which the contractor demonstrates a sense of cost responsibility, through the efficient use of resources in each work effort should be assessed.

Business Relations – Assess the timelines, completeness, and quality of problem identification, corrective action plans, proposal submittals, the contractor’s reasonable and cooperative behavior, effective business relations, and customer satisfaction.

Management – Assess the contractor’s success with timely award and management of subcontracts, including whether the contractor met small/small disadvantage and women- owned business participation goals. Discuss the extent to which the contractor discharges its responsibility for integration and coordination of all activity needed to execute the contract; identifies and applies resources required to meet schedule requirements; assigns responsibility for tasks/actions required by contract; communicates appropriate information to affected program elements in a timely manner. Assess the contractor’s risk mitigation plans. If applicable, identify any other management areas that are unique to the contract.

Other areas – Assess additional evaluation areas unique to the contract, or that cannot be captured elsewhere.

The evaluation ratings are as follows:

Exceptional – Performance meets contractual requirements and exceeds many to the Government’s benefit. The contractual performance of the task and sub-task being assessed was accomplished with few minor problems for which corrective actions taken by the contractor were highly effective.

Very Good - Performance meets contractual requirements and exceeds some to the Government’s benefit. The contractual performance of the task and sub-task being assessed was accomplished with some minor problems for which corrective actions taken by the contractor were effective.

Satisfactory - Performance meets contractual requirements. The contractual performance of the task and sub-task contain some minor problems for which corrective actions taken by the contractor appear or were satisfactory.

Marginal - Performance does not meet contractual requirements. The contractual performance of the task and sub-task being assessed reflect a serious problem for which the contractor has not yet identified corrective actions. The contractor’s proposed actions appear only marginally effective or were not fully implemented.

Unsatisfactory – Performance does not meet most contractual requirements and recovery is not likely in a timely manner. The contractual performance of the task or sub-task contains a serious problem(s) for which the contractor’s actions appear or were ineffective.

FOR OFFICAL USE ONLY

SURVEILLANCE ACTIVITY CHECKLIST

Quarterly Surveillance:

The COTR will perform a quarterly assessment of Quality, Schedule, Cost Control, Business Relations, Management, and Other Areas as applicable utilizing the CPARS evaluation rating definitions listed in enclosure 3.

Quarterly Summary of Ratings:

Quality Number of Exceptional

Schedule

Management

Number of Very Good

Number of Very Good

Number of Very Good

Number of Satisfactory

Number of Satisfactory

Number of Satisfactory

Number of Marginal

Number of Marginal

Number of Marginal

Number of Unsatisfactory

Number of Unsatisfactory

Number of Unsatisfactory

Cost Control

Business Relations

Other Areas

Number of Very Good

Number of Very Good

Number of Very Good

Number of Satisfactory

Number of Satisfactory

Number of Satisfactory

Number of Marginal

Number of Marginal

Number of Marginal

Number of Unsatisfactory

Number of Unsatisfactory

Number of Unsatisfactory

Annual Surveillance:

The COTR will perform an annual assessment of overall contract performance utilizing the CPARS evaluation rating definitions listed in enclosure 3 and the quarterly summary of ratings. This annual assessment will occur at the midpoint of each period and cover the previous 12 months, except for the base period which will cover only the previous 6 months.

TBD

Schedule Review of Quarterly Ratings.

Cost Control Review of Quarterly Ratings.

Business Relations Review of Quarterly Ratings.

Management Review of Quarterly Ratings.

Other Areas Review of Quarterly Ratings.