Attachment_2 _QASP.pdf

Training Delivery Services

Attachment 2

Quality Assurance Surveillance Plan

SECTION J, ATTACMENT 2

QUALITY ASSURANCE SURVEILLANCE PLAN

CDP TRAINING DELIVERY SERVICES

10/13/2015

1. INTRODUCTION

This Quality Assurance Surveillance Plan has been developed to evaluate Contractor performance while implementing the Performance Work Statement (PWS). It is designed to provide an effective surveillance method for monitoring and evaluating the Contractor’s performance for the requirements listed in the PWS.

The Contractor, and not the Government, is responsible for management and quality control actions to meet the terms of the contract. The role of the Government is quality assurance to ensure contract standards are achieved. In this contract, the quality control program is the driver for service quality. The Contractor is required to develop a comprehensive program of inspections and monitoring actions. The major step to ensuring a “self-correcting” contract is to ensure that the quality control program approved after contract award provides the measures needed to lead the Contractor to success. Once the quality control program is approved, careful application of the process and standards presented in the remainder of this document will ensure a quality program.

This Quality Assurance Surveillance Plan is not intended to interfere with Contractor's status as an 'independent contractor' under the law, nor is it intended in any way to supplant the Contractor's responsibility for the day-to-day control and management of its own personnel and other resources for which it is ultimately responsible.

2. OBJECTIVE

This plan provides a quality surveillance strategy for training delivery services to be performed at the Department of Homeland Security (DHS)/Federal Emergency Management Agency (FEMA)/Center for Domestic Preparedness (CDP), located at Anniston, Alabama. The primary intent of the plan is to provide a basis for the Contracting Officer’s Representative (COR) evaluation of performance quality.

Oversight of Contractor performance will assure quality performance. The plan will also afford the COR and Contracting Officer a productive mechanism to preclude major deficiencies in performance, provide input for annual contractor past performance evaluations, and make the determination for exercising of contract options.

3. PERFORMANCE INDICATORS (MEASURES). Surveillance of contractor performance will be performed by the appointed COR and the Contracting Officer based on the surveillance methodologies identified in the Performance Requirements Summary (PRS). The following primary task areas of the contract will be the basis from which all surveillance will originate:

3.1 Project Management

3.2 Course Delivery Management

3.3 Instructor Selection, Training, Certification and Sustainment

3.4 Logistics and Equipment Management

3.5 Safety Operations

3.6 Work Order Procedures

4. EVALUATION METHODS

The COR efforts will primarily be based on verification and monitoring of the Contractor’s performance. The Government will use a variety of surveillance methodology and techniques to validate the contractor’s compliance. The COR, assisted by other Government representatives, will perform evaluations based on each of the indicators stated in section 3 of this plan. The below listed methods of surveillance shall be used in the administration of this QASP.

5. PERFORMANCE REQUIREMENT SUMMARY

5.1 Lists the specific section in the PWS that the government will evaluate. The absence of any contract requirement from the PRS shall not detract from its enforceability or limit the rights or remedies of the government under any other provision of the contract.

5.2 Lists the service to be performed.

5.3 Lists the standard of performance for each specific service.

5.4 Lists the surveillance methods the government will use to evaluate the contractors performance in meeting the requirements of the contract.

6. SURVEILLANCE METHODS

6.1 The Government’s quality assurance procedures are based in part on attribute sampling of the recurring critical products of the contract using the concepts of MIL STD 105E sampling procedures and ANSI/ASQC Z1.4 sampling procedures and tables for inspection by attributes.

6.2 The Random Sampling method will be used for recurring service output items (daily, weekly, monthly, quarterly, semiannually, annually or as required) as determined necessary to assure a sufficient evaluation of contractor performance.

6.3 The 100% Inspection Method will be used for those tasks that occur infrequently and cannot be random sampled because the sample size for a small lot may exceed the lot size. Also, the tasks may have a stringent performance requirement where safety or health may be a concern.

6.4 Periodic surveillance. Sometimes called sampling, consists of the evaluation of tasks selected on other than 100 percent or random sample basis. It is appropriate for tasks that occur infrequently and where 100 percent inspection is neither required nor practicable. A predetermined plan for inspecting part of the work is established using subjective judgment and analysis of agency resources to decide what work to inspect and how frequently to inspect it. There will be periodic surveillance of output items as determined necessary to assure sufficient evaluation of contractor’s performance.

6.5 Customer complaints/Input. This is not a primary method, but it is a valuable supplement to more systematic methods. For example, in a case where random sampling indicates unsatisfactory service, customer complaints can be used as substantiating evidence. In certain situations where customers can be relied on to complain consistently when the quality of performance is poor, e.g., dining facilities, building services;

customer surveys and customer complaints may be a primary surveillance method.

FEMA CENTER FOR DOMESTIC PREPAREDNESS (CDP) TRAINING DELIVERY SERVICES

PERFORMANCE REQUIREMENTS SUMMARY (PRS)

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

1.9.2 Written minutes of PEM are prepared, signed by PM and delivered to COR within 5 working days for review and approval

Timeliness 91-95% of the minutes are received on time Positive/Negative CPARS evaluation

1.9.2 Written minutes of PEM are prepared, signed by PM and delivered to COR within 5 working days for review and approval

Quality Minutes received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

4.1 Government Furnished Property 100%

Annual Report

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

4.1.4 and 4.1.6 Sensitive Items and Weapons Accountability Report

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

4.1.4 and 4.1.6 Sensitive Items and Weapons Accountability Report

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

6.1 A written notification of any non-

compliance shall be provided by the contractor to the COR within 24 hours of discovery.

Timeliness 91-95% of the minutes are received on time Positive/Negative CPARS evaluation

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

6.1 A written notification of any non-

compliance shall be provided by the contractor to the COR within 24 hours of discovery.

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

6.3.1 Daily Accountability by 8:30 am

(CST)

Timeliness 91-95% of the minutes are received on time Positive/Negative CPARS evaluation

7.1.2 Course Delivery Plan Quality

Plans received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.1.2 Course Delivery Plan Timeliness 91-95% of plans are received on time Positive/Negative CPARS evaluation

7.1.2.2 Training Delivery Timeliness

95% of training delivery delivered on time per approved schedules

Positive/Negative CPARS evaluation

7.1.2.2 Training Delivery Quality 95% compliance with CDP requirements Positive/Negative CPARS

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.1.2.5 Evening Lectures. One-hour long

evening training class/seminar per training week

Timeliness 91-95% of the time lecture starts on time. 100% of the time the scheduled lecture is conducted

Positive/Negative CPARS evaluation

7.1.2.5 Evening Lectures concepts

submitted to the COR for approval no later than 21 days prior to delivery

Quality Concepts received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.1.2.5 Evening Lectures concepts

submitted to the COR for approval no later than 21 days prior to delivery

Timeliness 91-95% of proposals are received on time

7.1.2.6 Outreach Presentations.

Presentation proposals to the COR for review and approval no later than 21 days prior to the scheduled presentation.

Quality Proposals received are complete and accurate 91- 95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.1.2.6 Outreach Presentations.

Presentation proposals to the COR for review and approval no later than 21 days prior to the scheduled presentation.

Timeliness 91-95% of proposals are received on time Positive/Negative CPARS evaluation

7.1.2.6 Outreach Presentations. The

contractor must provide an after action report to the COR within 10 working days after presentation delivery.

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.1.2.6 Outreach Presentations. The

contractor must provide an after action report to the COR within 10 working days after presentation delivery.

Timeliness 91-95% of reports are received on time

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.1.3.1 Lodging Requirements List. The

contractor must provide a lodging requirements list to the Government designated office a minimum of 3 business days prior to the requirement.

Quality 100% compliance with CDP requirements Positive/Negative CPARS evaluation

7.1.3.1 Lodging Requirements List. The

contractor must provide a lodging requirements list to the Government designated office a minimum of 3 business days prior to the requirement.

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

7.1.4.1 Course administrative forms

(applications, tests, evaluations, etc.) must be collected and returned to the office designated by the COR within 10 calendar days of course completion.

Timeliness 91-95% of documents are received on time evaluation

7.1.4.1 Course administrative forms

(applications, tests, evaluations, etc.) must be collected and returned to the office designated by the COR within 10 calendar days of course completion.

Quality Documents received are complete and accurate 91- 95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.2 COBRATF Personnel are fully

qualified within the Contractor Employee Reliability Program (CERP) standards

Quality 100% compliance with CDP requirements

7.3.1 Instructor Selection and certification

criteria.

Quality 100% for experience and compliance with CDP requirements

Positive/Negative CPARS evaluation

7.3.2 COBRATF Instructors must have 5

years must be specialized experience working with WMD, CBRNE, or hazardous materials (civilian or military) at the technician level as defined by OSHA;

unless approved by the COR.

Quality 100% for experience and compliance with CDP requirements

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.3.3.2 Instructor Qualifications Monthly

Report

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.3.3.2 Instructor Qualifications Monthly

Report

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

7.3.4.1 Instructor Audit monthly report Timeliness 91-95% of work products are received on time Positive/Negative CPARS evaluation

7.3.4.1 Instructor Audit monthly report Quality

Work products received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.3.5 Current instructor records requirement Quality

Records are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.3.7 Subject Matter Expertise to support

all elements of training delivery as needed.

Timeliness 91-95% of work products are received on time Positive/Negative CPARS evaluation

7.3.7 Subject Matter Expertise to support

all elements of training delivery as needed.

Quality Work products received are complete and accurate 91-95% of the time, with 5% or less requiring rework

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.4.1 Maintain an inventory of equipment

and supplies that will be updated monthly.

Quality Inventory report is complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.4.1.1 Have the required training

equipment on hand for each resident/non-resident course in accordance with the approved program of instruction 30 minutes prior to the scheduled time of training delivery.

Timeliness 91-95% of training equipment on-hand for training on time, 100% of equipment on-hand prior to start of training

Positive/Negative CPARS evaluation

7.4.2.3 Equipment maintenance and

calibration plan shall be submitted to the COR on September 15th and March 15th of the contract base year and each subsequent option year.

Quality Plans are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.4.2.3 Equipment maintenance and

calibration plan shall be submitted to the COR on September 15th and March 15th of the contract base year and each subsequent option year.

Timeliness 91-95% of plans are received on time Positive/Negative CPARS evaluation

7.4.2.4 Non-Expendable Equipment

Disposal Plan will be submitted to the COR on September 15th of the contract base year and each subsequent option year.

Quality Plans are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.4.3 Training aids fabrication/development Quality

Work products received are complete and accurate 91-95% of the time, with 5% or less requiring rework

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.5.3 Job Hazard Analysis. Each job hazard

analysis shall be reviewed in a timely manner, not to exceed twenty-four (24) months

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

7.5.3 Job Hazard Analysis. Each job hazard

analysis shall be reviewed in a timely manner, not to exceed twenty-four (24) months

Quality Reports are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.5.7 The contractor shall report to the

COR in writing within 24 hours all accident/incidents occurring while performing work under this contract in accordance with CDP Accident/Incident Reporting Policy

Timeliness 91-95% of reports are received on time

7.5.7 The contractor shall report to the

COR in writing within 24 hours all accident/incidents occurring while performing work under this contract in accordance with CDP Accident/Incident Reporting Policy

Quality Reports received are complete and accurate with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.5.9 Site Audits. A written report will be

completed and maintained on all sites used for training.

Quality Reports are complete and accurate for 100% of training sites

Positive/Negative CPARS evaluation

7.5.11 Risk Analysis Plan for each new or

revised course.

Quality Plans received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.5.11 Risk Analysis Plan reviewed

annually for approved courses.

Timeliness 91-95% of plans are reviewed on time; not to exceed 13 months from last review

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

7.5.11.1 Safety briefings for each course

based on the risk analysis plan.

Timeliness 100% of courses receive required safety briefing Positive/Negative CPARS evaluation

7.5.12 Safety oversight required for courses

identified by risk level or individual training requirements.

Quality Requirement for 100% of courses Positive/Negative CPARS evaluation

7.6 The contractor shall provide an initial

cost estimate and work plan (as needed) for each work order proposal request generated by the COR.

Quality Reports are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.6 Work order cost estimates and work

plans shall be provided within 5 days of request for routine work orders and within 8 hours for urgent work orders. Urgent work must commence immediately upon COR approval.

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

7.6 Work orders shall be closed within 30

working days of work completion, to include actual cost data

Quality Reports are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

7.6 Work orders shall be closed within 30

working days of work completion, to include actual cost data

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

7.6.2 Work Order Monthly Report Quality

Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

8.1 Technical Progress Report due NLT the

10th day of each month

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

PERFORMANCE WORK

STATEMENT (PWS) TASKS

METRIC

TYPE

PERFORMANCE STANDARD/

ACCEPTABLE QUALITY LEVELS (AQL) INCENTIVE

8.1 Technical Progress Report due NLT the

10th day of each month

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

8.2 Monthly Personnel Reports due 1st day

of each month

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

8.2 Monthly Personnel Reports due 1st day

of each month

Timeliness 91-95% of reports are received on time Positive/Negative CPARS evaluation

8.3 Quarterly Race Nationality Origin

(RNO) Report due the first day of each quarter

Quality Reports received are complete and accurate 91-95% of the time, with 5% or less requiring rework

Positive/Negative CPARS evaluation

8.3 Quarterly Race Nationality Origin

(RNO) Report due the first day of each quarter

Timeliness 91-95% of reports provided on time. Due the last day of each quarter