QASP.doc

Federal Emergency Management Agency

Maintenance and Deactivation

Quality Assurance Surveillance Plan

TABLE OF CONTENTS

I.

INTRODUCTION

II. SCOPE

III. PERFORMANCE CRITERIA

A.

Timeliness (SSPA #1) B.

Customer Satisfaction (SSPA #2) C.

Quality (SSPA #3) D.

OVERALL PERFORMANCE SCORE ……………………………………………………………………………….7

IV. PERFORMANCE REQUIREMENTS SUMMARY

Exhibits:

1. Customer Satisfaction Surveys (for Routine and Emergency Maintenance [1a] and Deactivations [1b])

2. Maintenance Quality Survey

3. Deactivation Quality Survey

I.

INTRODUCTION

A.

Contractor shall perform according to the requirements in the Performance Work Statement (PWS); Section C. Contractor activity will be monitored by the Contracting Officer’s Technical Representative (COTR), with assistance from the Technical Monitor and/or other designated staff to ensure full compliance with contract terms and conditions. The contractor’s performance will be evaluated on a quarterly basis. This Quality Assurance Surveillance Plan (QASP) outlines the procedures that will be used in assessing and measuring the quality of contractor performance.

B.

The COTR is responsible for monitoring Contractor performance on a task order basis. The COTR will provide overall technical management, and monitor contractor performance. The Technical Monitor (or other designated staff member) will document Contractor’s progress and performance, and inform the COTR immediately regarding any potential problems and recommended courses of action. Problems of a contractual nature (as opposed to technical) must be reported to the Contracting Officer immediately.

C.

The method of surveillance will involve monitoring Work Order records, Property Transfer Reports (PTR), actual receipts of repairs, call logs, contractor maintenance/deactivation logs and phone or in-person interviews with customers. The contractor shall provide reports to COTR on maintenance performed and deactivations as specified in the PWS.

D.

Selected Service Performance Areas (SSPAs) are scored on the basis of achievement under individual task orders (See para. IV below). Financial Incentives and Disincentives will not be paid or deducted under this Quality Assurance Surveillance Plan.

E. The Contractor, Technical Monitor (or other designated staff member), and COTR will partner throughout the life of each task order and discuss the quality of performance during weekly meetings (conference calls or face-to-face meetings), or more frequently if necessary. Performance results will be documented by the Technical Monitor (or other designated staff member). The Contractor and COTR (or other designated staff member) will affix their signatures to indicate agreement.

F. If the Contractor and COTR are unable to reach agreement on the evaluation results, then the matter shall be elevated to the Contracting Officer. The Contracting Officer will consider any discrepancies between the Contractor and the COTR, and issue a final decision. There is no provision for the Contractor to appeal the Contracting Officer's final decision. The original evaluation shall be forwarded to the Contracting Officer for retention in the Official Contract File, and one copy each shall be provided to the Contractor and the COTR. The evaluation results will only be used internally by the government.

II.

SCOPE

A.

The Selected Service Performance Areas (SSPAs) include the following categories:

1. Timeliness

2. Customer Satisfaction

3. Quality

III.

PERFORMANCE CRITERIA

A.

Timeliness (SSPA #1)

1. Timeliness will be evaluated for Routine Maintenance, Emergency Maintenance and Deactivation.

a. Pursuant to the Performance Work Statement (PWS) Exhibit 1 and Exhibit 2 the contractor shall:

i. Respond and initiate emergency repairs within six (6) hours of receipt of the emergency request with the tools, equipment and supplies, necessary to make repairs.

ii. Pursuant to PWS the contractor shall initiate and complete routine maintenance repairs within forty-eight (48) hours after receipt of the request or monthly scheduled maintenance whichever comes first. Contractor shall complete routine maintenance items within seventy-two (72) hours of initial visit.

iii. Pursuant to PWS, the contractor shall initiate and complete routine deactivation requests for manufactured homes (MH) and park models (PM) within seven (7) calendar days after receipt of the work order.

iv. MH units must have deactivation initiated on an emergency basis within six (6) hours of receipt of Work Order. The work must be completed the same day as the Work Order is issued.

b.

Once per quarter following the start of the performance period, the COTR, Technical Monitor, or other designated staff member will select for evaluation the work orders issued for the prior month in each of the following three areas of performance: (1) emergency maintenance, (2) routine maintenance and (3) deactivations.

c.

The COTR, Technical Monitor, or other designated staff member will receive from the contractor a single Excel spreadsheet of all emergency maintenance, routine maintenance and deactivation work orders issued during the prior month.

Each row of data shall include, at minimum:

(i) The type of work order issued (emergency maintenance, preventive, routine maintenance and deactivation);

(ii) The occupant’s name;

(iii) The occupant’s billing address;

(iv) The occupant’s contact telephone number;

(v) The occupant’s Mobile Home bar code;

(vi) A description of the work performed;

(vii) The date and time the work was requested and completed;

(viii) And the status of the work order (if work orders incomplete, state why, what needs to be done, what has been done and who needs to complete the action).

d.

A minimum of 5% of the total number of work orders should be randomly sampled every month. If fewer than twenty (25) work orders have been issued in a given month for any one of the three areas, then 100% inspection will be performed instead of random sampling.

f.

An Excel spreadsheet of the Customer Satisfaction and Quality Survey results of each occupant randomly selected will be maintained on a monthly basis.

g.

The COTR, Technical Monitor, or other designated staff member will randomly select at least a 5% sample of work orders and serviced customers for call-outs. If fewer than twenty (25) work orders have been issued in a given month, then 100% call-outs will be performed instead of random sampling. Using the Customer Satisfaction Survey, Exhibits 1a and 1b, designated staff will contact the customers, ask them to answer the questions on the survey, and thus determine those customers’ levels of customer satisfaction. Scores will be calculated for each survey performed and recorded on the Excel spreadsheet.

h.

The COTR will administer performance surveillance on an on-going, quarterly basis, in order to more frequently update contractors regarding their performance quality levels.

i.

For each randomly selected work order, determine whether the emergency maintenance, routine maintenance, or deactivation was accomplished within the timeframes in III.A.1.a. Maintain a tally of those randomly selected work orders performed in a timely fashion versus those work orders performed in a tardy fashion.

2.

This Timeliness performance will be factored within two other percentage sub-scores, one for Customer Satisfaction and one for Quality, to arrive at one Overall Performance percentage score.

B.

Customer Satisfaction (SSPA #2)

1.

Customer Satisfaction is evaluated for Routine Maintenance, Emergency Maintenance, and Deactivations.

a.

Pursuant to the Performance Work Statement, the contractor shall provide maintenance and deactivations services and activities in a professional manner, incorporating valuable customer service, performance and quality assurance measures into the task, to ensure that disaster impacted individuals and households occupying the temporary housing units are treated and served with courteous and timely services.

b.

During each calendar month, the COTR, Technical Monitor, or other designated staff member will randomly select a statistically significant sample of the work orders issued in each of the following three areas of performance: (1) emergency maintenance (2) routine maintenance, and (3) deactivation. The samples to be used will be the same sample identified and collated in Steps III.A.1.b - III.A.2. listed above.

c.

The COTR, Technical Monitor, or other designated staff member will designate the randomly selected sample of work orders and the serviced customers, to be called. Using the Customer Satisfaction Survey, Exhibits 1a and 1b, designated staff will contact the customers, ask them to answer the questions on the survey, and thus determine those customers’ levels of customer satisfaction. Scores will be calculated for each survey performed and put on an Excel spreadsheet.

2. The Customer Satisfaction sub-score will be calculated as the average score for all surveys performed.

Example: if 10 surveys are performed and the contractor receives the following customer satisfaction scores:

90%, 80%, 70%, 90%, 80%, 70%, 90%, 80%, 70%, 90%, = 810 810 total percentage points divided by 10 samples = 81%

Then the average score for the 10 surveys would be 81% and the Customer Satisfaction sub-score would be 81%.

This Customer Satisfaction sub-score will be averaged within the Quality Surveys’ other percentage sub-scores, to arrive at one Overall Performance percentage score.

C.

Quality (SSPA #3)

1.

Quality will be evaluated for Routine/ Emergency Maintenance, Deactivation and Group Site Maintenance.

a.

The contractor shall ensure that work is performed pursuant to the standards listed in the Statement of Work.

b.

During each quarter, the COTR, Technical Monitor, or other designated staff member will select a sample of the work orders issued in each of the following three areas of performance: (1) emergency maintenance (2) routine maintenance, and (3) deactivation. The sample to be used will be the same sample identified and collated in Steps III.A.1.a - III.A.2 listed above.

c.

The COTR, Technical Monitor, or other designated staff member will utilize Exhibit 2, Maintenance Quality Survey, to evaluate Emergency and Routine Maintenance, and Exhibit 3, Deactivation Quality Survey, will be used to evaluate Deactivations. Scores will be calculated for each survey performed for each of the randomly selected work orders.

2.

The Quality sub-score will be calculated as the average score for all surveys performed. The formula is the same as used in above noted III.B.2.This Quality percentage sub-score will be averaged as one of the two percentage sub-scores including the sub-score for Customer Satisfaction, to arrive at one Overall Performance percentage score.

D.

Overall Performance Score

1.

The Customer Satisfaction, and Quality (with Timeliness factored in) sub-scores will be averaged to obtain a single Overall Performance score.

2. Ratings Scores:

Overall Performance score of 69.99% or lower: Unsatisfactory.

Overall Performance score of 70% - 79.99%: Marginal.

Overall Performance score of 80% - 89.99%: Satisfactory.

Overall Performance score of 90% - 94.99%: Excellent.

Overall Performance score of 95% or higher: Outstanding.

3.

Financial incentives or disincentives will not be paid under this plan.

IV.

PERFORMANCE REQUIREMENTS SUMMARY

A.

The Performance Requirements Summary (PRS), which follows, summarizes (in chart form):

1.

The Selected Service Performance Areas (SSPAs) critical to successful performance, 2.

The minimum standard required, The paragraph cited in the Performance Work Statement where a description of the exact requirement can be found, The method of surveillance.

The scoring and measurement system to be applied to each SSPA.

SSPA#1 Timeliness

a. Emergency Maintenance

a. Initiate and complete 100% emergency repair requests within six (6) hours of receipt of emergency request.

1a. 69.99% and below of the maintenance calls and deactivation requests were responded to within the timeframe. Unsatisfactory

1b. 70% - 79.99% of the maintenance calls and deactivation requests were responded to in the appropriate timeframe. Marginal

1c. 80% - 89.99% of the maintenance calls and deactivation requests were responded to in the appropriate time frame. Satisfactory

1d. 90% - 94.99% of the maintenance calls and deactivation requests were responded to in the appropriate timeframe. Excellent

1e. 95% and above of the maintenance calls, and deactivation requests were responded to in the appropriate timeframe. Outstanding

Random sampling Minimum 5% up to 100% surveillance

Random sampling

b. Routine Maintenance

b. Contractor shall repair 90% of all routine maintenance service calls on the first visit. 100% complete within 72 hours of initial visit.

c. Deactivation (MH/PM)

c. Initiate and complete routine deactivation requests within seven (7) calendar days after receipt of the work order.

Random sampling

SSPA#2 Customer Satisfaction

a. Emergency Maintenance Customer Satisfaction.

b. Routine Maintenance Customer Satisfaction

c. Deactivation Customer Satisfaction.

1b. Average Customer Satisfaction score is between 70% - 79.99%. Marginal

1c. Average Customer Satisfaction score is between 80% - 89.99%. Satisfactory

1d. Average Customer Satisfaction score is between 90% - 94.99%. Excellent

1e. Average Customer Satisfaction score is 95% or higher. Outstanding

Random sampling

SSPA#3 Quality

a. Emergency Maintenance Quality: PWS and

QASP

The Contractor will be determined to have met the minimum requirement for quality when the average Quality score tallied from all surveys is 80% or higher.

1a. Average Quality score is 69.99% or lower. Unsatisfactory

1b. Average Quality score is between 70% - 79.99%. Marginal

1c. Average Quality score is between 80% - 89.99%. Satisfactory

1d. Average Quality score is between 90% - 94.99%. Excellent

1e. Average Quality score is 95% or higher. Outstanding

Random sampling

Random sampling

b. Routine Maintenance Quality: PWS and QASP

Random sampling

An Overall Performance score of less than 80% is unacceptable; a score of 90% or over is excellent or outstanding.

1a. Overall Performance score is 69.99% or lower. Unsatisfactory

1b. Overall Performance score is between 70% - 79.99%. Marginal

1c. Overall Performance score is between 80% - 89.99%. Satisfactory

1d. Overall Performance score is between 90% - 94.99%. Excellent

1e. Overall Performance score is 95% or higher. Outstanding

1b.Marginal.

1c. Satisfactory.

1d. Excellent.

1e. Outstanding Invoice changes will not be required under this QASP.

Exhibit 1a Customer Satisfaction Survey (Routine and Emergency Maintenance)

FEMA-DR-1712-OK

Use the following scale to answer the satisfaction questions.

1 = Completely Inappropriate

4 = Very Appropriate (Very Good)

2 = Somewhat Inappropriate

5 = Completely Appropriate (Outstanding)

3= Appropriate (Minimum Requirement)

Observation Score

Total

Total raw score:

Registration # or ID

Address

Phone

Date

Interview

Remarks

Exhibit 1b

Customer Satisfaction Survey (Deactivations)

FEMA-DR-1712-OK

Use the following scale to answer the satisfaction questions.

1 = Completely Inappropriate

4 = Very Appropriate (Very Good)

2 = Somewhat Inappropriate

5 = Completely Appropriate (Outstanding)

3= Appropriate (Minimum Requirement)

Observation Score

Total

Total raw score:

Registration # or ID

Address

Phone

Date

Interview

Remarks

EXHIBIT 2

MAINTENANCE QUALITY SURVEY

Maintenance (100% maximum score)

1. Contractor performed monthly preventative maintenance inspection for unit whose work order is being surveyed, either for month of survey or previous month (previous month if surveyed work order is for routine or emergency maintenance call which originated from applicant and monthly preventative maintenance inspection is scheduled for later in the month). (10 percentage points)

2. Contractor provided appropriate FEMA reports detailing the surveyed work order in a timely manner as required. (10 percentage points)

3. Contractor left the occupant a summary of the findings and work performed for any type of visit and service call (preventative maintenance, routine maintenance, or emergency maintenance). (10 percentage points)

4. Did contractor perform contractor responsibilities according to the SOW? To include phone service, hours of operations, facilities, identification, resources, warranty, and reporting problems? (20 percentage points)

5. Contractor reported maintenance problems covered by warranty. (10 percentage points)

6. Qualified Contractor personnel performed the maintenance work. (10 percentage points)

7. Contractor did all things necessary to maintain/repair the unit to a safe, working, livable and comfortable condition, with the exception of those things that the occupants could reasonably maintain/repair. (20 percentage points)

8. Contractor used new materials of a quality equal to or better than the materials that were replaced. (10 percentage points)

Total Percentage Points:

Work Order Number:

Quality Survey Performed By:

EXHIBIT 3

DEACTIVATION QUALITY SURVEY

Deactivations (100% Maximum Score)

1. Did contractor perform Deactivation Preparation according to the SOW? (10 percentage points)

2. Did the contractor secure the interior fixtures, equipment, and furnishings of the unit according to the SOW? (10 percentage points)

3. Did the contractor secure the exterior according to the SOW? (10 percentage points)

4. Did contractor perform the cleaning and fumigating according to the SOW? (10 percentage points)

5. Did contractor perform the winterization according to the SOW? (10 percentage points)

6. Did contractor remove the debris associated with the deactivation in accordance with the SOW? (20 percentage points)

7. Did the contractor use the appropriate equipment resources to perform deactivation? (10 percentage points)

8. Did contractor at no time leave unattended, or otherwise unprotected, any excavation or safety hazard that might cause injury to any person? (20 percentage points)

Total Percentage Points:

Work Order Number:

Quality Survey Performed By:

1 ATTACHMENT B