Attch7_QASP.docx

QUALITY ASSURANCE SURVEILLANCE PLAN (QASP)

1. Contract Title: Command and Control (C2) Portfolio Test and Evaluation

2. Purpose:

This QASP provides a systematic method to evaluate performance for the stated contract. This QASP explains the following:

· What will be monitored?

· How monitoring will take place.

· Who will conduct the monitoring?

· How monitoring efforts and results will be documented.

This QASP does not detail how the Contractor accomplishes the work. Rather, the QASP is created with the premise that the Contractor is responsible for management and quality control actions to meet the terms of the contract. It is the Government’s responsibility to be objective, fair, and consistent in evaluating performance. In addition, the QASP should recognize that unforeseen and uncontrollable situations may occur.

This QASP is a “living document” and the Government may review and revise it on a regular basis. Updates shall ensure that the QASP remains a valid, useful, and enforceable document. Copies of the original QASP and revisions shall be provided to the Contractor and Government officials implementing surveillance activities.

3. Roles and Responsibilities:

The following personnel shall oversee and coordinate surveillance activities.

· Program/Project Manager (PM) – The PM provides program oversight and supports the Contracting Officer’s Representative’s (COR) performance assessment activities.

· Contracting Officer (KO) – The KO shall ensure performance of all necessary actions for effective contracting, ensure compliance with the contract terms, and shall safeguard the interests of the United States in the contractual relationship. The KO shall also ensure that the Contractor receives impartial, fair, and equitable treatment under this contract. Determine the final assessment of the Contractor’s performance.

· Contracting Officer’s Representative (COR) – The COR is responsible for providing continuous technical over-sight of the Contractor’s performance. The COR uses the QASP to conduct the oversight/surveillance process. The COR shall keep a Quality Assurance file that accurately documents the Contractor’s actual performance. The purpose is to ensure that the Contractor meets the performance standards contained in the contract. The COR is responsible for reporting early identification of performance problems to the KO. The COR is required to provide an annual performance assessment to the KO which will be used in documenting past performance. The QASP is the primary tool for documenting Contractor performance. The COR is not empowered to make any contractual commitments or to authorize any contractual change on the Government’s behalf.

4. Primary Method of Surveillance:

· 100 Percent Inspection will be conducted to ensure timeliness of deliveries for those Contract Data Requirements List (CDRL) submissions indicated in Appendix 1. The Government will check for timeliness of work by monitoring document completion times against schedules. This is the most appropriate method for these tasks where content, quality and timeliness must be tracked and verified.

· Random Inspection will be conducted for documentation related deliverables to check for an acceptable quality of work performed. Random sampling is more appropriate for these tasks (i.e. vulnerability notices, license renewals etc.) because the costs of performing 100 percent inspection would far outweigh the benefits. The project office will use representative samples that will ensure sufficient confidence that quality and timeliness is being met.

Please see Appendix 1: Surveillance Matrix for a breakout of which subtasks will be 100% Inspection and Random Inspection.

Surveillance Matrix

The Surveillance Matrix (Appendix 1) is the list of performance objectives and standards that must be performed by the Contractor. This matrix details the method of surveillance the COR will use to validate and inspect these performance elements. Inspection of each element will be documented in the COR file.

Performance objectives define the desired outcomes. Performance Standards define the level of service required under the contract to successfully meet the performance objective. The inspection methodology defines how, when, and what will be assessed in measuring performance. The Government performance surveillance, using this QASP, to determine the quality of the Contractor’s performance as it relates to the performance element standards. The Acceptable Quality Level (AQL) performance Standard Table should be used to form the foundation of the COR’s inspection checklist.

5. Performance Standards:

The Performance Standards are: Deliverables shall be 1On Time, 2Complete, & 3Accurate. This description is further defined below.

· 1On Time: On time performance completion in accordance with delivery schedule in the TOMP and IMS. Meets: ≤ Delivery date, Unsat: > 3 days after delivery date.

· 2Complete: The Contractor is required to provide all deliverables IAW the PWS. Documents shall be evaluated in terms of meeting the objectives of the requirement and the document’s accuracy, clarity, conciseness, and completeness. All deliverables will be evaluated for depth and breadth of technical discussion, and the degree to which deliverables enable third parties, not intimately familiar with the developed software, to understand the design and implementation of deliverable.

· 3Accurate: 95% AQL, with less than 5% of any document requiring revision during the draft; 100% AQL for final documentation. The Percentage of a document calculated to determine whether revisions required exceed 5% is done by calculating the number of change pages against the total pages in the document (e.g. change pages exceeding 5% of a 50-page document results in 3 pages needing fixes (6%)).

6. Documenting Performance:

· Acceptable Performance. The Government shall document positive performance. A Performance Assessment Report (PAR) template is attached (Appendix 2). Any report may become part of the supporting documentation for fixed price payments, award/incentive fee payments, Contractor Performance Assessment Reporting System (CPARS) entries, or other actions. Government acceptance of services permits the Contractor to invoice for the service fee.

· Unacceptable performance: Unacceptable Contractor performance can be identified by customer complaints (Appendix 3) or upon schedule surveillance evaluations. When unacceptable performance occurs, the COR shall inform the Contractor. This will normally be in writing unless circumstances necessitate verbal communication. The COR shall document the discussion and place it in the COR file and provide a copy to the KO.

When the COR determines formal written communication is required, the COR shall prepare a Corrective Action Report (CAR). The CAR is forwarded to the KO for dissemination to the Contractor. A CAR template is attached to this QASP (Appendix 4).

The Contractor shall acknowledge receipt of the CAR in writing. The CAR will specify if the Contractor is required to prepare a corrective action plan to document how the Contractor shall correct the unacceptable performance and avoid a recurrence. The CAR will also state how long after receipt the Contractor has to present this corrective action plan to the KO and COR. The Government may withhold payment for services until corrective action is taken. The Government shall review the Contractor's corrective action plan to determine acceptability. Upon Government acceptance of the corrected services the Contractor will be permitted to invoice for the service fee.

Any CAR may become a part of the supporting documentation for contract payment deductions, fixed fee deductions, award fee nonpayment, CPARS or other actions deemed necessary by the KO.

7. Mandatory or regulatory compliance items:

The Contractor will provide initial proof of compliance with regulatory and compliance items contained in the contract. The COR and the KO will evaluate the initial submission and will conduct ad hoc reviews of the Contractor's compliance throughout the remainder of the contract. The Contractor shall monitor compliance as required by Federal Acquisition Regulation (FAR) 52.222-50, Combating Trafficking in Persons, and report any issues to the KO.

8. Acceptable Quality Level (AQL):

The AQL for all deliveries are defined as: 4On Schedule & 5Accurate. This description is further defined below.

· 4On Schedule: Deliverable is submitted within 3 days of due date with no required re-performance or re-works.

· 5Accurate: Revisions that occur are minor and are resolved in a satisfactory manner.

The AQL’s are represented in percentages as well as meets/does not meet timeliness criteria, quality, and levels of reliability.

9. Evaluation Method:

The COR or other Designee will evaluate deliverables IAW the Performance Standards found in Section 5 of this QASP under the sixth column of the table “Method of Surveillance”. The COR will check that deliverables are turned in on time and will rely on Subject Matter Expert (SME) to verify tests and inspections. All deliverables will be evaluated for depth and breadth of technical discussion and how they meet the requirements of the PWS.

The COR or other Designee reserves the right to perform oversight and surveillance of Contractor performance at any time, but not as a disruption or impedance to Contractor performance. The Contractor shall be notified immediately (verbally if possible, but always in writing) of any discoveries requiring urgent attention/remedy/resolution. The COR will monitor outstanding issues until resolution. The COR shall document all notifications, discussions, and transmissions on contract matters.

10. Performance Rating

In evaluating the quality of the Contractor’s performance, the following performance ratings may be used (same as CPAR ratings).

Performance Rating Criteria

Appendix 1: Surveillance Matrix

6.2.1.1 6.3.1.1 6.4.1.1

6.2.1.1 6.3.1.1 6.4.1.1

6.2.1.2 6.3.1.2 6.4.1.2

6.2.1.2 6.3.1.2 6.4.1.2

6.2.2 6.3.2 6.4.2

6.2.2 6.3.2 6.4.2

6.2.3 6.3.3 6.4.3

6.2.3 6.3.3 6.4.3

6.2.3 6.3.3 6.4.3

6.2.3 6.3.3 6.4.3

6.2.3.1 6.3.3.1 6.4.3.1

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.4 6.3.4 6.4.4

6.2.5 6.3.5 6.4.5

6.2.5 6.3.4 6.4.5

6.2.5 6.3.5 6.4.5

6.2.5 6.3.5 6.4.5

6.2.6.1 6.3.6.1 6.4.6.1

6.2.6.1 6.3.6.1 6.4.6.1

6.2.6.2 6.3.6.2 6.4.6.2 Test Plan: Performance Test Plan

6.2.6.2 6.3.6.2 6.4.6.2 Test/Inspection Reports: Performance Test Report

6.2.6.2 6.3.6.2 6.4.6.2

6.2.6.3 6.3.6.3 6.4.6.3 Test Plan: Functional Test Plan

6.2.6.3 6.3.6.3 6.4.6.3

6.2.6.3 6.3.6.3 6.4.6.3 Computer Software Product End Items: Functional Test Scripts

6.2.6.4 6.3.6.4 6.4.6.4 Contractor Training of Government Personnel Training Materials

PERFORMANCE ASSESSMENT REPORT (PAR)

(If more space is needed, use reverse and identify by number)

4. QUALITY ASSURANCE PERSONNEL (COR) SIGNATURE AND DATE

I. PERFORMANCE

7. |_| DEFICIENCY (CHECK ALL BOXES THAT APPLY)

|_| NEW

|_| REPEAT

|_| NO DEFICIENCY NOTED

8. SERVICES SUMMARY or PWS PARAGRAPH ITEM REVIEWED

II. CONTRACTOR VALIDATION

11. CONTRACTOR REPRESENTATIVE |_| CONCUR |_| NON-CONCUR

12. CORRECTIVE ACTION ESTIMATED COMPLETION DATE

13. CONTRACTOR REPRESENTATIVE CORRECTIVE ACTION AND PREVENTION OF RECURRENCE OR REASON FOR NON-CONCURRENCE OF COR CITED DEFICIENCY

III. ACTION CORRECTED

14. |_| CONCUR |_| NON-CONCUR COR SIGNATURE AND DATE

15. COR REMARKS (REQUIRED)

6. CONTRACTOR REPRESENTATIVE REMARKS

Appendix 2 – Performance Assessment Report Template

Appendix 3 – Customer Complaint Record Template

CUSTOMER COMPLAINT RECORD

DATE/TIME OF COMPLAINT

SOURCE OF COMPLAINT

ORGANIZATION

BUILDING NUMBER

INDIVIDUAL

PHONE NUMBER

NATURE OF COMPLAINT

CONTRACT REFERENCE

VALIDATION

DATE/TIME CONTRACTOR INFORMED OF COMPLAINT

ACTION TAKEN BY CONTRACTOR

RECEIVED/VALIDATED BY

Appendix 4 – Corrective Action Report Template

CORRECTIVE ACTION REPORT (CAR)

(If more space is needed, use reverse and identify by number)

1. CONTRACTOR

2. CONTRACT NUMBER

3. TYPE OF SERVICES

4. FUNCTIONAL AREA

5. SUSPENSE DATE

6. CONTROL NUMBER

7. DEFICIENCY |_| MAJOR |_| MINOR

FINDING:

FINDING IMPACT:

Please respond with a written corrective action plan that details the corrective action of the cited deficiency, the cause of the deficiency, and actions taken to prevent recurrence by Suspense Date in Block 5. If date was not entered in Block 5, the Contractor is not required to provide a response.

8. QUALITY ASSURANCE PERSONNEL (COR)

TYPED NAME AND GRADE

SIGNATURE AND DATE

9. ISSUING AUTHORITY

TYPED NAME AND GRADE

SIGNATURE AND DATE

10. COR RESPONSE TO CONTRACTOR CORRECTIVE ACTION AND ACTION TAKEN TO PREVENT RECURRENCE

11. COR DETERMINATION

|_| ACCEPTED |_| REJECTED

12. CLOSE DATE

Enclosure 6, Page 1 of 4 Pages 17Jul2013/Version 2

C2 T&E QASP

Page 7 of 10 Pages 31 January 2018