Atch 1 Quality Assurance Surveillance Plan.pdf

W81K04-22-R-0005

ATTACHMENT 1

Quality Assurance Surveillance Plan (QASP)

For

Neurocognitive Assessment Testing and Support Services

1. Purpose.

This Quality Assurance Surveillance Plan (QASP) is a government developed and applied document used to provide a standard of surveillance for contract service provider Neurocognitive Assessment Testing and Support Services in support for U. S. Army Medical Command’s neurocognitive assessment program for all Department of Defense (DOD) agencies (Army, Navy/Marine Corps, and Air Force) and the U. S. Coast Guard. It provides the approach the government will use to conduct surveillance over the performance aspects of the effort. The intent is to ensure that the contractor performs in accordance with performance metrics set forth in the contract documents, that the government receives the quality of services called for in the contract, and that the government only pays for the acceptable level of services received.

2. Scope.

The QASP is put in place to provide government surveillance oversight of the contractor’s quality control efforts to assure they are timely, and effective, and results are performed as specified in the contract. The QASP is not a part of the resulting contract nor is it intended to duplicate the contractor’s internal quality management efforts.

3. Government Roles and Responsibilities.

The following personnel shall oversee and coordinate surveillance activities.

3.1. Contracting Officer (KO). The KO is responsible for monitoring contract compliance, contract administration, and cost control and for resolving any differences between the observations documented by the Contracting Officer’s Representative (COR) and the contractor. The KO will designate a COR as the government representative for performance management. The number of additional government representatives serving as inspectors depends on the complexity of the services measured, as well as the contractor’s performance, and must be identified and designated by the KO.

3.2. COR. The COR is designated in writing by the KO to act as his or her authorized representative. The COR will assist the KO with the technical administration of the contract to ensure proper government surveillance of the contractor’s performance. Any COR limitations will be identified with the designation letter. The COR is not empowered to make any contractual commitments or to authorize any contractual changes on the government’s behalf. Any changes the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action. The COR is responsible for Quality Assurance (QA) monitoring and completion of forms/reports used to document the inspection and evaluation of the contractor’s work performance. Government surveillance may occur under the terms and conditions of the contract for inspection.

3.3. Other Key Government Personnel. Upon award, the government may enter performance monitors, etc., who may provide input to the COR for reporting purposes.

3.4. The following contract service provider will serve as the contractor’s representative for this contract: (Upon award, government will enter name(s)).

4. Inspection Instructions.

4.1. The contractor shall provide and maintain an inspection system acceptable to the government covering the services under this contract. Complete records of all inspection work performed by the contractor will be maintained and made available to the government during contract performance.

4.2. If any of the services do not conform to contract requirements, the government may require the contractor to perform the services again in conformity with contract requirements, at no additional cost to the government. When the defects in services cannot be corrected by reperformance, the government may require the contractor to take necessary action to ensure that future performance conforms to contract requirements and reduce the contract price to reflect the reduced value of the services performed.

4.3. The government has the right to inspect and test all services called for by the contract, to the extent practicable at all times and places during the term of the contract. The government shall perform inspections and tests in a manner that will not unduly delay the work.

4.4. If the contractor fails to promptly perform the services again or to take the necessary action to ensure future performance in conformity with contract requirements, the government may, by contract or otherwise, perform the services and charge to the contractor any cost incurred by the government that is directly related to the performance of such service; or terminate the contract for default.

4.5. If the government performs inspections or tests on the premises of the contractor or a subcontractor, the contractor shall furnish, and shall require subcontractors to furnish, at no increase in contract price, all reasonable facilities and assistance for the safe and convenient performance of these duties.

5. Methods of Inspection. (The method of inspection and the level of surveillance used will be reflected in the PRS under the “Method of Inspection” column and must match what is selected in Enclosure 1 to QASP, QASP Checklist.)

5.1. The below listed methods of surveillance may be used in the administration of this QASP. They can occur quarterly, monthly, or as needed:

a. 100% Inspection. The COR may conduct 100% inspections of the work defined in the performance work statement (PWS). The COR will also review information submitted in the required reports defined in the PWS (if applicable).

b. Periodic Inspection. The government may conduct periodic inspections monthly, quarterly, or on an as-needed basis. The periodic inspection shall be conducted by the COR.

c. Random Inspection. The government may conduct random monitoring by reviewing information/reports required and submitted in accordance with the contract. The random monitoring shall be performed by the COR.

d. Performance Evaluation Meetings. The contractor and the COR will meet as often as necessary to review the contractor’s performance and address any contract discrepancy reports (CDRs) issued during the period. A mutual effort will be made to resolve identified issues.

e. Customer Feedback – The COR may provide and collect customer surveys or complaints regarding performance. A mutual effort will be made to resolve any problems/issues identified.

5.2. Level of surveillance may be conducted on a monthly, quarterly or as-needed basis and an analysis of the results will determine if the contractor met the standards or did not meet the standards identified in the PWS/contract.

6. Performance Requirements Summary (PRS).

Performance Requirement

PWS

Reference

Performance Standard Acceptable Quality Level

(AQL)

Surveillance Method

Incentive/ Disincentive

NCAT

Baseline Assessments

IAW PWS

paragraphs

1.5 and 5.1.

Services meet the goals as set by DOD Health Affairs and objectives of the PWS in testing deploying Service members of the Army, Navy, Air Force, and Marines within 12 months of deployment.

100 % of all deploying service members will be identified for compliance with DOD Health Affairs NCAT policy and objectives.

-Progress or status meetings

-Validated User Customer Complain ts

Contractor Management notification

Document performance in

CPARS

-Periodic Inspection

NCAT Test Scheduling and Coordination

IAW PWS

paragraphs 5.1, and 5.5.2.

Services meet the goals as set by DOD Health Affairs and the PWS in scheduling deploying Service members of the Army, Navy, Air Force, and Marines to receive baseline testing within 12 months prior to deployment.

100 % of all deploying service members will be scheduled for testing prior to deployment.

-Progress or status meetings

-Validated User Customer Complain ts

-Periodic Inspection

Contractor Management notification

Document

CPARS

NCAT

Program IT Support

IAW PWS

paragraphs 1.4 and 5.3.

Meet the objectives in the PWS and ensure the ANAM program receives adequate IT support to fulfill the requirements of the DOD mandated ANAM program.

90 % of all laptops used in testing will be available at all times for testing.

-Progress or status meetings

-Validated User / Customer Complaints

Contractor Management notification

Document performance in

CPARS

NCAT/ANA

M Software/ Server Management

IAW PWS

paragraphs 4, 1.7.2, 5.2.3, and 5.3.

Meet the objectives of the PWS and the Computer Equipment Configuration and Data Management SOPs: system(s) are optimized to enhance NCAT program services.

90 % of all laptops used in testing will be current as to all software and documentation requirements.

-Progress or status meetings

-Periodic Inspection

Contractor

CPARS

Training Support

IAW PWS

paragraph 3.3.

Services meet the objectives of the PWS and all site and program specific requirements.

Training Plan and course curriculum is submitted within 90 days of contract award.

90% of requests for training will be accomplished upon request after 90 days of contract performance start.

-Progress or status meetings

-Validated User Customer Complain ts

-Periodic Inspection

Contractor

CPARS

Personnel IAW PWS paragraphs

1.7 and 5.3.

Services meet the objectives of the PWS all contractor NCAT Testers, under the NCAT program office are properly trained

100 % of the contractor personnel will meet training and certification requirements

-Periodic Inspection

Contractor and technically competent.

Isolated Test Sites

IAW PWS

paragraphs

1.4.2 and 5.5.1.

Services meet the objectives of the PWS, isolated site test support.

100 % coverage will be provided at isolated test sites for scheduled test dates in sufficient staffing to test all

NCAT

participants.

-Periodic Inspectio n

-Validated User / Customer Complaints

Contractor

CPARS

Embedded Test Sites

IAW PWS

paragraphs

5.5.1 and 5.7.

Services meet the objectives of the PWS, embedded test sites.

There will be no embedded test site unfilled, with qualified personnel for more than 60 days

-Periodic Inspectio n

-Validated User / Customer Complaints

Contractor

CPARS

Tracking/ Reporting

IAW PWS

paragraphs

1.4 and 5.2.3.

Services meet the objectives of the PWS, data tracking and reporting is accurate, clear, and concise, and reports are provided within the timelines established in the delivery schedule at paragraphs in 5.1.9.1 through 5.1.9.16.

90% of all reports due will be provided by the due date specified in the

PWS.

-Progress or status meetings

Contractor

CPARS

Coordinate Travel

IAW PWS

paragraphs 5.5.1 and 5.6.

Services meet the objectives of the PWS and travel arrangements are made within 14 days of government notification provided the Government has notified the contractor of the required travel 14 days in advance.

100% of all travel shall be coordinated with the COR

-Progress or status meetings

-Validated User / Customer Complaints

Contractor

CPARS

Support Equipment Management

IAW PWS

paragraphs 1.4, 1.4.2.1, 5.2.2, 5.2.4, 5.2.4.1, 5.3, 5.4, 5.5, 5.6.4, and 5.7.

Services meet the objectives of the PWS and equipment acquisition is tracked, documented, deployed, transferred, and managed.

100% of Government Furnished equipment is maintained tracked. All laptops are shipped on time to support scheduled testing.

-Progress or status meetings

-Validated User Customer Complain ts

-Periodic Inspection

Contractor

NCAT

Technical Support/Cust omer Service Desk

IAW PWS

paragr aphs 1.4.2.1 , 5.2.1, 5.2.2, 5.2.3, and 5.7.5.6.

Services meet the objectives of the PWS, incoming requests for baseline NCAT test results are monitored on a daily basis, and baseline data results are reported to requester within 24 hours of request.

Technical Support/Custome r Service desk will be operational 98% of the stated hours in the

PWS.

- Progress or status meetings

-Validated User Customer Complain ts

-Periodic Inspection

Contractor

CPARS

Manage the collection of NCAT data in the central data repository

IAW PWS

paragraphs 1.7.2, 5.2.1, 5.2.3, 5.3, 5.6.2, and 5.7.2.

Services meet the objectives of the PWS and NCAT data in the NCAT/Central data repository maintained is a secure and safe manner, including daily backups of data to maintain its integrity.

There will no material weakness findings in the operation of the data repository.

-Progress or status meetings

-Validated User Customer Complain ts

-Periodic Inspection

Contractor

A. 100 % Inspection: One Hundred Percent Inspection is exactly what the title implies – inspecting a requirement every time it occurs.

B. Customer Complaint: A customer complaint is a valid complaint when the Quality Assurance Plan (QAP), after a thorough investigation, determines that 100% of Medical Standards of Care have not been met.

C. Other Primary Surveillance Methods – Random sampling, customer complaints, 100% surveillance, inspections, reports, etc.

7. Successful Performance.

7.1. Successful performance can be incentivized with favorable past performance ratings and award of follow-on opportunities.

7.2. Acceptable services for performance is demonstrated by an accepted and executed certified invoice and receiving report, as applicable.

7.3. The acceptable quality level (AQL) consists of the performance standards established for the services required by the government to meet contract requirements. The AQL will be measurable and structured to permit an assessment of the contractor’s performance.

8. Documentation of Surveillance.

8.1. Effective contract surveillance relies on the COR identifying and documenting discrepancies during performance of routine daily services, or through the contractor’s quality control program. The COR will report discrepancies to the contractor for timely resolution. Survelliance may consist of periodic reports, and customer feedback and timeliness of contract deliverables/reports.

8.2. The COR will maintain a complete QA file which will be retained by the COR for the life of the contract.

Information in the QA file will be considered when completing the annual CPARS report.

8.3. Documented surveillance will consist of inspections performed by the COR. Examples of documentation that supports contract surveillance consist of details of inspections or data gathering, conversations or meetings with the contractor, notes and comments that support inspection paperwork, to include quality assurance surveillance reports.

If performance is deemed unacceptable, the COR will inform the contractor about possible reperformance soultions.

Disagreements or disputes will be referred to the KO for review.

8.4. All documentation resulting from surveillance will be made a part of the contract file. The COR must keep the QA files during the surveillance period, but at the conclusion of the contract, and as directed by the KO, the COR must give the files to the KO for inclusion in the official contract file.

9. Corrective Actions.

9.1. The contractor will be provided the opportunity to submit proposed corrective action to resolve the discrepancy.

The COR will review proposed corrective action and determine whether or not it is acceptable and whether or not the discrepancy has been corrected. If the discrepancy has been resolved, the COR will notify the contractor and document the quality assurance surveillance checklist.

9.2. The COR will notify the contracting officer of unacceptable performance if any services do not conform to contract requirements. The contracting officer may require the contractor to re-perform the services to conform with contract requirements at no additional cost to the government.

9.3. When unacceptable performance cannot be corrected by re-performance, the government may require the contractor to take action necessary to ensure future performance conforms with contract requirements.

9.4. The government may, by separate contract or otherwise, perform the services and charge the contractor any cost incurred that is directly related to the performance of such service, or issue:

9.4.1. Cure Notice

9.4.2. Show Cause

9.4.3. Terminate the contract for convenience of the government

9.4.4. Terminate the contract for cause

10. Certification of Services. Certification of services is performed by the COR via Wide Area Work Flow (WAWF) system. At the end of each billing period, the contractor inputs invoice information into WAWF system. WAWF automatically notifies the appropriate COR via email of pending invoice. COR accesses WAWF and verifies the accuracy of services provided by the contractor. The COR will certifiy the invoice and payment is conducted by the Defense Finance Accounting System (DFAS). If the COR encounters errors in the contractor’s invoice, the COR will reject the invoice, state the reason for rejection and WAWF will send the invoice back to the contractor. If the contractor disagrees with the COR, the issue will be forwarded to the KO for resolution.

11. QASP Checklist, Enclosure 1 to QASP

12. Contract Discrepancy Report (CDR), Enclosure 2 to QASP (Optional)

Enclosure 1 to QASP

QASP Checklist

Service or Standard:

Survey Period: ___________________________________________________________

Surveillance Method: (Check) (The method of inspection and the level of surveillance selected must match what is reflected in the PRS under the “Method of Inspection” column.)

_____ 100% Inspection

_____ Periodic Inspection

_____ Random Monitoring (reports)

_____ Performance Evaluation Meetings

_____Customer Feedback

Level of Surveillance: (Check): _____ Monthly

_____ Quarterly

_____ As needed

Analysis of Results:

Contract Service Provider’s Performance (Check): _____ Meets Standards

_____ Does Not Meet Standards

Narrative of Performance During Survey Period:

Prepared by____________________________________________ Date_____________________

Enclosure 2 to QASP Contract Discrepancy Report