Att3-SOFRAPTORIV-QASP-Draft.pdf.pdf

QUALITY ASSURANCE SURVEILLANCE PLAN (QASP)

FOR

Special Operations Forces Requirements, Analysis, Prototyping, Training, Operations and Rehearsal

(SOF RAPTOR IV)

CONTRACT NO: W900KK-19-R-0078

U.S. Army Program Executive Office for Simulation, Training and Instrumentation (PEO STRI)

12350 Research Parkway Orlando, FL 33826-3276

QUALITY ASSURANCE SURVEILLANCE PLAN

SOF RAPTOR IV

W900KK-19-R-0078

1. PURPOSE: This Quality Assurance Surveillance Plan (QASP) will be used as a guide to Government Quality Assurance Personnel (QAP), it provides a systematic method to evaluate the services the contractor is required to furnish. The Surveillance /Evaluation Methods identified in the QASP, in concert with the Contractor's Quality Control Procedures will assure the Government of satisfactory contractor performance. The QASP is the management tool for documenting site surveillance conducted on contractors, contractor performance evaluation, and reporting of contractor performance.

The QASP is intended to be a ''living document''. That is, it should be revised or modified as circumstances warrant throughout the contract period. Following contract award, this document should be reviewed to ensure that it will work cooperatively with the Contractor's Quality Control Plan, but not duplicate its provisions. The contractor, and not the government, is responsible for management and quality control actions to meet the terms of the contract. The role of the government is to ensure contract standards are achieved.

2. METHODS AND FREQUENCY:

The principal methods that apply to the type of work being performed on this contract are management information systems, i.e., schedules, reports, inspection, observation, and receiving formal complaints. One or any combination may be used. The Contracting Officer's Representative (COR) will provide timely feedback to the contractor on unacceptable performance. Prompt feedback is essential so the contractor can develop and implement a corrective action plan. Surveillance will be conducted on an as required basis, with a QASP for each specific Task Order that is tailored to meet the requirements for oversight to evaluate services and products.

When required, a QASP Report (Ref: Appendix A), will be prepared by the Assistant Product Manager responsible for the Task order, a copy will be provided to the COR and submitted to the Procuring Contracting Officer (PCO). Out of cycle reports may be submitted in support of unacceptable performance identified during the performance period by the COR (via the responsible Assistant Product Manager) or when there is a significant change in performance that alters the assessment in one or more evaluation areas.

3. REVIEW RESPONSIBILITIES:

Contracting Officer: Brian D. Serra - 407-208-3357 – brian.d.serra.civ@mail.mil

COR – Rick Matthews – 407-384-3751 – richard.w.matthews.civ@mail.mil

4. PERFORMANCE AREAS:

A. Quality of Service or Product.

The contractor will be evaluated as to the quality of the output of their work. The contractor's personnel should be technically competent in the functional area(s) identified in each specific SR IV Task Order. Included in the technical performance are the contractor's contributions in meetings and reviews, the quality of the contractor's productivity, reports and CDRL’s as well as the overall quality of the technical support provided.

B. Schedule

For each SR IV Task Order, the specific QASP Report will quantify how to best evaluate the contractor’s performance to the best extent possible, the percentage of tasks being complete on time, ahead of schedule or behind schedule. For all deliverables, discuss the milestones, deliverable items or significant data items that contribute to the schedule evaluation. Discuss causes and evaluate effectiveness of contractor corrective actions.

C. Cost Control

Since each Task Order is tailored to meet SOF customer requirements and in most cases customer funded, it will be up to each TO project team to best determine how to evaluate the quality and effectiveness of the contractor's management of the contract. The contractor should be evaluated in the successful control of resources devoted to the successful delivery of services or products for the specific Task Order. The Project Team shall address the adequacy of the contractor's initial staffing and evaluate effectiveness of subcontract management activity, if applicable.

D. Invoice Vouchers

The COR will work with the Task Order team to evaluate the quality and timeliness of invoice submissions. The contractor shall submit invoices for Firm Fixed Price and Labor Cost CLINs monthly. Invoices covering subcontractors will be submitted in a timely manner once received. The COR will coordinate with the Task Order team to review the invoices for accuracy as related to the work accomplished over the period of the invoices.

E. Business Relations

Evaluate the adequacy of the contractor's responsiveness and management. Address the extent to which the contractor demonstrates a thorough understanding of the customer's requirements and keeps the government informed of work progress, and provides for early problem identification and effective corrective action plans. In addition, the effectiveness of support to any on-site workforce (such as instructor/operators) should be considered along with the timeliness of their work requests as covered under each Task Order, as it applies.

5. EVALUATION CRITERIA:

(Exceptional) Performance meets contractual requirements and exceeds many to the Government’s benefit.

Contractual performance of element(s) and/or sub-element(s) assessed were accomplished with few minor problems for which corrective actions taken by the contractor were highly effective. Meets or exceeds all contractual requirements after corrective actions. Rating is a 3

(Satisfactory) Performance meets contractual requirements. Contractual performance of element(s) and/or sub-element(s) contain minor problems for which corrective actions taken by the contractor were adequate. Meets contractual requirements after corrective actions. Rating is a 2

(Unsatisfactory) Performance does not meet most contractual requirements. Contractual performance of element(s) and/or sub-element(s) contain significant problems for which the contractor corrective actions were ineffective. Does not meet contractual requirements after corrective action. Rating is a 1

6. DOCUMENTATION:

A. Task Order Documentation

As applicable for each Task Order, documentation will be used and referenced in the TO specific QASP to perform surveillance which could consist of technical reports, contractor plans and procedures, schedules, customer feedback and contract data requirements. During the course of the contract, the COR, via the TO Project team will retain a copy of all QASP Reports. At the end of the surveillance period, the COR forwards these records for inclusion in the contract file; However, when a specific service becomes unsatisfactory during a surveillance period the inspection documentation supporting the contract discrepancy report is forwarded to the PCO.

B. Recording Observations

When used, each Task Order QASP Report, records information on observations and defects; the documents then become a formal record for reference. The contractor is told each time that a defect is found during scheduled or unscheduled observations. The Assistant Product Manager, in coordination with the COR, asks the contractor task leader to initial the notation, documenting notification of the defect.

C. Potential Unacceptable Performance

The TO Assistant Product Manager, in coordination with the COR must identify the specific product and/or service that is unacceptable and the possible causes.

D. Documenting Unacceptable Performance

1. The TO Assistant Product Manager and the COR will attempt to resolve the problem with the contractor. The original report and the attempted solution, along with an evaluation of results, need to be posted electronically in the contract file.

2. Based on the severity of the discrepancy and the success of the solution, the COR will notify the PCO. The contractor shall complete a response to the unacceptable evaluation if requested by the PCO or by its own choice.

E. Taking Action

1. The COR may evaluate the contractor's performance and document any non-compliance, but only the PCO may take action against the contractor for an unacceptable rating.

2. When the contractor's performance is unacceptable and a formal action is indicated, the COR and the TO Assistant Product Manager will determine what action is appropriate for the specific circumstances and make a recommendation to the PCO.

7. RATING:

All contractor tasks will be rated as according to the scale listed above. Any reports will be collected with necessary supporting documentation and be given a rating for each of the CLINs or performance areas using the evaluation criteria in Section 5 of the plan.

8. QASP REPORT:

QASP Reports (Ref: Appendix A) will be used to record observations and defects and rate individual contractor tasks, The Report will be used to give overall ratings in the performance areas identified in Section 4.

RICHARD W. MATTHEWS BRIAN D. SERRA

Contracting Officer’s Representative Contracting Officer

Appendix A – Government QASP Report Tool

Appendix B – Contractor Observation Report

Appendix C - FAR Inspection Excerpt

MATTHEWS.RICHA

RD.W.1067293513

Digitally signed by

MATTHEWS.RICHARD.W.1067293

Date: 2018.04.02 09:09:38 -04'00'

Digitally signed by

SERRA.BRIAN.D.1368988622

Date: 2018.04.03 13:43:19

-04'00'

Appendix A

Methods and Metrics

Performance assessments will be accomplished using a combination of assessment methods/metrics listed.

Frequencies:

Surveillance Method/ By Whom Frequency Comments

Contractor Self Reporting/ Contractor Each Course Reports contractor efforts and accomplishments.

Course Assessment/ QAR Each Course Evaluates using PWS and Appendix B.

Performance Assessment/ COR, PD Monthly Evaluates using QAR and contractor course reports.

Program Review/ Stakeholders Semi-annual On-site performance review with stakeholders.

Customer Input/ Customer As received PD validates input and responds to the customer.

QARs will conduct inspections during each course and document the results on the checklist provided in Appendix B. Checklist data and COR/QARs observations will include at a minimum:

Individual conducting assessment.

Course being assessed and location/ site.

Date and time of assessment.

Number of students trained.

Contractor ratings.

If above or below standard - details of circumstances resulting in the evaluation.

Provide copies if critical documents generated.

Signature of inspector.

Metrics:

Rating Definition

Above standards (3)

Performance exceeds contractual requirements to the Government’s benefit. This rating must be accompanied with specific comments on how the Government benefited. This rating denotes accomplishing required elements with few minor problems for which corrective actions taken by the contractor were highly effective.

Meets standards (2)

Performance meets contractual requirements. This rating denotes accomplishing required elements with some minor problems for which corrective actions taken by the contractor were satisfactory.

Below standards (1)

Performance does not meet contractual requirements. This rating must be accompanied with specific comments on requirements not met. This rating denotes that required elements were not performed IAW contractual requirements and/or required elements contained serious problem(s) for which the contractor’s corrective actions were ineffective.

Each course assessment will be recorded on the form provided in Appendix B. A “meets standards” or “2” rating does not requires specific evaluation notes. All other ratings require specific justification. Use back of the checklist and\or additional paper if needed. Unsatisfactory ratings will be brought the attention of the contractor and forwarded to the PD, COR and KO. If unsatisfactory elements need to be re-performed the QAR will submit an assessment of re-performed elements with initial assessment.

Appendix B

Contractor Observation Report

Course: Date and Time:

Location/ Site: # Students Trained:

Site Lead:

# Contractors Present During Training:

Instructors, Role Players, etc.

Assessment Conducted By:

Rating: * 1 = below standards 2 = meets standards * 3 = above standards

* below or above standard ratings must be supported with comments.

Y N

QUALITY

* 1 2 * 3

1. Contractors are participating in the training?

2. Contractors demonstrate subject matter knowledge of learning objectives?

3. Contractors are prepared for training IAW task, conditions, and standards or desired training objectives?

4. Contractors conducted rehearsals prior to training?

5. Contractors are participating in the conduct/evaluation/reporting process of training?

6. Contractors are performing practical/ hands-on training to assess individual task proficiency?

7. Contractors are using AARs to improve and sustain training?

8. Contractors are professional?

9. Contractors are meeting or exceeding training requirements?

Additional Comments:

Signature: Date:

Appendix C

FAR Inspection Excerpt

52.246 – 4 Inspection of Services – Fixed Price: As prescribed in 46.304, insert clause:

Inspection of Services – Fixed Price (Aug 1996)

a) Definition: “Services” as used in this clause, includes services performed, workmanship, and material furnished or utilized in the performance of services

b) The contractor shall provide and maintain an inspection system acceptable to the Government covering the services under this contract. Complete records of all inspection work performed by the contractor shall be maintained and made available to the Government during contract performance and for as long afterwards as the contract requires.

c) The Government has the right to inspect and test all services called for by the contract, to the extent practicable at all times and places during the term of the contract. The Government shall perform inspections and tests in a manner that will not unduly delay the work.

d) If the Government performs inspections or tests on the premises of the contractor or a subcontractor, the contractor shall furnish, and shall require subcontractors to furnish, at no increase in contract price, all reasonable facilities and assistance for the safe and convenient performance of these duties.

e) If any of the services do not conform with contract requirements, the Government may require the contractor to perform the services again in conformity with contract requirements, at no increase in contract amount. When the defects in services cannot be corrected by re-performance, the Government may:

1) Require the contractor to take necessary action to ensure that future performance conforms to contract requirements; and

2) Reduce the contract price to reflect the reduced value of the services performed

f) If the contractor fails to promptly perform the services again or to take the necessary action to ensure future performance in conformity with contract requirements, the Government may –

1) By contract or otherwise, perform the services and charge to the contractor any cost incurred by the Government that is directly related to performance of such service; or

2) Terminate the contract for default

(End of Clause)