Attach_8_-QASP_CSP.pdf

N00421-16-R-0059

Quality Assurance Surveillance Plan and Contract Surveillance Plan for

Technical and Engineering Services (TES)

1. Purpose

This requirement consists of both performance-based and non-performance-based orders;

therefore, a Quality Assurance Surveillance Plan (QASP) and a Contract Surveillance Plan

(CSP) are both required. The QASP/CSP is used to ensure that the contractor performs in accordance with the performance standards and definitions/metrics and the Government receives the quality of services called for in the contract.

This hybrid QASP/CSP is a Government developed and applied document used to ensure systematic quality assurance methods are used in the administration and surveillance of performance based and non-performance based tasking under the contract. The intent is to ensure the contractor performs in accordance with the performance based standards and definitions and non-performance based required Level of Effort (LOE), and the Government receives the quality of services called for in each Task Order (TO) Performance Work Statement

(PWS)/Statement of Work (SOW).

This contract will leverage the SAIW Division’s core capabilities involving engineering and technical services to support the advanced research and development, systems engineering, and life-cycle support of electronics, communications, and information systems. The scope of the contract encompasses rapidly developed engineering designs for end products intended for immediate warfighter operational use, and may include strategic and tactical airborne, land-based, and mobile, sea-based surface and sub-surface, systems, subsystems and components.

The following are representative of the programs, systems, and technology areas to which the requested engineering and technical services may be applied:

Military and commercial radio communication systems

Information and computer network systems

Command and control systems

Automatic identification technology systems

Integrated document management systems

Multimedia systems

Embedded and stand-alone sensors systems

Unmanned Aerial Systems

Cyber Warfare offensive and defensive solutions

A properly executed QASP/CSP will assist the Government in achieving the objectives of this procurement.

2. Authority

Authority for issuance of this hybrid surveillance document is provided under Contract Section E

– Inspection and Acceptance, which provides for inspections and acceptance of the services, products, and documentation called for in the contract, which will be executed by the

Contracting Officer or a duly authorized representative.

3. Scope

To fully understand the roles and responsibilities of the parties, it is important to first define the distinction in terminology between Quality Control Plan and the QASP/CSP. The contractor, and not the Government, is responsible for the Quality Control Plan, which defines the management and quality control actions necessary to meet the quality standards set forth in the contract and all resultant orders.

The hybrid QASP/CSP provides Government surveillance oversight of the contractor’s efforts to assure they are timely, effective, and delivering the results specified in the contract and each TO.

4. Government Resources

The following definitions for Government resources are applicable to this plan:

Contracting Officer (KO): A person duly appointed with the authority to enter into a contract

(Procuring Contracting Officer (PCO)), or a person with the authority to administer contracts

(Administrative Contracting Officer (ACO)), and make related determinations and findings on behalf of the Government. The PCO for this contract is AIR-2.5.1.3. The ACO will be designated in the resulting contract. Contracting officers are designated via a written warrant that sets forth limitations of authority.

Contracting Officer Representative (COR): An individual appointed in writing by the PCO to act as their authorized representative to assist in administering the contract. The COR will be appointed in the resulting contract. The limitations of authority are contained in the letter of appointment.

Alternate Contracting Officer Representative (ACOR): An individual appointed in writing by the PCO to act as their authorized representative, in the absence of the COR, to assist in administering the contract. The ACOR will be appointed in the resulting contract. The limitations of authority are contained in a written letter of appointment.

Government Project Leads (GPL): The COR designates individual GPL to assist in administering of specific efforts under the contract.

5. Responsibilities

The following Government resources will have responsibility for the implementation of this hybrid QASP/CSP Surveillance Plan:

Contracting Officer (abbreviated KO): The KO (either the PCO or ACO) ensures performance of all necessary actions for effective contracting, ensures compliance with the terms of the contract, and safeguards the interests of the United States in the contractual relationship. It is the KO that assures the contractor receives impartial, fair and equitable treatment under the contract. The KO is ultimately responsible for the final determination of the adequacy of the contractor’s performance.

Contracting Officer Representative: The COR is responsible for technical administration of the contract and assures proper Government surveillance of the contractor’s performance. The

COR is not empowered to make any contractual commitments or to authorize any changes on the

Government’s behalf. Any changes that the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action.

Alternate Contracting Officer’s Representative: The ACOR assists the COR for technical administration of the contract and assures proper Government surveillance of the contractor’s performance. The ACOR is not empowered to make any contractual commitments or to authorize any changes on the Government’s behalf. Any changes that the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action.

Government Project Leads: The GPLis responsible for assisting in administering of specific efforts under the contract. A GPL cannot, in any manner, alter the scope of the contract, make commitments or authorize any changes on the Government’s behalf.

6. Methods of QA Surveillance

a. Contractor Performance Assessment Reporting System (CPARS): The marketplace for advanced research and development, systems engineering, and life-cycle support of electronics, communications, and information systems services is very competitive. As such, the successful offeror has a vested interest in the Government-generated CPARS under this contract. Additionally, an evaluation using the CPARS format will be performed annually at the end of each ordering year. This evaluation will be one determinant in the award of future contracts or TOs. The Government will address the quality of product or service, schedule, cost control, business relations, management, utilization of small business, and other important areas for this procurement. Some of the monitoring methods to be used will be

Government observation, review of reports, customer feedback, and review of Contract Data

Requirements Lists (CDRLs). As this information may affect future source selections throughout the Department of Defense (DOD), as well as the continuation of this tasking, the annual Government assessment will be used appropriately as an additional performance oversight and communication tool within the policies of this hybrid QASP/CSP.

b. QASP/CSP: This document will be used by the COR, ACOR, and GPL in the technical administration of this contract. In addition to the below instructions, the form to be used for documentation of quality assurance surveillance is the hybrid checklist provided herein.

7. Surveillance

Enclosures (1) through (3) set forth the performance standards, incentives, and surveillance methods for the contractor, the COR and GPL while enclosures (4) through (6) provides the checklist and means for the COR to document the results of the surveillance and will be provided to the KO.

8. Documentation

In addition to providing reports to the KO, the COR will maintain a complete Quality Assurance file. The file will contain copies of all reports, evaluations, recommendations, and any actions related to the Government’s performance of the quality assurance function, including the originals of the Surveillance Activity Checklists. All such records will be maintained for the life of the contract. The COR will forward these records to the KO at termination or completion of the contract.

9. Enclosures

Enclosure (1): Quality Standards – In-Service Engineering by PWS (Performance Based)/SOW

(Non-Performance Based)

Enclosure (2): CDRL Data Quality Standards (Performance Based)

Enclosure (3): Incentives

Enclosure (4): Surveillance Activity Checklist – Level Of Effort & Performance Based

Enclosure (5): Contract Surveillance by Contract Data Requirements Lists (Level of Effort &

Performance Based)

Enclosure (6): Annual Surveillance Summary

Enclosure (1)

QUALITY STANDARDS – IN-SERVICE ENGINEERING BY PWS

(PERFORMANCE BASED)

Required

Service

(Performance

Requirements)

Standard (Performance

Standards) / Maximum Allowable

Degree of Deviation Requirement

(AQL)

Method of

Surveillance

(Quality

Assurance)

Incentives

System

Integration and

Life-Cycle

Support IAW

PWS/SOW

Para 3.3.3

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure

Cybersecurity

IAW

PWS/SOW

Para 3.3.5

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure

QUALITY STANDARDS – IN-SERVICE ENGINEERING BY PWS (LEVEL OF

EFFORT)

Required

Service (Non-

Performance

(LOE)

Requirements)

Standard (Performance

Standards) / Maximum Allowable

Degree of Deviation Requirement

(AQL)

Method of

Surveillance

(Quality

Assurance)

Concept and

Technology

Development

IAW

PWS/SOW

Para 3.3.1

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure

System

Development and Design

IAW

PWS/SOW

Para 3.3.2

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure (1) in the evaluation.

System

Integration and

Life-Cycle

Support IAW

PWS/SOW

Para 3.3.3

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure

Technical

Management

Support IAW

PWS/SOW

Para 3.3.4

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure

Cybersecurity

IAW

PWS/SOW

Para 3.3.5

Based upon feedback from the

Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable.

Metrics are provided in the TO

SOW and will be used as a Baseline in the evaluation.

100% Inspection by COR/ACOR and/or GPL.

See

Enclosure (2)

CDRL DATA QUALITY STANDARDS (PERFORMANCE BASED AND LEVEL

OF EFFORT)

Description

Standard

AQL

Surveillance/

Method/Measure

Scientific and Technical Reports

Summary A001

Submission is in accordance with the

Data Item Description

(DID) cited in the

CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Scientific and

Technical Reports - Configuration Change

Request Document

A002

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Report, Record of Meeting/Minutes -

Trip/Meeting

Report/Conference Minutes/Agenda A003

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Software Development

Plan (SDP) A004

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Financial Progress

Reports A005

Submission is in accordance with the format detailed in BLK

16 of the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Interface Design Description (IDD)

A006

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL.

See Enclosure 3.

Software Test Report

(STR) A007

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite

100% Inspection by COR, ACOR and/or GPL

See Enclosure

34.

Software User Manuals

(SUM) A008

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Computer Software

Product End Items - End Item Deliverable

A009

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Test Plan - Validation

Test Plan A010

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Test Procedure -

Validation Test

Procedure A011

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure

43.

Test/Inspection Report

- Validation Test

Report A012

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Installation Control

Drawings A013

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical Report -

Study/Services A014

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical Information

Report - Maintenance and Repair

Documentation A015

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Product Drawings/Models &

Associated Lists -

Technical

Documentation for

Repair & Maintenance

- Electronic Format A016

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Contract Performance

Report (CPR) A017

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Security Test Plan

A018

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Presentation Material

A019

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Scientific and Technical Reports -

Elements, Organization and Design A020

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical Information

Report -Project Close-

Out Report A021

Submission is in accordance with the

DID cited in the CDRL.

A one-time deliverable. Must be on time, with no more than one revision.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical Report - Study/Service -

Integration/Installation

Plan Report A022

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3

Change Control

Strategy A023

Submission is in accordance with the format detailed in BLK 16 of the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Operational Security

(OPSEC) Plan A024

Submission is in accordance with the

DID cited in the CDRL.

A one-time deliverable. Must be on time, with no more than one revision.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Reserved A025

Segregation of Costs and Invoice

Requirements Reporting A026

Submission is in accordance with the

DID cited in the CDRL.

A one-time deliverable at each

TO close. Must be on time, with no more than one revision per submission.

100% Inspection by COR, Status Report -

Information Technology Personnel

Security Report for

NAVAIR Security A027

Submission is in accordance with the DID cited in the CDRL.

As an annual report, this deliverable must be on time and with no more than one revision per submission.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Software Requirements

Specifications (SRS)

A028

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Software Design

Description (SDD) A029

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Software Development

Status Report (SDSR) A030

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Software Test Plan

(STP) A031

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3

Contractor’s Configuration

Management Plan

A032

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Configuration Audit

Summary Report A033

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical and

Management Work Plan - Program Plans for Implementation of

SOW and TDLs A034

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Integrated Logistics Support Plan A035

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Logistics Management

Information (LMI)

Data Product A036

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Validation Report -

Validation of

Technical Manual Changes-Via

Demonstration A037

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Training Conduct

Support Document

A038

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Inspection and Test

Plan A039

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Technical Report -

Study Services -Cost

Feasibility Report A040

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, Contractor's Risk

Management Plan A041

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Quality System Plan

Quality Management / Assurance Plan A042

Submission is in accordance with the DID cited in the CDRL.

A one-time deliverable. Must be on time, with no more than one revision.

100% Inspection by COR, ACOR and/or GPL:

See Enclosure 3.

Detailed Project

Schedule A043

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Detailed Task/Activity

Estimate Report A044

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure

43.

Intermediate Project Schedule A045

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Integrated Master Schedule A046

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

System Security

Administrator

Operators Documentation A047

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

NAVAIR

Cybersecurity Implementation Plan

A048

Submission is in accordance with the DID cited in the CDRL.

95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, ACOR and/or GPL

See Enclosure 3.

Transition Out Plan

A049

Submission is in accordance with the

DID cited in the CDRL.

95% of required deliverable provided on time. No more than

1 report per year may be inaccurate or require a rewrite.

100% Inspection by COR, Enclosure (3)

INCENTIVES

The following incentives will apply to performance under this contract.

Assessment Period Acceptable

Performance

Definition

How Measured Incentives

Ordering Year 1:

Not more than one of the measurement areas rated below

“Satisfactory”.

None of the measurement areas are rated below

“Marginal”.

End of the first assessment period using the CPARS format.

(+) Meet the acceptable performance definition as a condition for additional tasking.*

(-) Does not meet the acceptable performance definition as a condition for additional tasking.*

Ordering Year 2: Not more than one of the measurement areas rated below

“Satisfactory”.

None of the measurement areas are rated below

“Marginal”.

End of the second assessment period using the CPARS format covering the previous 12 months.

(+) Meet the acceptable performance definition as a condition for additional tasking.*

(-) Does not meet the acceptable performance definition as a condition for additional tasking.*

Ordering Year 3: Two or more of the measurement areas rated “Very Good” or above. None rated below

“Satisfactory”.

End of the third assessment period using the CPARS format covering the previous 12 months.

(+) Meet the acceptable performance definition as a condition for additional tasking.*

(-) Does not meet the acceptable performance definition as a condition for additional tasking.*

Ordering Year 4: Two or more of the measurement areas rated “Very Good” or above. None of

End of the fourth assessment period evaluation using the

CPARS format

(+) Meet the acceptable performance definition as a the measurement areas are below

“Satisfactory”.

covering the previous 12 months.

condition for additional tasking.*

(-) Does not meet the acceptable performance definition as a condition for additional tasking.*

Ordering Year 5: Two or more of the measurement areas rated “Very Good” or “Exceptional”.

None of the measurement areas are rated “Marginal” or below.

End of the fifth assessment period using the CPARS format covering the previous 12 months.

(+) Meet the acceptable performance definition as a condition for satisfactory or better

Final CPARS rating.

(-) Does not meet the acceptable performance definition which will result in a marginal or unsatisfactory final CPARS rating.

Final CPAR Review After completion of all TOs.

(+) Meet the acceptable performance definition as a condition for satisfactory or better

Final CPARS rating.

(-) Does not meet the acceptable performance definition` which will result in a marginal or unsatisfactory Final

CPARS rating.

* The Government may not award additional tasking (orders) unless all regulatory requirements are met and the contractor meets the acceptable performance definition.

All PWS/SOW and CDRL tasks, including sub-tasks, will be assessed focusing on the following.

Quality of Product or Service: Assess the contractor’s effort to transform operational needs and requirements into an integrated solution. Areas of focus may include the planning and management of program tasks, the quality of support provided throughout all phases of contract execution, the integration of program management specialties, management of interfaces, and the management of a totally integrated effort of all program management concerns to meet cost, performance, and schedule objectives.

Assess how successfully the contractor meets program quality.

Schedule: Assess the contractor’s adherence to the required delivery schedule by assessing the contractor’s efforts during the assessment period that contribute to or effect the schedule variance. Also address significance of scheduled events (i.e., design reviews), discuss causes, and assess the effectiveness of contractor corrective actions.

Cost Control: Assess the contractor’s effectiveness in forecasting, managing, and controlling contract cost. Is the contractor experiencing cost growth or under-run? If so, discuss the causes and contractor proposed solutions for the cost overruns. For contracts where task or contract sizing is based upon contractor provided person hour estimates, the relationship of these estimates to ultimate cost should be assessed. In addition, the extent to which the contractor demonstrates a sense of cost responsibility, through the efficient use of resources in each work effort should be assessed.

Business Relations: Assess the timelines, completeness and quality of problem identification, corrective action plans, proposal submittals, the contractor’s reasonable and cooperative behavior, effective business relations, and customer satisfaction.

Management: Assess the contractor’s success with timely award and management of subcontracts, including whether the contractor met small/small disadvantage and women-owned business participation goals. Discuss the extent to which the contractor discharges its responsibility for integration and coordination of all activity needed to execute the contract; identifies and applies resources required to meet schedule requirements; assigns responsibility for tasks/actions required by contract; communicates appropriate information to affected program elements in a timely manner. Assess the contractor’s risk mitigation plans.

Utilization of Small Business: The RFP and FAR Subpart 19.7 and 15 U.S.C. 637 contains statutory requirements for complying with the Small Business Subcontracting

Program. Assess whether the contractor provided maximum practicable opportunity for

Small Business (including Alaska Native Corporations (ANCs) and Indian Tribes)

(including Small Disadvantaged Businesses (which also includes ANCs and Indian

Tribes), Women Owned Small Businesses, HUBZone, Veteran Owned, Service Disabled

Veteran Owned Small Business, and ANCs and Indian Tribes that are not Small

Disadvantaged Businesses or Small Businesses) to participate in contract performance consistent with efficient performance of the contract. Evaluation will focus on the metrics of actual small business utilization as compared to the contract required targets.

Other areas: Assess additional evaluation areas unique to the contract or that cannot be captured elsewhere.

The evaluation ratings are as follows:

Exceptional Performance: Contractor’s performance of virtually all contract requirements consistently exceeds the acceptable standards and in addition provides numerous significant tangible or intangible benefits to the Government (e.g., improved quality, responsiveness, reduced costs (>5%) below initial estimates, increased timeliness, or generally enhanced effectiveness of operations). Although a few areas require minor improvement, these areas are offset by superior performance in other areas.

The few problems that do exist are insignificant in nature and have been noted, and the contractor has taken effective and quick corrective action.

Very Good Performance: Contractor’s performance of most contract requirements is consistently above acceptable standards and provides significant tangible and intangible benefits to the Government (e.g., improved quality, responsiveness, reduced costs (1-5%) below the initial estimates, increased timeliness, or generally enhanced effectiveness of operations). Although some areas require improvement, these areas are minor and are offset by better performance in other areas. Few, if any, recurring problems have been noted, and the contractor has taken satisfactory corrective action.

Satisfactory Performance: Contractor’s performance of most contract requirements meets the acceptable standards with some tangible or intangible benefits to the

Government (e.g., improved quality, costs are consistent with expectations, responsiveness, increased timeliness, or generally enhanced effectiveness of operations).

Although there are some areas of very good or excellent performance, these are more or less offset by marginal performance in other areas.

Marginal: Performance does not meet the full intent of the contract requirements. The contractual performance of the task and subtask being assessed reflect a problem for which the contractor has not yet identified marginally corrective actions. Costs have exceeded estimates without reasonable justification. The contractor’s proposed actions appear only marginally effective or were not fully implemented.

Unsatisfactory Performance: Contractor’s performance of most contract requirements is inconsistent and frequently does not meet acceptable standards. Quality, responsiveness, and timeliness in many areas require attention and action. Cost control efforts are nearly nonexistent. Corrective actions were not taken or were ineffective.

For Level of Effort TOs, hours delivered by each order as compared to the order required hours will be evaluated and will influence the ratings awarded above. Cost variances greater than 10% cannot earn an Exceptional or Very Good for Cost Control evaluation criteria.

Enclosure (4)

SURVEILLANCE ACTIVITY CHECKLIST – LEVEL OF EFFORT & PERFORMANCE BASED

Quarterly Surveillance:

The COR will perform a quarterly assessment of Quality, Schedule, Cost Control, Business Relations, Management, Utilization of

Small Business, and Other Areas as applicable utilizing the CPARS evaluation rating definitions listed in enclosure 3.

QUARTERLY EVALUATION – BY PWS/SOW

Description

Surveillance

Method/

Measure

Dates Quality

Assessment

Schedule

Assessment

Cost Control

Assessment

Business Relations

Assessment Management

Assessment

Utilization of

Small Business

Assessment

Other Areas

Assessment

3.3.1 Provide

Concept and

Technology

Development support IAW

PWS/SOW

requirements.

100% Inspection by COR/ACOR and/or.GPL

3.3.2 Provide

System

Development and

Design support

IAW PWS/SOW

requirements.

100% Inspection and/or GPL

3.3.3 Provide

System Integration and Life-Cycle

Support IAW

PWS/SOW

requirements.

100% Inspection

3.3.4 Provide

Technical

Management

Support IAW

PWS/SOW

requirements.

100% Inspection

3.3.5 Provide

Cybersecurity for

Assessment and

Authorization support IAW

PWS/SOW

requirements.

100% Inspection

Enclosure (5)

QUARTERLY EVALUATION BY CONTRACT DATA REQUIREMENTS LISTS

(CDRLs) Form DD 1423

Description Surveillance Method / Measure Dates

Due

Dates

Completed

No.

Submittals

No. of

Req’d

Rework

Percentage

On Time Comments

Scientific and Technical Reports

Summary A001

100% Inspection by COR/ACOR and/or GPL.

Scientific and Technical Reports -

Configuration Change Request

Document A002

Report, Record of

Meeting/Minutes - Trip/Meeting

Report/Conference

Minutes/Agenda A003

Software Development Plan (SDP)

A004

Financial Progress Reports A005 100% Inspection by COR/ACOR

Interface Design Description (IDD)

A006

Software Test Report (STR) A007 100% Inspection by COR/ACOR

Software User Manuals (SUM)

A008

Computer Software Product End

Items - End Item Deliverable A009

Test Plan - Validation Test Plan

A010

Test Procedure - Validation Test

Procedure A011

Test/Inspection Report - Validation

Test Report A012

Installation Control Drawings

A013

Technical Report - Study/Services

A014

Technical Information Report -

Maintenance and Repair

Documentation A015

Product Drawings/Models &

Associated Lists - Technical

Documentation for Repair &

Maintenance - Electronic Format

A016

Contract Performance Report

(CPR) A017

100% Inspection by

COR/ACOR and/or GPL.

Security Test Plan A018 100% Inspection by

Presentation Material A019 100% Inspection by

Scientific and Technical

Reports - Elements, Organization and Design A020

Technical Information Report -

Project Close-Out Report A021

Technical Report -

Study/Service -

Integration/Installation Plan

Report A022

Change Control Strategy A023 100% Inspection by

Operational Security (OPSEC)

Plan A024

Reserved A025

Segregation of Costs and

Invoice Requirements

Reporting A026

Status Report - Information

Technology Personnel Security

Report for NAVAIR Security

A027

Software Requirements

Specifications (SRS) A028

Software Design Description

(SDD) A029

Software Development Status

Report (SDSR) A030

Software Test Plan (STP) A031 100% Inspection by

Contractor’s Configuration

Management Plan A032

Configuration Audit Summary

Report A033

Technical and Management

Work Plan - Program Plans for

Implementation of PWS/SOW and TDLs A034

Integrated Logistics Support

Plan A035

Logistics Management

Information (LMI) Data

Product A036

Validation Report - Validation of Technical Manual Changes-

Via Demonstration A037

Training Conduct Support

Document A038

Inspection and Test Plan A039 100% Inspection by

Metric Summary: Current Period Cumulative

Total Number of Deliverables Submitted:

Total Number of Deliverables Submitted Late

Total Number of Deliverables Requiring Revision:

Percentage of Deliverables Submitted Late:

Percentage of Deliverables Requiring Revision

Technical Report - Study

Services -Cost Feasibility

Report A040

Contractor's Risk Management

Plan A041

Quality System Plan Quality

Management / Assurance Plan

A042

Detailed Project Schedule A043 100% Inspection by

Detailed Task/Activity Estimate

Report A044

Intermediate Project Schedule

A045

Integrated Master Schedule

A046

Status Report Information

Technology Personnel Security

Report for Contracting Officer

Representative (COR) A047

System Security Administrator

Operators Documentation A048

NAVAIR Cybersecurity

Implementation Plan A049

Enclosure (6)

Annual Surveillance Summary

The COR will perform an assessment of overall contract performance utilizing the CPARS evaluation rating definitions listed in enclosure (3). This assessment will be completed annually covering the previous 12 months.

Description Surveillance

Method/

Measure

Date

Planned

Date

Completed

Summary

Rating/Results

Quality of

Product or Service

Review of Quarterly

Ratings.

Schedule

Cost Control Review Quarterly of

Business Relations

Management

Utilization of

Small Business

Other Areas

Annual Surveilance Completed By: _______________________

Date Completed: ________________