The file's text, extracted by GovTribe without its formatting.
N00421-16-R-0059 Enclosure (6) Quality Assurance Surveillance Plan and Contract Surveillance Plan for Technical and Engineering Services (TES)
1. Purpose
This requirement consists of both performance-based and non-performance-based orders; therefore, a Quality Assurance Surveillance Plan (QASP) and a Contract Surveillance Plan (CSP) are both required. The QASP/CSP is used to ensure that the contractor performs in accordance with the performance standards and definitions/metrics and the Government receives the quality of services called for in the contract.
This hybrid QASP/CSP is a Government developed and applied document used to ensure systematic quality assurance methods are used in the administration and surveillance of performance based and non-performance based tasking under the contract. The intent is to ensure the contractor performs in accordance with the performance based standards and definitions and non-performance based required Level of Effort (LOE), and the Government receives the quality of services called for in each Task Order (TO) Performance Work Statement (PWS)/Statement of Work (SOW).
This contract will leverage the SAIW Division’s core capabilities involving engineering and technical services to support the advanced research and development, systems engineering, and life-cycle support of electronics, communications, and information systems. The scope of the contract encompasses rapidly developed engineering designs for end products intended for immediate warfighter operational use, and may include strategic and tactical airborne, land-based, and mobile, sea-based surface and sub-surface, systems, subsystems and components. The following are representative of the programs, systems, and technology areas to which the requested engineering and technical services may be applied:
· Military and commercial radio communication systems
· Information and computer network systems
· Command and control systems
· Automatic identification technology systems
· Integrated document management systems
· Multimedia systems
· Embedded and stand-alone sensors systems
· Unmanned Aerial Systems
· Cyber Warfare offensive and defensive solutions
A properly executed QASP/CSP will assist the Government in achieving the objectives of this procurement.
2. Authority
Authority for issuance of this hybrid surveillance document is provided under Contract Section E – Inspection and Acceptance, which provides for inspections and acceptance of the services, products, and documentation called for in the contract, which will be executed by the Contracting Officer or a duly authorized representative.
3. Scope
To fully understand the roles and responsibilities of the parties, it is important to first define the distinction in terminology between Quality Control Plan and the QASP/CSP. The contractor, and not the Government, is responsible for the Quality Control Plan, which defines the management and quality control actions necessary to meet the quality standards set forth in the contract and all resultant orders.
The hybrid QASP/CSP provides Government surveillance oversight of the contractor’s efforts to assure they are timely, effective, and delivering the results specified in the contract and each TO.
4. Government Resources
The following definitions for Government resources are applicable to this plan:
Contracting Officer (KO): A person duly appointed with the authority to enter into a contract (Procuring Contracting Officer (PCO)), or a person with the authority to administer contracts (Administrative Contracting Officer (ACO)), and make related determinations and findings on behalf of the Government. The PCO for this contract is AIR-2.5.1.3. The ACO will be designated in the resulting contract. Contracting officers are designated via a written warrant that sets forth limitations of authority.
Contracting Officer Representative (COR): An individual appointed in writing by the PCO to act as their authorized representative to assist in administering the contract. The COR will be appointed in the resulting contract. The limitations of authority are contained in the letter of appointment.
Alternate Contracting Officer Representative (ACOR): An individual appointed in writing by the PCO to act as their authorized representative, in the absence of the COR, to assist in administering the contract. The ACOR will be appointed in the resulting contract. The limitations of authority are contained in a written letter of appointment.
Government Project Leads (GPL): The COR designates individual GPL to assist in administering of specific efforts under the contract.
5. Responsibilities
The following Government resources will have responsibility for the implementation of this hybrid QASP/CSP Surveillance Plan:
Contracting Officer (abbreviated KO): The KO (either the PCO or ACO) ensures performance of all necessary actions for effective contracting, ensures compliance with the terms of the contract, and safeguards the interests of the United States in the contractual relationship. It is the KO that assures the contractor receives impartial, fair and equitable treatment under the contract. The KO is ultimately responsible for the final determination of the adequacy of the contractor’s performance.
Contracting Officer Representative: The COR is responsible for technical administration of the contract and assures proper Government surveillance of the contractor’s performance. The COR is not empowered to make any contractual commitments or to authorize any changes on the Government’s behalf. Any changes that the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action.
Alternate Contracting Officer’s Representative: The ACOR assists the COR for technical administration of the contract and assures proper Government surveillance of the contractor’s performance. The ACOR is not empowered to make any contractual commitments or to authorize any changes on the Government’s behalf. Any changes that the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action.
Government Project Leads: The GPLis responsible for assisting in administering of specific efforts under the contract. A GPL cannot, in any manner, alter the scope of the contract, make commitments or authorize any changes on the Government’s behalf.
6. Methods of QA Surveillance
a. Contractor Performance Assessment Reporting System (CPARS): The marketplace for advanced research and development, systems engineering, and life-cycle support of electronics, communications, and information systems services is very competitive. As such, the successful offeror has a vested interest in the Government-generated CPARS under this contract. Additionally, an evaluation using the CPARS format will be performed annually at the end of each ordering year. This evaluation will be one determinant in the award of future contracts or TOs. The Government will address the quality of product or service, schedule, cost control, business relations, management, utilization of small business, and other important areas for this procurement. Some of the monitoring methods to be used will be Government observation, review of reports, customer feedback, and review of Contract Data Requirements Lists (CDRLs). As this information may affect future source selections throughout the Department of Defense (DOD), as well as the continuation of this tasking, the annual Government assessment will be used appropriately as an additional performance oversight and communication tool within the policies of this hybrid QASP/CSP.
b. QASP/CSP: This document will be used by the COR, ACOR, and GPL in the technical administration of this contract. In addition to the below instructions, the form to be used for documentation of quality assurance surveillance is the hybrid checklist provided herein.
7. Surveillance
Enclosures (1) through (3) set forth the performance standards, incentives, and surveillance methods for the contractor, the COR and GPL while enclosures (4) through (6) provides the checklist and means for the COR to document the results of the surveillance and will be provided to the KO.
8. Documentation
In addition to providing reports to the KO, the COR will maintain a complete Quality Assurance file. The file will contain copies of all reports, evaluations, recommendations, and any actions related to the Government’s performance of the quality assurance function, including the originals of the Surveillance Activity Checklists. All such records will be maintained for the life of the contract. The COR will forward these records to the KO at termination or completion of the contract.
9. Enclosures
Enclosure (1): Quality Standards – In-Service Engineering by PWS (Performance Based)/SOW (Non-Performance Based) Enclosure (2): CDRL Data Quality Standards (Performance Based) Enclosure (3): Incentives Enclosure (4): Surveillance Activity Checklist – Level Of Effort & Performance Based Enclosure (5): Contract Surveillance by Contract Data Requirements Lists (Level of Effort & Performance Based) Enclosure (6): Annual Surveillance Summary
QUALITY STANDARDS – IN-SERVICE ENGINEERING BY PWS (PERFORMANCE BASED)
| Required Service (Performance Requirements) |
| Standard (Performance Standards) / Maximum Allowable Degree of Deviation Requirement (AQL) |
| Method of Surveillance (Quality Assurance) |
| Incentives |
| System Integration and Life-Cycle Support IAW PWS/SOW Para 3.3.3 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
| Cybersecurity IAW PWS/SOW Para 3.3.5 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
QUALITY STANDARDS – IN-SERVICE ENGINEERING BY PWS (LEVEL OF EFFORT)
| Required Service (Non-Performance (LOE) Requirements) |
| Standard (Performance Standards) / Maximum Allowable Degree of Deviation Requirement (AQL) |
| Method of Surveillance (Quality Assurance) |
| Incentives |
| Concept and Technology Development IAW PWS/SOW Para 3.3.1 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
| System Development and Design IAW PWS/SOW Para 3.3.2 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
| System Integration and Life-Cycle Support IAW PWS/SOW Para 3.3.3 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
| Technical Management Support IAW PWS/SOW Para 3.3.4 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
| Cybersecurity IAW PWS/SOW Para 3.3.5 |
| Based upon feedback from the Government Project Leads, 95% of the services and products provided must be deemed comprehensive, timely, and technically acceptable. Metrics are provided in the TO SOW and will be used as a Baseline in the evaluation. |
| 100% Inspection by COR/ACOR and/or GPL. |
| See Enclosure 3 |
Enclosure (1)
CDRL DATA QUALITY STANDARDS (PERFORMANCE BASED AND LEVEL OF EFFORT)
Description
Standard
AQL
Surveillance/ Method/Measure
Incentives
| Scientific and Technical Reports Summary A001 |
| Submission is in accordance with the Data Item Description (DID) cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Scientific and Technical Reports - Configuration Change Request Document A002 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Report, Record of Meeting/Minutes - Trip/Meeting Report/Conference Minutes/Agenda A003 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Software Development Plan (SDP) A004 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Financial Progress Reports A005 |
| Submission is in accordance with the format detailed in BLK 16 of the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Interface Design Description (IDD) A006 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL. |
| See Enclosure 3. |
| Software Test Report (STR) A007 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 34. |
| Software User Manuals (SUM) A008 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Computer Software Product End Items - End Item Deliverable A009 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Test Plan - Validation Test Plan A010 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Test Procedure - Validation Test Procedure A011 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 43. |
| Test/Inspection Report - Validation Test Report A012 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Installation Control Drawings A013 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical Report - Study/Services A014 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical Information Report - Maintenance and Repair Documentation A015 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Product Drawings/Models & Associated Lists - Technical Documentation for Repair & Maintenance - Electronic Format A016 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Contract Performance Report (CPR) A017 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Security Test Plan A018 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Presentation Material A019 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Scientific and Technical Reports - Elements, Organization and Design A020 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical Information Report -Project Close-Out Report A021 |
| Submission is in accordance with the DID cited in the CDRL. |
| A one-time deliverable. Must be on time, with no more than one revision. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical Report - Study/Service - Integration/Installation Plan Report A022 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3 |
| Change Control Strategy A023 |
| Submission is in accordance with the format detailed in BLK 16 of the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Operational Security (OPSEC) Plan A024 |
| Submission is in accordance with the DID cited in the CDRL. |
| A one-time deliverable. Must be on time, with no more than one revision. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
Reserved A025
| Segregation of Costs and Invoice Requirements Reporting A026 |
| Submission is in accordance with the DID cited in the CDRL. |
| A one-time deliverable at each TO close. Must be on time, with no more than one revision per submission. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Status Report - Information Technology Personnel Security Report for NAVAIR Security A027 |
| Submission is in accordance with the DID cited in the CDRL. |
| As an annual report, this deliverable must be on time and with no more than one revision per submission. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Software Requirements Specifications (SRS) A028 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Software Design Description (SDD) A029 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Software Development Status Report (SDSR) A030 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Software Test Plan (STP) A031 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3 |
| Contractor’s Configuration Management Plan A032 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Configuration Audit Summary Report A033 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical and Management Work Plan - Program Plans for Implementation of SOW and TDLs A034 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Integrated Logistics Support Plan A035 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Logistics Management Information (LMI) Data Product A036 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Validation Report - Validation of Technical Manual Changes-Via Demonstration A037 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Training Conduct Support Document A038 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Inspection and Test Plan A039 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Technical Report - Study Services -Cost Feasibility Report A040 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Contractor's Risk Management Plan A041 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Quality System Plan Quality Management / Assurance Plan A042 |
| Submission is in accordance with the DID cited in the CDRL. |
| A one-time deliverable. Must be on time, with no more than one revision. |
| 100% Inspection by COR, ACOR and/or GPL: |
| See Enclosure 3. |
| Detailed Project Schedule A043 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Detailed Task/Activity Estimate Report A044 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 43. |
| Intermediate Project Schedule A045 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Integrated Master Schedule A046 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| Status Report Information Technology Personnel Security Report for Contracting Officer Representative (COR) A047 |
| Submission is in accordance with the DID cited in the CDRL. |
| A one-time deliverable. Must be on time, with no more than one revision. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| System Security Administrator Operators Documentation A048 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
| NAVAIR Cybersecurity Implementation Plan A049 |
| Submission is in accordance with the DID cited in the CDRL. |
| 95% of required deliverable provided on time. No more than 1 report per year may be inaccurate or require a rewrite. |
| 100% Inspection by COR, ACOR and/or GPL |
| See Enclosure 3. |
Enclosure (2)
INCENTIVES
The following incentives will apply to performance under this contract.
| Assessment Period |
| Acceptable Performance Definition |
| How Measured |
| Incentives |
Ordering Year 1:
| Not more than one of the measurement areas rated below “Satisfactory”. None of the measurement areas are rated below “Marginal”. |
| End of the first assessment period using the CPARS format. |
| (+) Meet the acceptable performance definition as a condition for additional tasking.* |
(-) Does not meet the acceptable performance definition as a condition for additional tasking.*
| Ordering Year 2: |
| Not more than one of the measurement areas rated below “Satisfactory”. None of the measurement areas are rated below “Marginal”. |
| End of the second assessment period using the CPARS format covering the previous 12 months. |
| (+) Meet the acceptable performance definition as a condition for additional tasking.* |
(-) Does not meet the acceptable performance definition as a condition for additional tasking.*
| Ordering Year 3: |
| Two or more of the measurement areas rated “Very Good” or above. None rated below “Satisfactory”. |
| End of the third assessment period using the CPARS format covering the previous 12 months. |
| (+) Meet the acceptable performance definition as a condition for additional tasking.* |
(-) Does not meet the acceptable performance definition as a condition for additional tasking.*
| Ordering Year 4: |
| Two or more of the measurement areas rated “Very Good” or above. None of the measurement areas are below “Satisfactory”. |
| End of the fourth assessment period evaluation using the CPARS format covering the previous 12 months. |
| (+) Meet the acceptable performance definition as a condition for additional tasking.* |
(-) Does not meet the acceptable performance definition as a condition for additional tasking.*
| Ordering Year 5: |
| Two or more of the measurement areas rated “Very Good” or “Exceptional”. None of the measurement areas are rated “Marginal” or below. |
| End of the fifth assessment period using the CPARS format covering the previous 12 months. |
| (+) Meet the acceptable performance definition as a condition for satisfactory or better Final CPARS rating. |
(-) Does not meet the acceptable performance definition which will result in a marginal or unsatisfactory final CPARS rating.
Final CPAR Review
| After completion of all TOs. |
| (+) Meet the acceptable performance definition as a condition for satisfactory or better Final CPARS rating. |
(-) Does not meet the acceptable performance definition` which will result in a marginal or unsatisfactory Final CPARS rating.
* The Government may not award additional tasking (orders) unless all regulatory requirements are met and the contractor meets the acceptable performance definition.
All PWS/SOW and CDRL tasks, including sub-tasks, will be assessed focusing on the following.
Quality of Product or Service: Assess the contractor’s effort to transform operational needs and requirements into an integrated solution. Areas of focus may include the planning and management of program tasks, the quality of support provided throughout all phases of contract execution, the integration of program management specialties, management of interfaces, and the management of a totally integrated effort of all program management concerns to meet cost, performance, and schedule objectives. Assess how successfully the contractor meets program quality.
Schedule: Assess the contractor’s adherence to the required delivery schedule by assessing the contractor’s efforts during the assessment period that contribute to or effect the schedule variance. Also address significance of scheduled events (i.e., design reviews), discuss causes, and assess the effectiveness of contractor corrective actions.
Cost Control: Assess the contractor’s effectiveness in forecasting, managing, and controlling contract cost. Is the contractor experiencing cost growth or under-run? If so, discuss the causes and contractor proposed solutions for the cost overruns. For contracts where task or contract sizing is based upon contractor provided person hour estimates, the relationship of these estimates to ultimate cost should be assessed. In addition, the extent to which the contractor demonstrates a sense of cost responsibility, through the efficient use of resources in each work effort should be assessed.
Business Relations: Assess the timelines, completeness and quality of problem identification, corrective action plans, proposal submittals, the contractor’s reasonable and cooperative behavior, effective business relations, and customer satisfaction.
Management: Assess the contractor’s success with timely award and management of subcontracts, including whether the contractor met small/small disadvantage and women-owned business participation goals. Discuss the extent to which the contractor discharges its responsibility for integration and coordination of all activity needed to execute the contract; identifies and applies resources required to meet schedule requirements; assigns responsibility for tasks/actions required by contract; communicates appropriate information to affected program elements in a timely manner. Assess the contractor’s risk mitigation plans.
Utilization of Small Business: The RFP and FAR Subpart 19.7 and 15 U.S.C. 637 contains statutory requirements for complying with the Small Business Subcontracting Program. Assess whether the contractor provided maximum practicable opportunity for Small Business (including Alaska Native Corporations (ANCs) and Indian Tribes) (including Small Disadvantaged Businesses (which also includes ANCs and Indian Tribes), Women Owned Small Businesses, HUBZone, Veteran Owned, Service Disabled Veteran Owned Small Business, and ANCs and Indian Tribes that are not Small Disadvantaged Businesses or Small Businesses) to participate in contract performance consistent with efficient performance of the contract. Evaluation will focus on the metrics of actual small business utilization as compared to the contract required targets.
Other areas: Assess additional evaluation areas unique to the contract or that cannot be captured elsewhere.
The evaluation ratings are as follows:
Exceptional Performance: Contractor’s performance of virtually all contract requirements consistently exceeds the acceptable standards and in addition provides numerous significant tangible or intangible benefits to the Government (e.g., improved quality, responsiveness, reduced costs (>5%) below initial estimates, increased timeliness, or generally enhanced effectiveness of operations). Although a few areas require minor improvement, these areas are offset by superior performance in other areas. The few problems that do exist are insignificant in nature and have been noted, and the contractor has taken effective and quick corrective action.
Very Good Performance: Contractor’s performance of most contract requirements is consistently above acceptable standards and provides significant tangible and intangible benefits to the Government (e.g., improved quality, responsiveness, reduced costs (1-5%) below the initial estimates, increased timeliness, or generally enhanced effectiveness of operations). Although some areas require improvement, these areas are minor and are offset by better performance in other areas. Few, if any, recurring problems have been noted, and the contractor has taken satisfactory corrective action.
Satisfactory Performance: Contractor’s performance of most contract requirements meets the acceptable standards with some tangible or intangible benefits to the Government (e.g., improved quality, costs are consistent with expectations, responsiveness, increased timeliness, or generally enhanced effectiveness of operations). Although there are some areas of very good or excellent performance, these are more or less offset by marginal performance in other areas.
Marginal: Performance does not meet the full intent of the contract requirements. The contractual performance of the task and subtask being assessed reflect a problem for which the contractor has not yet identified marginally corrective actions. Costs have exceeded estimates without reasonable justification. The contractor’s proposed actions appear only marginally effective or were not fully implemented.
Unsatisfactory Performance: Contractor’s performance of most contract requirements is inconsistent and frequently does not meet acceptable standards. Quality, responsiveness, and timeliness in many areas require attention and action. Cost control efforts are nearly nonexistent. Corrective actions were not taken or were ineffective.
For Level of Effort TOs, hours delivered by each order as compared to the order required hours will be evaluated and will influence the ratings awarded above. Cost variances greater than 10% cannot earn an Exceptional or Very Good for Cost Control evaluation criteria.
N00421-16-R-0059 Enclosure (3) N00421-16-R-0059 Enclosure (3)
SURVEILLANCE ACTIVITY CHECKLIST – LEVEL OF EFFORT & PERFORMANCE BASED
Quarterly Surveillance:
The COR will perform a quarterly assessment of Quality, Schedule, Cost Control, Business Relations, Management, Utilization of Small Business, and Other Areas as applicable utilizing the CPARS evaluation rating definitions listed in enclosure 3.
QUARTERLY EVALUATION – BY PWS/SOW
| Description |
| Surveillance Method/ |
Measure
| Dates |
| Quality Assessment |
| Schedule Assessment |
| Cost Control Assessment |
| Business Relations Assessment |
| Management Assessment |
| Utilization of Small Business Assessment |
| Other Areas Assessment |
| 3.3.1 Provide Concept and Technology Development support IAW PWS/SOW requirements. |
| 100% Inspection by COR/ACOR and/or.GPL |
| 3.3.2 Provide System Development and Design support IAW PWS/SOW requirements. |
| 100% Inspection by COR/ACOR and/or GPL |
| 3.3.3 Provide System Integration and Life-Cycle Support IAW PWS/SOW requirements. |
| 100% Inspection by COR/ACOR and/or GPL |
| 3.3.4 Provide Technical Management Support IAW PWS/SOW requirements. |
| 100% Inspection by COR/ACOR and/or GPL |
| 3.3.5 Provide Cybersecurity for Assessment and Authorization support IAW PWS/SOW requirements. |
| 100% Inspection by COR/ACOR and/or GPL |
Enclosure (4) N00421-16-R-0059 Enclosure (5)
QUARTERLY EVALUATION BY CONTRACT DATA REQUIREMENTS LISTS
(CDRLs) Form DD 1423
| Description |
| Surveillance Method / Measure |
| Dates Due |
| Dates Completed |
| No. Submittals |
| No. of Req’d Rework |
| Percentage On Time |
| Comments |
| Scientific and Technical Reports Summary A001 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Scientific and Technical Reports - Configuration Change Request Document A002 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Report, Record of Meeting/Minutes - Trip/Meeting Report/Conference Minutes/Agenda A003 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software Development Plan (SDP) A004 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Financial Progress Reports A005 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Interface Design Description (IDD) A006 |
| 100% Inspection by COR/ACOR and/or GPL |
| Software Test Report (STR) A007 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software User Manuals (SUM) A008 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Computer Software Product End Items - End Item Deliverable A009 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Test Plan - Validation Test Plan A010 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Test Procedure - Validation Test Procedure A011 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Test/Inspection Report - Validation Test Report A012 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Installation Control Drawings A013 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical Report - Study/Services A014 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical Information Report - Maintenance and Repair Documentation A015 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Product Drawings/Models & Associated Lists - Technical Documentation for Repair & Maintenance - Electronic Format A016 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Contract Performance Report (CPR) A017 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Security Test Plan A018 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Presentation Material A019 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Scientific and Technical Reports - Elements, Organization and Design A020 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical Information Report -Project Close-Out Report A021 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical Report - Study/Service - Integration/Installation Plan Report A022 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Change Control Strategy A023 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Operational Security (OPSEC) Plan A024 |
| 100% Inspection by COR/ACOR and/or GPL. |
Reserved A025
| Segregation of Costs and Invoice Requirements Reporting A026 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Status Report - Information Technology Personnel Security Report for NAVAIR Security A027 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software Requirements Specifications (SRS) A028 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software Design Description (SDD) A029 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software Development Status Report (SDSR) A030 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Software Test Plan (STP) A031 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Contractor’s Configuration Management Plan A032 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Configuration Audit Summary Report A033 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical and Management Work Plan - Program Plans for Implementation of PWS/SOW and TDLs A034 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Integrated Logistics Support Plan A035 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Logistics Management Information (LMI) Data Product A036 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Validation Report - Validation of Technical Manual Changes-Via Demonstration A037 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Training Conduct Support Document A038 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Inspection and Test Plan A039 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Technical Report - Study Services -Cost Feasibility Report A040 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Contractor's Risk Management Plan A041 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Quality System Plan Quality Management / Assurance Plan A042 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Detailed Project Schedule A043 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Detailed Task/Activity Estimate Report A044 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Intermediate Project Schedule A045 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Integrated Master Schedule A046 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Status Report Information Technology Personnel Security Report for Contracting Officer Representative (COR) A047 |
| 100% Inspection by COR/ACOR and/or GPL. |
| System Security Administrator Operators Documentation A048 |
| 100% Inspection by COR/ACOR and/or GPL. |
| NAVAIR Cybersecurity Implementation Plan A049 |
| 100% Inspection by COR/ACOR and/or GPL. |
| Metric Summary: |
| Current Period |
| Cumulative |
Total Number of Deliverables Submitted:
Total Number of Deliverables Submitted Late
Total Number of Deliverables Requiring Revision:
Percentage of Deliverables Submitted Late:
Percentage of Deliverables Requiring Revision
Enclosure (5)
Annual Surveillance Summary
The COR will perform an assessment of overall contract performance utilizing the CPARS evaluation rating definitions listed in enclosure (3). This assessment will be completed annually covering the previous 12 months.
| Description |
| Surveillance Method/ |
Measure
| Date Planned |
| Date Completed |
| Summary Rating/Results |
| Quality of Product or Service |
| Review of Quarterly Ratings. |
| Schedule |
| Review of Quarterly Ratings. |
| Cost Control |
| Review Quarterly of Ratings. |
| Business Relations |
| Review of Quarterly Ratings. |
| Management |
| Review of Quarterly Ratings. |
| Utilization of Small Business |
| Review of Quarterly Ratings. |
| Other Areas |
| Review of Quarterly Ratings. |
Annual Surveilance Completed By: _______________________
Date Completed: ________________