Attachment 1 - Quality Assurance Surveillance Plan (QASP).docx

DOCX document 79 KB Posted

Attached to
ATC Test Support Services Federal contract opportunity
Solicitation number
W91CRB-21-R-0016
Issued by
Department of the Army Materiel Command Army Contracting Command Aberdeen Proving Ground

About this file

This document provides a Quality Assurance Surveillance Plan (QASP) for the Aberdeen Test Center (ATC) Support Services Contract. The QASP outlines performance requirements and acceptable quality levels for test support services including ammunition operations, compliance and program support, engineering and scientific support, facilities design and maintenance, test instrumentation operations, marine operations and maintenance, vehicle and equipment operations and maintenance, technical test support, and test range and facility operations support. Key personnel roles and responsibilities are defined for monitoring contractor performance against standards detailed in a Performance Requirements Summary matrix, using methods such as visual observations, customer feedback reviews, and record inspections. Performance ratings, non-conformance documentation, and a continuous improvement approach are established to address issues and ensure mission capabilities.

View the file

Other files for this federal contract opportunity

Other files attached to ATC Test Support Services, newest first.
File Type Posted
ATSS RFP AMD_5 W91CRB-21-R-0016.pdf PDF
ATSS RFP AMD_4 W91CRB-21-R-0016.pdf PDF
ATSS RFP AMD_3 W91CRB-21-R-0016.pdf PDF
Solicitation Attachment 5 - LOE Spreadsheet 2020-12-18.xlsx XLSX spreadsheet
ATSS RFP AMD_2 W91CRB-21-R-0016.pdf PDF
ATSS RFP AMD_1 W91CRB-21-R-0016.pdf PDF
Solicitation Attachment 2 - Contract References Form 2020-12-11.xlsx XLSX spreadsheet
Solicitation Attachment 5 - LOE Spreadsheet 2020-12-8.xlsx XLSX spreadsheet
Solicitation Attachment 4 - OCI Certification.docx DOCX document
Solicitation Attachment 3 - Past Performance Questionnaire.docx DOCX document
Attachment 4c1 - Local 2424 CBA Amendment - HEO Lead - Trans Op II.pdf PDF
Attachment 4a - WD 15-4266 Maryland.pdf PDF
Solicitation Attachment 2 - Contract References Form.xlsx XLSX spreadsheet
Attachment 2 - Labor Category Qualification Requirements..pdf PDF
Attachment 4b - Local 186 Executed CBA.pdf PDF
Attachment 3 - DD Form 254.pdf PDF
Solicitation Attachment 5 - LOE Spreadsheet 2020-11-24.xlsx XLSX spreadsheet
Attachment 5 - Training Matrix.pdf PDF
Attachment 7 - 2020 CBA Notice of Critical Status.pdf PDF
Attachment 4c - Local 2424 Executed CBA.pdf PDF
Exhibit C - CDRLs A001 - A025.pdf PDF
Solicitation Attachment 6 - Purchasing System Review Form.xlsx XLSX spreadsheet
Exhibit B - Contractor Furnished Equipment List.pdf PDF
Exhibit A - SBPCD and SBSP.pdf PDF
Solicitation Attachment 1 - Summary of Experience Form.docx DOCX document
ATSS RFP W91CRB-21-R-0016.pdf PDF
Attachment 6 - GFP.pdf PDF
Show all 27

On GovTribe

Work with this file on GovTribe

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

Quality Assurance Surveillance Plan (QASP) Aberdeen Test Center (ATC) Support Services Contract 16 April 2020

1.1 Vision4
1.2 Mission4
1.3 Purpose4
1.4 Performance Management Approach5
1.5 Performance Management Strategy5

1.6 Authority……………………………………………………………………………… 6

2 Roles and Responsibilities……………………………………………………………...6

2.1 Program / Project Manager6
2.2 Contracting Office (KO)6
2.3 Contracting Officer's Representative (COR)7
2.4 Other Key Government Personnel8
2.5 Contractor Representatives8
3 Methodologies to Monitor Performance9

3.1 Surveillance Techniques…………………………………………………………… 9

3.2 Customer Feedback…………………………………………………………………..9

3.3 Acceptable Quality Levels……………………………………………………………9

4 Quality Assurance Documentation and Assessment……………………………….10

4.1 Performance Assessment…………………………………………………………..10

4.2 Surveillance Forms…………………………………………………………………..10

4.3 Acceptance of Services10
4.4 Documentation10
4.5 Performance Issues10
4.6 Resolution10
4.7 Reporting11

4.8 Levels of Performance………………………………………………………………12

5 Surveillance Matrix……………………………………………………………………..14

6 Attachments15
Appendix 1 - Surveillance Matrix17
Appendix 2 - Corrective Action Report (CAR)42
Appendix 3 - Customer Complaint Record43
Appendix 4 - Performance Assessment Report (PAR)44

Quality Assurance Surveillance Plan (QASP) Aberdeen Test Center (ATC) Support Services Contract 1 Introduction

1.1 Vision

Department of Defense premier Test Center, providing safe, timely and cost effective test services in support of the Warfighter.

1.2 Mission

To provide test and test support services for authorized customers, within DoD and outside DoD, including government and non-government organizations, domestic and foreign. Provide comprehensive test and training, both real and simulated; provide expert knowledge and technical services including instrumentation application, facility operations, prototyping and fabrication; exploit emerging technologies; and develop leading edge instrumentation, analysis, and test methodologies.

1.3 Purpose

This quality assurance surveillance plan (QASP) is pursuant to the requirements listed in the performance work statement (PWS) entitled Test Support Services Contract. For each listed objective on the Performance Requirements Summary (PRS) in the contract, the QASP provides an effective method of monitoring Contractor performance. This plan sets forth the procedures and guidelines that the Government will use in ensuring the required performance standards or services levels are understood and achieved by the Contractor.

The Acceptable Quality Level (AQL) refers to the maximum degree of deviation from the standard that can still be deemed as satisfactory. The AQLs, PRS Summary Table, for Contractor performance are structured to allow the Contractor to manage how the work is performed while providing negative incentives for performance shortfalls. For certain critical activities such as those involving safety and compliance, the desired performance level is established at 100 percent.

This Quality Assurance Surveillance Plan (QASP) is a government-developed document used to determine if the Contractor's performance meets the performance standards contained in the contract. The QASP establishes procedures on how this assessment/inspection process will be conducted. It provides details for a continuous oversight process as follows:

· What will be monitored

· How monitoring will take place

· Who will be conduct the monitoring

· How monitoring efforts and results will be documented The Contractor is responsible for implementing and delivering performance that meets contract standards using its Quality Control Plan. The QASP provides the structure for the government's surveillance of the Contractor's performance to assure that it meets contract standards. It is the government's responsibility to be objective, fair and consistent in evaluating Contractor performance.

The QASP is not part of the contract nor is it intended to duplicate the Contractor's quality control plan. This QASP is a living document. Flexibility in the QASP is required to allow for an increase or decrease in the level of surveillance necessary based on Contractor performance. The government may provide a copy of the QASP to the Contractor to facilitate open communication. In addition, the QASP should recognize that unforeseen or uncontrollable circumstances might occur that are outside the control of the Contractor. As a result, the QASP should ensure early identification and resolution of performance issues to minimize impact on mission performance.

1.4 Performance Management Approach

The PWS structures the acquisition around “what” service or quality level is required, as opposed to “how” the Contractor should perform the work (i.e., results, not compliance). This QASP will define the performance management approach taken by the contracting officer’s representative (COR) to monitor and manage the Contractor’s performance to ensure the expected outcomes or performance objectives communicated in the PWS are achieved.

Performance management represents a significant shift from the more traditional quality assurance (QA) concepts in several ways. Performance management focuses on assessing whether outcomes are being achieved and to what extent. This approach migrates away from scrutiny of compliance with the processes and practices used to achieve the outcome. A performance-based approach enables the Contractor to play a large role in how the work is performed, as long as the proposed processes are within the stated constraints. The only exceptions to process reviews are those required by law (federal, state, and local) and compelling business situations, such as safety and health. A “results” focus provides the Contractor flexibility to continuously improve and innovate over the course of the contract as long as the critical outcomes expected are being achieved and/or the desired performance levels are being met.

1.5 Performance Management Strategy

The Contractor is responsible for the quality of all work performed. The Contractor measures that quality through the Contractor’s own quality control (QC) program. QC is work output, not workers, and therefore includes all work performed under this contract regardless of whether the work is performed by Contractor employees or by subcontractors. The Contractor’s QC process will set forth the staffing and procedures for self-inspecting the quality, timeliness, responsiveness, customer satisfaction, and other performance requirements in the PWS. The Contractor will develop and implement a performance management system with processes to assess and report its performance to the designated Government representative. The Contractor’s QC process will set forth the staffing and procedures for self-inspecting the quality, timeliness, responsiveness, customer satisfaction, and other performance requirements in the PWS. This QASP enables the Government to take advantage of the Contractor’s QC program. Contractor’s QC plan may be used as a guide for planning concurrent inspections, for reviewing the data gathered by the Contractor’s QC personnel, and other items as may be established by the Contractor’s QC program.

The Government representative(s) will monitor performance and review performance reports furnished by the Contractor to determine how the Contractor is performing against performance objectives communicated in the PWS. The Contractor will be responsible for making required changes in processes and practices to ensure performance is managed effectively.

1.6 Authority

Authority for issuance of this QASP is provided under Part 46 of the Federal Acquisition Regulation, Inspection of Services clauses, which provide for inspection, acceptance and documentation of the service called for in the contract or order. This acceptance is to be executed by the contracting officer or a duly authorized representative.

2 Roles and Responsibilities This QASP defines the roles and responsibilities of all members of the integrated project team (IPT), identifies the performance objectives, defines the methodologies used to monitor and evaluate the Contractor’s performance, describes quality assurance documentation requirements, and describes the analysis of quality assurance monitoring results. The following personnel shall oversee and coordinate surveillance activities.

2.1 Program / Project Manager

The PM provides primary program oversight, nominates the COR, ensures the COR is trained before performing any COR duties and supports the COR's performance assessment activities. While the PM may serve as a direct conduit to provide Government guidance and feedback to the Contractor on technical matters, they are not empowered to make any contractual commitments or any contract changes on the government's behalf.

Assigned PM: Sandy Kirkendall Organization or Agency: Aberdeen Test Center (ATC) Telephone: 410-278-2213 Email: sandy.l.kirkendall.civ@mail.mil

2.2 Contracting Office (KO)

The contracting officer (KO) is responsible for monitoring contract compliance, contract administration, and cost control and for resolving any differences between the observations documented by the Government and the Contractor. The KO will designate a minimum of one full-time COR as the government authority for performance management. Additional representatives serving as technical monitors may be identified and designated by the KO as required.

The KO shall ensure performance of all necessary actions for effective contracting, ensure compliance with the contract terms, and shall safeguard the interests of the United States in the contractual relationship.

The KO shall ensure that the Contractor receives impartial, fair, and equitable treatment under this contract. The KO is also responsible for the final determination regarding adequacy of the Contractor’s performance. The KO determines and documents the final assessment of the Contractor's performance in the governments past performance tracking system.

Assigned KO: Erin K. Weber Organization or Agency: Army Contracting Command, Aberdeen Proving Ground Telephone: 410-306-2790 Email: erin.k.weber.civ@mail.mil

2.3 Contracting Officer's Representative (COR)

The COR is appointed and designated in writing by the KO to act as his or her authorized representative to assist in administering a contract. The COR is not empowered to make any contractual commitments or to authorize any contractual changes on the Government’s behalf. Any changes that the Contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action. The COR may be held financially liable for unauthorized directions given to the Contractor.

The COR is responsible for providing continuous technical oversight of the Contractor's performance. The COR uses the QASP to conduct the oversight/surveillance process. The COR shall keep a Quality Assurance file that accurately documents the Contractor's actual performance. The purpose is to ensure that the Contractor meets the performance standards contained in the contract. The COR is responsible for reporting early identification of performance problems to the KO. The COR is required to provide an annual performance assessment to the KO which will be used in documenting past performance. The QASP is the primary tool for documenting Contractor performance.

The COR is responsible for the overall technical administration of the contract and assures proper Government surveillance of the Contractor’s performance to ensure that contract quality requirements, provisions, standards, and thresholds are defined, practical, enforceable, necessary, and verifiable. The COR will have the responsibility for completing QA monitoring forms used to document the inspection and evaluation of the Contractor’s work performance. The COR will have primary responsibility for reviewing the Surveillance Checklists, Contractor Ratings Database (submitted by customers) and Technical Inspections (submitted by Technical Monitors (TM)). The COR shall also have the overall responsibility to maintain accurate and complete documentation of all surveillance activities. This should also include minutes of any meetings and all correspondence between the Government and the Contractor.

2.4 Other Key Government Personnel

Technical Monitors (TMs) The TM is a government point of contact designated in writing by the COR to act as his or her authorized representative to assist in administering the contract. The TMs are Subject Matter Experts (SMEs) assigned to act as a technical representative to aid in the oversight and administration of the contract. The TM will report all mission critical discrepancies to the COR. The TM shall provide detailed technical oversight of the Contractor’s performance in accordance with the QASP and report his or her findings to the COR in a timely, complete, and impartial fashion.

While the TM may serve as a direct conduit to provide Government guidance and feedback to the Contractor on technical matters outlined in the contract, he or she is not empowered to make any contractual commitments or to authorize any contractual changes on the Government’s behalf. Any changes that the Contractor deems may affect contract, price, terms, or conditions shall be referred to the KO for action. The TM will ensure that the Contractor’s performance is evaluated on a weekly basis or as required by the COR.

The TM is responsible for technical administration of the project and ensures proper government surveillance of the Contractor’s performance. The TM will have the responsibility for completing QA monitoring forms used to document the inspection and evaluation of the Contractor’s work performance. Government surveillance may occur under the inspection of services clause for any service relating to the contract.

Aberdeen Test Center (ATC) Contracts Team The ATC Contracts Team provides centralized contracts management support to all ATC activities to include, but not limited to, the following: technical advice in the preparation of Acquisition Request Packages, QASP preparation and implementation, training, development of internal policies and procedures, and serves as the liaison office between contracting activities and ATC.

2.5 Contractor Representatives

The following employees of the Contractor serve as the Contractor's Program Manager and Task Manager for this contract. (Complete this section after the contract award) Program Manager - <upon award, enter name> Telephone: <enter number> Email: <enter address> Task Manager - <upon award, enter name> Telephone: <enter number> Email: <enter address> Other Key Contract Personnel - <upon award, enter name or delete these lines if not applicable> Title: <enter title> Telephone: <enter number> Email: <enter address> 3 Methodologies to Monitor Performance

3.1 Surveillance Techniques

In an effort to minimize the performance management burden, simplified surveillance methods shall be used by the Government to evaluate Contractor performance when appropriate. The primary methods of surveillance are:

· Random monitoring, which shall be performed by the COR.

· 100% Inspection as deemed necessary to support evaluation of performance for purchases to support performance and deliverables.

· Periodic Inspection – COR typically performs the periodic inspection on a monthly basis.

3.2 Customer Feedback

Customer feedback may be obtained either from the results of random customer complaints. All customer complaints will be investigated to determine complaint validity. Valid customer complaints must set forth in writing the detailed nature of the complaint and must be signed and must be forwarded to the COR. The preferred method of complaint documentation is the Customer Complaint Report. The COR shall maintain a summary log of all formally received customer complaints as well as a copy of each complaint in a documentation file.

3.3 Acceptable Quality Levels

The acceptable quality levels (AQLs) for Contractor performance are included in Appendix 1, Performance Requirements Summary Matrix. Performance objectives define the desired outcomes. Performance Standards define the level of service required under the contract to successfully meet the performance objective. The inspection methodology defines how, when, and what will be assessed in measuring performance. The Government performs surveillance, using this QASP, to determine the quality of the Contractor's performance as it relates to the performance element standards.

4 Quality Assurance Documentation and Assessment

4.1 Performance Assessment

The Government shall use the monitoring methods cited to determine whether the performance standards/service levels/AQLs have been met. If the Contractor has not met the minimum requirements, the Contractor may be asked to identify the root cause and develop a corrective action plan to show how and by what date it intends to bring performance up to the required levels.

4.2 Surveillance Forms

The Government’s QA surveillance, accomplished by the COR and in conjunction with the TMs, will be reported using the forms in the Appendix. The completed forms will document the Government’s assessment of the Contractor’s performance to ensure that the required services are being achieved. The COR will retain a copy of all completed QA surveillance forms.

4.3 Acceptance of Services

When all services have been deemed acceptable and there is documented objective quality evidence to support acceptable performance, the COR will accept the services provided and authorize payment upon satisfactory completion of the work. This is done by approving the Contractor’s invoice in Wide Area Workflow https://wawf.eb.mil/.

4.4 Documentation

The COR should maintain a personal log of visits made to the Contractor’s work location, when the visit occurred, who was in the area at the time of the visit, what was observed, and what the COR said to the Contractor. The COR must input and upload all inspection records into the Procurement Integrated Enterprise Environment (PIEE), Surveillance and Performance Monitoring (SPM) Module.

4.5 Performance Issues

The COR must coordinate and communicate with the Contractor to resolve issues and concerns regarding unsatisfactory performance.

4.6 Resolution

The COR and Contractor should jointly formulate tactical courses of action for corrective actions.

4.7 Reporting

1. PIEE’s Joint Appointment Module (JAM) is used to nominate, appoint, track, and revoke an individual as a COR against an Army contract. Each designated COR is responsible for establishing and maintaining their profile in JAM. Monthly reports will be submitted as required in SPM module and approved by the KO.

2. Contractor Manpower Reporting Application (CMRA). A designated COR will be appointed by the requiring activity to verify annual manpower information entered into the CMRA online application by the prime Contractor. The Contractor is required to submit their manpower information by 31 October each fiscal year for the previous 12 months of labor data. COR validation of Contractor input is to be completed by 30 Nov each fiscal cycle.

3. Contractor Performance Assessment Reporting System (CPARS). At the completion of each annual performance period the COR will complete the CPARS report and submit via the online CPARS tool. The data will be input annually thereafter by the COR into the CPAR system prior to exercising the option for the next performance period. The COR will forward their CPAR assessment electronically to the KO who will review, add comments and forward to the Contractor. The Contractor has 30 days from receipt to concur, non-concur and/or make comments. The CPARS assessment will address, but is not limited to, the following elements:

· Quality of Service. Assess the Contractor’s conformance to contract requirements, specifications and standards of good workmanship (e.g., commonly accepted technical, professional, environmental or safety/health standards).

· Schedule. Assess the timeliness of the Contractor against the completion of the contract milestones, delivery schedules, test schedules or administrative requirements (e.g., efforts that contribute to or effect the schedule variance).

· Cost Control. Assess the Contractor’s performance in helping the government save money by improving processes, submitting value engineering change proposals, implementation of technical infusion and sustainment projects and seeking the best value on cost reimbursement items. For example, the evaluator will (1) compare actual cost center labor rates to Contractor proposed labor rates to ensure that the costs reported by cost center are consistent with labor amounts reported on invoices submitted to Defense Finance and Accounting Service (DFAS), (2) assess how well the contract management team manages overall execution of service provided to include the elimination of non-value added activities and their cost, (3) measure the indirect to direct ratio to track overhead (O/H) cost increases and non-productive hours vs. non-productive hours.

· Business Relations. Assess the integration and coordination of all activity necessary to effectively execute the contract specifically the timeliness, completeness and quality of problem identification, corrective actions plans, proposal submittals, the Contractor’s history of reasonable and cooperative behavior, customer satisfaction, timely award and management of subcontracts and whether the Contractor met small/disadvantaged and woman owned business participation goals.

· Safety. This is a critical area and any safety violations or poor safety performance will result in an unsatisfactory rating. The evaluator will assess performance based on results of work place safety evaluations, accidents, injuries, and SOP/policy violations. Inspection of this element will be performed through observation of daily operations and analysis of reports. Inspection factors will include the following:

1. No safety violations resulting in an incident, OSHA reportable or more severe or a major incident.

2. No at-fault safety violations resulting in damage to Government property.

3. Incidents are reported appropriately and timely.

4. No more than three instances of SOP/Policy violations per quarter.

· Security. This is a critical area and any security violations involving classified defense information may result in an unsatisfactory rating. This evaluation covers both Physical Security and COMSEC.

· Financial Liability for lost, damaged, stolen equipment (at-fault violations resulting in damage/loss to Government property).

Other elements shall be assessed and entered in CPARS as required.

4.8 Levels of Performance

Surveillance activities will monitor and measure Contractor performance. The following levels of performance are defined below and will be used for this contract as follows:

1. Satisfactory Performance. When a Contractor’s quality control program is effective, the resulting work performance can be expected to be satisfactory and within the specified AQL. If surveillance results show consistently good performance, the amount of surveillance can be decreased. If during a reduced inspection, a process is found to no longer be acceptable or the service becomes degraded, then the inspection frequency will increase.

2. Unsatisfactory Performance. If the number of complaints/defects exceeds the performance threshold for any objective, the COR will determine the possible cause and document findings. Government caused complaints/defects shall not be counted against the Contractor. The same applies to any other requirement of the contract when government caused deficiencies negatively impact Contractor’s performance. If the Contractor’s performance is judged unsatisfactory for any requirement in the contract, the COR will inform the Contractor’s on-site representative and request his/her signature and date of notification on the QA inspection sheet or Contractor Discrepancy Report (CDR) as appropriate. Any dispute(s) will be directed to the KO for resolution. The Contractor will be given a timeline after notification to correct the deficiency in accordance with the requirements of the contract. The KO will make the final determination of the consequences of uncorrected deficiencies.

Documentation of unsatisfactory performance or non-conformance supplies or services shall be classified as critical, major, or minor. Critical and major non-conformances will result in issuance of a CDR to the Contractor. The degree of non-conformance supplies or services is stated below as follows:

1. Non-Conforming Performance. All government discovered non-conformance shall be documented along with the Contractor focal point notified of the discrepancy. Documentation of non-conformance shall include the contract number, contract requirement and reference, the specific deficiency to the requirements, the date and time it was discovered, and government inspector (COR/TM) documenting the discrepancy.

2. Critical non-conformance is defined as a non-conformance that is likely to result in hazardous or unsafe conditions for individuals using, maintaining, or depending upon the supplies or services; or is likely to prevent performance of a vital agency mission. Critical non-conformances require the issuance of a CDR to the Contractor requiring the development of a corrective action plan by the Contractor which identifies the root cause, corrective action for the root cause, corrective action for the specific non-conformance, and the date the corrective action will be complete.

3. Major non-conformance is defined as a non-conformance, other than critical, that is likely to result in failure of the supplies or services, or to materially reduce the usability of the supplies or services for their intended purpose. Deficiencies that are recurring can also be classified as major. Major non-conformances require the issuance of a CDR to the Contractor requiring the development of a corrective action plan by the Contractor which identifies the root cause, corrective action for the root cause, corrective action for the specific non-conformance, and the date the corrective action will be complete.

4. Minor non-conformance is defined as a non-conformance that is not likely to materially reduce the usability of the supplies or services for their intended purpose, or is a departure from established standards having little bearing on the effective use or operation of the supplies or services which can be corrected on the spot. Minor non-conformances can be issued to the Contractor verbally however they are still required to be documented by the government.

Several forms or documentation methods shall be used to document Contractor performance to include, but are not limited to, the following:

1. Contract Discrepancy Reports (CDR). The CDR will be used whenever necessary in the administration of the contract to formally document unacceptable performance. The COR will initiate a CDR (fill out blocks 1 thru 4 and attach any supporting documentation), forward it to the KO for signature (block 5). After KO review it will be forwarded to the Contractor for corrective action. The Contractor will submit a corrective action, sign and return the CDR to the KO (blocks 6 thru 10). The KO will review the Contractor’s response and determine acceptance/rejection and finalize the CDR (blocks 11 and 12) and close out form. The COR will initiate a CDR, as a minimum, whenever unacceptable performance is determined critical in nature and requires immediate corrective action or trends develop in unacceptable performance (repetitive deficiencies) are recorded and require corrective action.

2. Customer Complaint Record (CCR). The CCR will be used to document unsatisfactory performance. COR will instruct TMs and customers on the proper completion of the CCR. Customer complaints, to be considered valid, must clearly present in writing the detailed nature of the complaint, must be signed, and must be forwarded to the COTR/COR. The COTR/COR will accept customer complaints and investigate them. The COR will validate each customer complaint before corrective action can be taken. Performance management drives the Contractor to be customer focused through initially and internally addressing customer complaints and investigating the issues and/or problems,

3. Customer Feedback. The Contractor is expected to establish and maintain professional communication between its employees and customers. The primary objective of this communication is customer satisfaction. Customer satisfaction is the most significant external indicator of the success and effectiveness of all services. Customer feedback shall be provided and can be measured through random customer complaints (described above) and customer satisfaction email.

5 Surveillance Matrix The Surveillance Matrix is the list of performance objectives and standards that must be performed by the Contractor. It is provided in Appendix 1. This matrix details the method of surveillance the COR will use to validate and inspect these performance elements. Inspection of each element will be documented in the COR file.

Performance objectives define the desired outcomes. Performance Standards define the level of service required under the contract to successfully meet the performance objective. The inspection methodology defines how, when, and what will be assessed in measuring performance. The Government performs surveillance, using this QASP, to determine the quality of the Contractor's performance as it relates to the performance element standards. The PRS should be used to form the foundation of the COR's inspection checklist.

In evaluating the quality of Contractor’s performance, the following performance ratings may be used.

Performance Rating Criteria

Excellent / Outstanding
Performance meets contractual requirements and exceeds many to the government’s benefit. The contractual performance of the element or sub-element being assessed was accomplished with no problems and Contractor actions were highly effective.
Very Good
Performance meets contractual requirements and exceeds some to the government’s benefit. The contractual performance was accomplished with few minor problems for which corrective actions taken by the Contractor were effective.
Good
Performance meets contractual requirements. The contractual performance contains some minor problems for which corrective actions taken by the Contractor were satisfactory.
Marginal
Performance does not meet some contractual requirements. The contractual performance reflects a serious problem for which the Contractor has not yet identified corrective actions. The Contractor’s proposed actions appear marginally effective or were not fully implemented.
Unsatisfactory
Performance does not meet most contractual requirements and recovery is not likely in a timely manner. The contractual performance contains serious problem(s) for which the Contractor’s corrective actions appear or were ineffective.

6 Attachments List of Attachments:

· Appendix 1, PRS (Surveillance Matrix)

· Appendix 2, Corrective Action Report (CAR)

· Appendix 3, Customer Complaint Record (CCR)

· Appendix 4, Performance Assessment Report (PAR)

Appendix 1 - Surveillance Matrix

Performance Requirement Summary (PRS)

Sub-paragraphs not identified in the PRS shall comply with the Standards / Acceptable Quality Levels (AQLs), as well as the incentive/remedy, identified for the major paragraph. More stringent or specific Standards, Acceptable Quality Levels (AQLs), Incentives and Remedies, may be listed for sub-paragraphs.

Statements
Standards/AQLs
Incentive/Remedy
Inspections
3.1 The Contractor shall perform ammunition support functions, including all sub-paragraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects How: Periodic review or random inspection Who: TM or COR

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.1.1 The Contractor shall provide ammunition assembly, disassembly, modification, and explosive operations support.
STD) Accurate and timely explosives/munitions inspection, assembly, disassembly, modification and hazard assessment/certification.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

AQL) Acceptable performance of this task requires the Contractor to perform explosives and munitions inspection, assembly, disassembly, and modification correctly and completely, with no more than one technically incorrect task or test delay every six months.

3.1.2 The Contractor shall provide ammunition accountability functions.
STD) Supply Class V Material (Ammunition) accountability to include physical location of material and records accuracy, completeness and timeliness.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Process turn-in documents within 5 business days of the end of the test event.

AQL) Supply Class V Material (Ammunition) shall be 100% accounted for.

3.2 The Contractor shall provide compliance, program, and staff support, including all subparagraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.3 The Contractor shall provide engineering, scientific, computer, software, programming, and Data Processing and Analysis for ATC, including all subparagraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.4 The Contractor shall provide Facilities Design and Maintenance, planning, and programming for operations, repair, and new alterations of facilities, including all subparagraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.5 The Contractor shall provide Test Instrumentation Operation, Maintenance, Repair, and Development, including all subparagraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.6 The Contractor shall patrol and secure APG restricted water zones, islands, and shorelines for ensuring public safety during testing, including all subparagraphs
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.7 The Contractor shall operate and maintain vehicles and associated equipment for ATC, including all sub paragraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and 99% completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery time and date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

STD) Testing must be conducted at a level of efficiency deemed acceptable by the Government.

AQL) Actively support testing or other typical operation (e.g., operating a communication or weapon system) at least 80% of each work shift. Commence testing immediately after the start of the shift safety briefing.

STD) Accurate and complete daily electronic driver or maintenance logs and other records reviewed and submitted to the government by the established schedule for all days worked.

AQL) 95% initial accuracy and 99% initial completeness of records and logs by 0900 the following workday, corrected to 100% accuracy and completeness within 24 hours.

STD) The Contractor shall provide an operator or maintainer with required license, without delay of testing.

AQL) No more than one incident per quarter of failure to supply an operator or maintainer with required licenses, without delay of testing

3.8 The Contractor shall provide technical test support for various test activities, including all subparagraphs.
STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.8.3 The Contractor shall provide a fully qualified and certified equipment operator with material handling and construction equipment.
STD) The Contractor shall provide an operator with equipment within two weeks of scheduled request.
The Contractor shall be responsible for expedite fees as a result of failure to supply an operator with equipment.

AQL) No more than two incidents per year of failure to supply an operator with equipment.

3.8.6 The Contractor shall operate and maintain digital data network systems, wireless networks, and automation applications used to support the ATC test mission.
STD) Contractor-managed systems shall be available and compliant.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

AQL) 99.9% availability of Contractor managed systems.

100% compliant with Category I vulnerabilities. 95% compliant, correctable to 100% within 24 hours or as required by the Government.

3.9 The Contractor shall provide Test Range/Facility

Operations Support for test set-up, execution, reporting, and operations of facility and equipment, including all sub-paragraphs.

STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No more than one validated complaint per quarter.

3.10 The Contractor shall comply with Overarching

Requirements for all high level objectives and tasks, including all sub-paragraphs.

STD) Accurate and timely delivery of work products within schedule and milestones, as requested by the Government. Contractor leadership review of work products prior to submission. Work performed by personnel with all appropriate licensing and certifications. Work compliant with all regulations. Mission capable.
Rework and remediation as a result of Contractor negligence or error shall be accomplished at no additional cost to the government.

Input into CPARS.

What: Visually observe operations How: Random intervals Who: TM or COR

What: Substantiated complaints How: Monthly review of feedback Who: TM or COR

What: Records and documents How: Periodic review or random inspection Who: TM or COR

What: Acquired or Developed Data, Equipment, or Work Products How: Periodic review or random inspection, Personnel interviews Who: TM or COR

What: Facility Projects

AQL) 95% accuracy and completeness for non-critical work products, corrected to 100% within one business day of requested correction. 100% accuracy and completeness for critical work products.

100% of reports and work products delivered by the assigned delivery date unless extension is granted.

100% compliant with all policies, regulations, and work directives, including but not limited to operating procedures and test plans.

95% Mission capable with no testing delays as a result of Contractor performance.

No…

This is the start of the file's text. The full file is on GovTribe.

File details come from the government source that posted it. Updated .