CERS_QASP_D_Attachment_2.pdf

Quality Assurance Surveillance Plan for the

Consolidated Emergency Response System

Dispatch, Alerting and Records Management Project

1 Introduction

This Quality Assurance Surveillance Plan (QASP) is pursuant to the requirements listed in the Consolidated Emergency Response System (CERS) Dispatch, Alerting and Records Management (DAR) Performance Work Statement (PWS). This plan sets forth the procedures and guidelines Product Manager, Emergency Response Systems (PdM ERS), Program Manager, Information Systems and Infrastructure (PM IS&I), Marine Corps Systems Command (MARCORSYSCOM) will use in ensuring the required performance standards or services levels are achieved by the contractor.

1.1 Purpose

The purpose of this QASP is to describe the methodology by which the contractor's performance will be monitored to determine compliance with established performance objectives, and to establish performance benchmarks that ensure a quantifiable basis for measuring effectiveness. The QASP is designed to limit surveillance to the necessary measures to verify that the contractor is satisfactorily performing services directly related to the performance requirements of the CERS DAR PWS.

1.2 Performance Management Approach

The PWS structures the acquisition around “what” service or quality level is required, as opposed to “how” the contractor should perform the work (i.e., results, not compliance). This QASP will define the performance management approach taken by PdM ERS to monitor and manage the contractor’s performance to ensure the expected outcomes or performance objectives communicated in the PWS are achieved. Performance management rests on developing a capability to review and analyze information generated through performance assessment. The ability to make decisions based on the analysis of performance data is the cornerstone of performance management; this analysis yields information that indicates whether expected outcomes for the project are being achieved by the contractor.

Performance management represents a significant shift from the more traditional Quality Assurance (QA) concepts in several ways. Performance management focuses on assessing whether outcomes are being achieved and to what extent. This approach migrates away from scrutiny of compliance with the processes and practices used to achieve the outcome. A performance-based approach enables the contractor to play a large role in how the work is performed, as long as the proposed processes are within the stated constraints. The only exceptions to process reviews are those required by law (federal, state, and local) and compelling business situations, such as safety and health. A “results” focus provides the contractor flexibility to continuously improve and innovate over the course of the contract as long as the critical outcomes expected are being achieved and/or the desired performance levels are being met.

1.3 Performance Management Strategy

The contractor is responsible for the quality of all work performed. The contractor measures that quality through the contractor’s own Quality Control (QC) Program. QC is work output, not workers, and therefore includes all work performed under this contract regardless of whether the work is performed by contractor employees or by subcontractors. The contractor’s QCP will set forth the staffing and procedures for self-inspecting the quality, timeliness, responsiveness, customer satisfaction, and other performance requirements in the PWS. The contractor will develop and implement a performance management system with processes to assess and report its performance to the designated Government representative. The contractor’s QCP will set forth the staffing and procedures for self-inspecting the quality, timeliness, responsiveness, customer satisfaction, and other performance requirements in the PWS. This QASP enables the Government to take advantage of the contractor’s QCP.

The Government representative(s) will monitor performance and review performance reports furnished by the contractor to determine how the contractor is performing against communicated performance objectives. The Government will make determination regarding incentives based on performance measurement metric data and notify the contractor of those decisions. The contractor will be responsible for making required changes in processes and practices to ensure performance is managed effectively.

2 Roles and Responsibilities

The Contracting Officer (KO) is responsible for monitoring contract compliance, contract administration, and cost control and for resolving any differences between the observations documented by the PdM ERS Contracting Officer's Representative (COR) and the contractor. The KO will designate one full-time COR as the Government authority for performance management. The number of additional representatives serving as technical inspectors depends on the complexity of the services measured, as well as the contractor’s performance, and must be identified and designated by the KO.

The COR is designated in writing by the KO to act as his or her authorized representative to assist in administering a contract. COR limitations are contained in the written appointment letter. The COR is responsible for technical administration of the project and ensures proper Government surveillance of the contractor’s performance. The COR is not empowered to make any contractual commitments or to authorize any contractual changes on the Government’s behalf. Any changes that the contractor deems may affect contract price, terms, or conditions shall be referred to the KO for action. The COR will have the responsibility for completing QA monitoring forms used to document the inspection and evaluation of the contractor’s work performance. Government surveillance may occur under the inspection of services clause for any service relating to the contract. The COR will conduct monthly performance reviews with the contractor based upon the information obtained through the surveillance methods identified above pertaining to the performance outlined in the Performance Requirements Summary (PRS), Attachment 1.

The failure of the contractor to meet the Acceptable Quality Level (AQL) may result in a reduction in the partial contract payment. Reviews and evaluations will form the basis for determining compliance with performance objectives, measures and standards. Monthly reviews will be used to identify the degree of success or failure by the contractor. Failure to perform due to contractor delay or failure to comply with the mutually developed Project Schedule will be considered a failure in performance threatening the execution of the program and will result in a basis for Government consideration. The Government reserves the right to withhold payment of invoices until deficient action is completed and/or consideration is provided.

3 Methodology to Monitor Performance

3.1 Surveillance Methods

Surveillance of contractor performance is the method used by the Government to determine whether the contractor is effectively and efficiently complying with all terms and conditions of the contract. The COR will use the surveillance methods listed below in the administration of this QASP. The PRS contains the performance objectives that are being measured.

Inspection: A method carried out by visual examination of a product (e.g., meeting minutes, data from testing, plans, procedures, reports, or documentation) or process.

Analysis: A method that is carried out by detailed examination to assess the application of the techniques used in order to determine if they are appropriate and effective.

Demonstration: A method carried out by operation of a process from start to finish or the operation of the system, or part of the system, that relies on observable functional operation.

Customer Feedback: A method by which installation operators may submit feedback on the performance of the system.

3.2 Acceptable Quality Levels

The AQLs included in the PRS Table, for contractor performance are structured to allow the contractor to manage how the work is performed while providing negative incentives for performance shortfalls.

Levels of performance are keyed to the relative importance of the task to the overall mission performance at each Marine Corps Installation receiving CERS DAR.

4 Quality Assurance Documentation

4.1 Performance Management Feedback Loop

The performance management feedback loop begins with the communication of expected outcomes.

Performance standards are expressed in the PWS and are assessed using the performance monitoring techniques shown in the PRS.

4.2 Monitoring Forms

The Government’s QA surveillance, accomplished by the COR, will be reported using the monitoring forms in Attachments 2, Sample QA Monitoring Form. The forms, when completed, will document the Government’s assessment of the contractor’s performance under the contract to ensure that the required results for CERS DAR are being achieved.

The COR will retain a copy of all completed QA surveillance forms.

5 Analysis of Quality Assurance Assessment

5.1 Determining Performance

The Government shall use the monitoring methods cited to determine whether the performance standards, service levels, and AQLs have been met. If the contractor has not met the minimum requirements, it may be asked to develop a corrective action plan to show how and by what date it intends to bring performance up to the required levels.

5.2 Reporting

At the end of each month, the COR will prepare a written report for the KO summarizing the overall results of the quality assurance surveillance of the contractor’s performance. This written report, which includes the contractor’s submitted monthly report and the completed quality assurance monitoring forms (Attachment 2), will become part of the QA documentation. It will enable the Government to demonstrate whether the contractor is meeting the stated objectives and/or performance standards, including cost, technical, and scheduling objectives.

5.3 Reviews and Resolution

The COR may require the contractor’s project manager, or a designated alternate, to meet with the KO, COR, PM and other Government IPT personnel as deemed necessary to discuss performance evaluation.

The COR will define a frequency of in-depth reviews with the contractor, including appropriate self-assessments by the contractor; however, if the need arises, the contractor will meet with the COR as often as required or per the contractor’s request. The agenda of the reviews may include:

Monthly performance assessment data and trend analysis

Issues and concerns of both parties

Projected outlook for upcoming months and progress against expected trends, including a corrective action plan analysis

Recommendations for improved efficiency and/or effectiveness

Issues arising from the performance monitoring processes

The COR must coordinate and communicate with the contractor to resolve issues and concerns regarding marginal or unacceptable performance.

The COR and contractor should jointly formulate tactical and long-term courses of action. Decisions regarding changes to metrics, thresholds, or service levels should be clearly documented. Changes to service levels, procedures, and metrics will be incorporated as a contract modification at the convenience of the KO.

Attachment 1 - CERS DAR Performance Requirements Summary

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

CAD: The contractor shall Engineer, Furnish, Install, Secure and Test (EFIST) a Computer Aided Dispatch (CAD) for CERS

DAR.

• Provide a CAD capable of supporting Law Enforcement (LE), Fire, and Emergency Medical Service (EMS) in any capacity including multi-jurisdictional.

• Ensure all calls for service and related information from the Enhanced 911 (E911) system are seamlessly transferred to the CAD.

• CAD provides dispatchers the capability to maintain situational awareness, rapidly assess and assign available emergency response resources.

• CAD provides integrated Geographic Information System (GIS)/Mapping and Emergency Medical Dispatch (EMD) job aids.

• Ensure CAD meets applicable system requirements set forth in the SDS (Appendix D to the PWS).

2.3.1

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

FSA: The contractor shall EFIST a Fire Station Alerting (FSA) system at each place of performance. (See Table 2-1 of the PWS for the quantity of fire stations per Installation requiring alerting capabilities.)

• FSA initiated from any emergency dispatch position

• Ensure FSA system meets applicable system requirements set forth in the SDS (Appendix D to the PWS).

2.3.2

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

MDC: The contractor shall extend the CERS DAR capability to mobile First Responders through the use of MDCs as in-vehicle information sharing tools. MDC to be inclusive of the device, vehicle mounting system and communications network interface.

Data is sent from the dispatchers to the MDSc via CAD systems.

• Configure MDCs to enable a secure interface (IAW IA policy and directive) with the CAD system, allowing secure communications with the MDC.

• Ensure the CAD system interfaces with MDCs by one or more mobile communications networks.

• Configure the MDC units to monitor all CAD event and unit activity, view important call details, maintain their own status for assigned calls/events, update existing CAD events from the field, provide call/event disposition comments, send private and secure car-to-dispatch/car-to-car messages and perform comprehensive name, vehicle and property searches in Fire and Emergency Service (F&ES) and LE databases.

• Ensure all MDCs have access to geographical maps. F&ES database, LE databases, and RMS and report generation tools.

• Provide vehicle mounts where necessary for the MDC and all associated ancillary devices.

• MDC does not interfere with the normal operations of the vehicle to include driver controls; Heating, Ventilation, &

Air Conditioning; air bags; and battery power.

• Use of the MDC does not degrade the vehicle battery life.

• Ensure MDC meets applicable system requirements set forth in the SDS (Appendix D of the PWS).

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

LE RMS: Contractor shall EFIST an LE RMS for CERS DAR.

• Ensure LE RMS meets applicable system requirements set forth in the SDS (Appendix D to the PWS). 2.3.4

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Uninterrupted Power Supply (UPS) System – Common Equipment: The contractor shall provide a solution that supports the power budget for the common equipment. 2.3.5

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Interface Requirements: The contractor shall integrate CERS DAR components without degrading service, performance, or function of previously installed or existing systems.

• CERS DAR integrates with CERS E911, E-LMR, and BTI without replacing hardware or software components of existing systems.

• Leverage user access rights and databases from CERS E911.

• Integrate CERS DAR with existing audible and visual alarm notification at the consoles to alert any failure or outage on the system.

• Utilize existing administration interfaces deployed during CERS E911.

• Integrate CERS DAR components with existing dispatch workstation hardware.

• Integrate CERS DAR components with existing Administration and Maintenance (A&M) workstation hardware.

2.4

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

E911 Computer Premise Equipment (CPE): The contractor shall interface CERS DAR components with the E911 system deployed during CERS E911 to allow Automatic Number Identification /Automatice Location Identification (ANI/ALI) data to be sent from the E911 system to the CAD.

CERS E911 components are: Dispatch LAN, Time Synchronization, E911 CPE, Logging and Recording, Furniture, UPS.

2.4.1

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Logging and Recording: The contractor shall interface CERS Dispatch components with the E911 system to allow call data including the voice call to be associated with the incident record for RMS storage. 2.4.2

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

Dispatch Local Area Network (LAN): The contractor shall build CERS DAR on the LAN deployed during CERS E911. 2.4.3

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Time Synchronization: The Contractor shall integrate CERS DAR with existing time synchronization services.

• Synchronize CERS DAR components and subsystems to Global Positioning System (GPS) time synchronization sources deployed under CERS E911.

• Ensure MDCs are time synchronized with the CERS E911 capability.

2.4.4

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

GIS Data Integration: The contractor shall integrate CERS DAR components with the GIS mapping data to provide a mapping capability from existing Government Furnished Information (GFI).

• Use native ESRI file formats to the maximum extent possible.

2.4.5

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

F&ES RMS: The contractor shall provide a web services direct interface to the F&ES RMS that is capable of sending CAD data directly to the F&ES RMS system via a secure web link. 2.4.6

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

E-LMR Dispatch Console: The contractor shall integrate CERS DAR with existing E-LMR dispatch consoles.

• Able to integrate the following console types: Motorola, Harris, Zetron and Cassidian.

• Dispatch console integration includes the ability to accept radio Position Location Identification (PLI) and AVL

2.4.7 Accuracy, Clarity and

Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

capabilities where they exist, and that standard interfaces are provided in all cases to allow PLI and AVL information from future E-LMR systems to be ingested. Timeliness

All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Fire Alarn Systems: The contractor shall integrate CERS DAR with existing Fire Alarm monitoring systems add that have the required external interface.

• Able to integrate at a minimum Monaco and King-Fisher fire alarm monitoring systems.

2.4.8

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

UPS System – Workstation: The contractor shall provide a solution that fits within the power budget for the existing CERS E911 console workstations or provide UPS additions or changes required to support the existing and newly installed systems at cutover.

2.4.9

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Workstation Area: The contractor shall EFIST and make operational CERS DAR desktop equipment, including cabling, power, display monitors, and ancillary devices, with the existing CERS E911 workstation area to create a dispatch workstation that complies with American National Standards Institute/Human Factors and Ergonomics Society (ANSI/HFES) 100-2007.

• Furnish a single keyboard and mouse at each workstation, which will give the dispatcher access to any information they can view from the workstation. Keyboard and mouse will interface with all contractor computer systems via the E911-provided Keyboard-Video-Mouse (KVM) interface.

• Operators are able to view information from any of the disparate systems (i.e., E911, CAD, FSA), and dispatch from a single workstation IAW ANSI/HFES 200-2007.

• Layout is customizable by the the user for their specific work preference and responsibilities.

• Peripheral equipment located on a dispatch workstation is not permanently attached to the workstation; instead it is adjustable across the surface of the workstation.

2.4.10

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

A&M: The contractor shall integrate CERS DAR to the A&M workstations to support the administration of CERS DAR components and interfaces. 2.4.11

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Project Planning: The contractor shall establish and maintain a Project Plan that meets the Government’s requirement for insight into the contractor’s methods of procedure used throughout the performance period of the PWS.

• Provide and brief the Project Plan at the Post Award Conference (PAC).

• Project Plan is updated when changes to structure, schedule or performance occur and submitted monthly, at a minimum, to the Government for review.

• Provide Project Plan updates are provided during the weekly meetings.

• Project Plan shall:

a) Function as a monthly Plan of Action and Milestones (POA&M) that includes project phases for each installationlocation.

b) Identify the project timeline and associated milestones. Track the progress and critical milestons of the program, including the tasks needed to complete the project.

c) Indicate the order in which the contractor proposes to perform the work and the dates on which the contractor contemplates starting and completing tasks (including acquiring materials, equipment, and utility service connections).

d) Address a management approach and highlight actions that will be taken to mitigate risk to cost, schedule, and performance.

e) Describe the contractor’s approach to Resource Management

f) Highlight positive or negative impacts; provide details on the process to deal with unforeseen site conditions;

and predict schedule slips.

g) Detail work tasks and be reflective of activities and submittals including: technical reviews, planning, Product Acceptance, Site Acceptance, training, asset tagging, closeout documentation, and “as-built” submittals at a minimum.

h) Reflect the updated project progress as percent complete values for each task and project phase.

i) Include information in the form of a progress chart and indicate task dependencies.

j) Be baselined at the time of initial submittal and be re-baselined only upon Government approval

k) Provide any and all necessary information, data, studies, and reports necessary or useful to demonstrate full compliance with Federal, State, and Local enfironmental laws, including any known potential compliance issues associated with the system manufacturing, testing, operations, or disposal.

3.1

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Quality Control: The contractor shall develop and maintain an effective quality control program to ensure services are performed IAW the PWS.

• All discrepancies are reported to the Contracting Officer’s Representative (COR), the PdM, and the local Technical Support Officer (TSO) within one (1) calendar day to ensure immediate resolution.

• Contactor’s internal quality control program shall establish tracking records for all measurable performance requirements listed in the PWS.

• Contractor incorporated the following minimum elements into the Quality Control Plan (QCP):

3.2

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

a) Definition of contractor quality control management lines of responsibility.

b) Quality Control Management System Process.

c) Internal Design Review/Change Control Process.

d) Internal Document Control Process.

e) Process for preliminary systems testing and validation Prior to Government System Qualification Test

(SQT).

f) Process for the execution of corrective maintenance.

g) Process for maintaining quality assurance records throughout the project lifecycle.

h) Process for performing random internal quality control audits.

• Draft QCP provided and briefed as part of the PAC.

• Final QCP presented at the System Requirements Review-2 (SRR-2).

• Changes to the QCP provided to the Contracting Officer and COR for approval at least 10 working days prior to implementation.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

SEMP: The contractor shall document and provide a Systems Engineering Management Plan (SEMP) detailing processes that aligns with the Government Systems Engineering Plan (SEP) that will be used to implement and commission all planned systems.

• Draft contractor formatted SEMP delivered during the SRR-2.

• Final SEMP submitted NLT 20 working days after completion of SRR-2.

• Provide a Hazardous Material Management Program Plan (HMMPP) as an attachment to the SEMP to identify hazardous materials used to build, test or deploy CERS DAR, including procedural controls and precautions to be followed and risks of hazardous materials.

• Provide a discussion as part of the SEMP of Human Factors and Human Systems Integration (HSI) methods, processes, and standards that were used in the development of this system, including the system’s projected compliance with the HIS standards listed in the SDS.

• Develop content for Categorical Exclusions, Environmental Assessments, Environmental Impact Statements, and associated documentation, including the PESHE, NEPA Compliance Assessments, and Overseas Environmental Assessments IAW EO 12114, Environmental MFRs, and other required environmental documentation and assessments to include any necessary NEPA/EO 12114 MFRs and Decision Memorandums.

• Document a Safety Assessment Report (SAR) to identify safety features of the hardware, software, and system design and to identify procedural, hardware, and software related hazards that may be present, including specific procedural controls and precautions to follow, and any residual safety risks.

• Present draft SAR as part of the SRR-2.

• Provide a final SAR with each system installation.

3.3

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

CMP: The contractor shall establish and maintain a Configuration Management (CM) Program throughout the project lifecycle.

• Program CM is documented in a Configuration Management Plan (CMP) that aligns with the Government’s

Configuration Management Program (CMP).

• Draft CMP submitted for review at the PAC.

• Final CMP approved at the SRR-2.

3.4

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

PAC: The contractor shall conduct a PAC, in the National Capital Region at a Government specified location, within 30 calendar days after contract award.

• NLT two (2) calendar days prior to the PAC, electronically send to all participants the meeting information to include

3.5 Accuracy, Clarity and

Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

the agenda and presentation slides (in MS Office format), and the Project Plan (in MS Project and PDF file).

• Provide a hardcopy binder of all required deliverables for each Government PAC participant.

• Following the PAC, make the recommended changes to the documents presented during the PAC.

• Pepare PAC electronic meeting minutes and submitted for approval NLT five (5) working days after the meeting.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Weekly Meetings and Status Reports: The contractor shall participate in weekly meetings with Government personnel either by teleconference or video teleconference to ensure the adherence to the Project Plan.

• At a minimum, participate in the weekly meeting in-person on a quarterly basis at a predefined Government location.

• During the weekly meetings, provide status updates, findings, milestones, significant actions, issues and concerns, and discrepancies.

• Submit a weekly meeting agenda NLT two (2) working days prior to the first weekly meeting; use the Government approved agenda for all weekly meetings.

• Establish a Weekly Meeting Action Log that tracks individual assigned actions including persons assigned, dates, Course of Actions (COAs), and reference to the meeting at which the action was assigned.

• Make the action log available NLT one (1) working day prior to the weekly meeting.

• Establish and maintain a library throughout the project showing drawings or photographs of critical items and work progress.

• Make the library available NLT one (1) working day prior to the initial weekly meeting.

• Provide weekly meeting minutes within five working days after each meeting.

• Transfer weekly meeting minutes, action logs, and the photo library to the Government upon final acceptance of the project.

• Provide a secure method, such as a secure File Transfer Protocol (FTP) site, for delivering related project documents and weekly project photos electronically to the Government.

3.6

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

Inspection, Analysis,and Customer Feedback.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

System-Level Engineering Document Package: The contractor shall present the preliminary system-level document package and conduct a preliminary document review to allow the Government to validate the drawing formats, details captured, quality, and accuracy of the information.

• Deliver the preliminary system-level engineering document package NLT thirty (30) working days prior to the SRR.

• At a minimum, the contractor’s system-level engineering document package includes:

a) Table of Contents/Drawing Index.

b) System Architecture Diagram (logical diagram).

(1) Network services required for the operation of that device. Indicate the service name, protocol (e.g., Transmission Control Protocol and User Datagram Protocol) and port range.

c) System Time Synchronization Diagram (notional).

d) Design Descriptions: (1) System-Subsystem Design Description: DI-IPSC-81432A; (2) Database Design

Description: DI-IPSC-81437A; (3) Data Flow Description;( 4) Theory of Operation.

e) Signal and Power Rack Plans.

f) Rack Elevations (notional).

g) Electrical Circuit Route Plan (notional).

h) Details of Interfaces to Other Systems/Subsystems.

(1) Interface Control Document: DI-CMAN-81248A, DI-IPSC-81436A, DI-IPSC-81434A.

i) Details of Surge Protection Devices.

j) Details of Connector Terminations.

k) Detail Device Wiring.

4.1

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

l) Operating systems, applications, open-source software, Mobile Code, utilities, drivers, system services, scripts, configuration files, databases (including full database schemas), and other software required and the appropriate configurations, including revisions and/or patch levels for each of the computer systems.

m) List of hardware to include make, model, purpose/function, and supplier.

• After completion of the preliminary document review and Government acceptance, construct the final system-level engineering document package incorporating any comments or changes delineated by the Government.

• Deliver the final (90 percent) system-level engineering document package for review NLT fifteen (15) working days after completion of the SRR.

• When the final system-level engineering document package has been completed, prepare and conduct a final documentation review during a regular scheduled weekly meeting to allow the Government to provide final comments prior to final acceptance and implementation.

• Adjudiate Government comments.

Effectiveness All portions of this section accomplished the Government’s total product goals.

This task fulfilled the PWS requirements.

Analysis, Demonstration, and Customer Feedback.

Location-Specific Engineering Document Package: A preliminary location-specific engineering document package.

• At each PCV, provide the preliminary location-specific engineering document package and conduct a preliminary document review to allow the Government to validate the drawing formats, details captured, quality, and accuracy of the information.

• Deliver the preliminary location-specific engineering document package NLT five (5) working days prior to each

PCV.

• Deliver the final location-specific engineering document package twenty (20) working days prior to each Site

4.2

Accuracy, Clarity and Completeness

All aspects of this section were accurately, clearly, and completed to the Government’s requirements within the scope of this section.

This task was completed to the DoD standards and fulfilled the PWS requirements.

Inspection, Analysis, Demonstration, and Customer Feedback.

Timeliness All portions of this section were completed satisfactory within the time frame the Government requested.

This task was completed within the schedule set forth in the contract and satisfied the PWS requirements.

CERS DAR PERFORMANCE OBJECTIVE

PWS

PARA.

No.

PERFORMANCE

MEASURE PERFORMANCE STANDARD ACCEPTABLE QUALITY

LEVEL (AQL)

METHOD OF

SURVEILLANCE

Acceptance.

• Deliver the “as-built” location specific engineering document package five (5) working days after each Site

Acceptance.

• Redline the location specific engineering document package and incorporate the changes into a final “as-built” drawing package.

• Final “as-built” diagrams delivered on Compact Disk – Read Only Memory and one (1) printed hardcopy during the installation Site Acceptance.

• Review the final engineering document package for differences between the planned install and the actual. All differences are formally noted on the final document package.

• At a minimum, the location-specific engineering document package includes:

a) Table of Contents/Drawing Index.

b) System Architecture Diagram (logical diagram);

(1) Source Device Name and Media Access Control and/or Internet Protocol (IP) Address; (2) Destination Device Name and Media Access Control and/or IP Address.

c) System Time Synchronization Diagram.

d) Floor Plan.

e) Electrical Plan Notes.

f) Panel Schedules.

g) Signal and Power Rack Plans.

h) Rack Elevations.

i) Horizontal and Vertical Layouts.

j) Cable Racking…