GCCS-TCO__JTCW_QASP_7_Oct_2015_-_Final.pdf

PWS Enclosure (1)

Quality Assurance Surveillance Plan (QASP) for

Global Command and Control System (GCCS) -

Tactical Combat Operations (TCO) /

Joint Tactical Common Operational Picture (COP) Workstation (JTCW)

Test & Evaluation (T&E)

Contractor Support Services (CSS)

1. PURPOSE.

This Quality Assurance Surveillance Plan (QASP) has been developed as the principal basis for assessing overall performance of the technical support for the GCCS-TCO/JTCW effort. This document will be used by the Government to evaluate the Contractor’s performance to assure they are timely, effective, and are delivering the services and products specified in the contract.

This QASP provides the methodology by which the Contractor's performance will be monitored and to establish performance benchmarks that ensure a quantifiable basis for measuring effectiveness. The plan is designed to limit surveillance to the minimum necessary to verify that the Contractor is satisfactorily performing services directly related to the performance requirements of the Performance Work Statement (PWS). The performance requirements are those designated with corresponding performance measures and performance standards.

Surveillance will be accomplished in accordance with the Performance Requirements Summary

(PRS).

2. GOVERNMENT SURVEILLANCE

The Contracting Officer’s Representative (COR) is identified in the PWS. COR authority will be limited to administering specific technical aspects of the contract. The PWS will identify specific guidelines and clearly detail the limits of the COR’s authority. The COR will:

a. Monitor Contractor performance in accordance with this QASP.

b. Coordinate priorities of support, resources, and associated schedules.

3. SURVEILLANCE METHODS

Surveillance of contractor performance is the method used by the Government to determine whether the contractor is effectively and efficiently complying with all terms and conditions of the contract. The COR may use any of the surveillance methods listed below, or any other reasonable method not listed, in the administration of this QASP:

a. Inspection: A method carried out by visual examination of a product (e.g., meeting minutes, data from testing, plans, procedures, reports, or documentation) or process.

b. Analysis: A method that is carried out by detailed examination to assess the application of the techniques used in order to determine if they are appropriate and effective.

c. Demonstration: A method carried out by operation of a process from start to finish or the operation of the system, or part of the system, that relies on observable functional operation.

d. Customer Feedback: A method carried out by soliciting customer/end user satisfaction of technical services performed by the contractor.

4. PERFORMANCE REQUIREMENTS SUMMARY

The performance requirements requiring Government surveillance, the performance standards, and the surveillance methods are set forth in the PRS, Attachment (1). The performance requirements correspond to paragraph 3 of the PWS. The performance measures to be used are technical accuracy, clarity, completeness, timeliness, and effectiveness. The performance standards define what is considered acceptable performance and are the benchmarks against which performance will be measured. The Acceptable Quality Level (AQL) is the maximum acceptable variation from the performance standard. The surveillance method is how performance will be checked. The COR will use the PRS to evaluate the Contractor’s performance to assure they are timely, effective, and are delivering the services and products specified in the contract.

5. PERFORMANCE REVIEWS AND EVALUATIONS

COR Responsibility: The COR will conduct monthly performance reviews with the Contractor based upon the information obtained through the surveillance methods identified above pertaining to the performance outlined in the PRS. The following criteria will be used for performance evaluations:

EXCELLENT: Performance significantly exceeds contractual requirements to the

Government’s benefit; above the minimal acceptable level.

SATISFACTORY: Performance meets contractual requirements; minimal acceptable level.

UNSATISFACTORY: Performance does not meet contractual requirements; below minimal acceptable level.

Contractor Responsibility: The failure of the Contractor to meet the AQL set in the PRS may result in a reduction in contract payment. Reviews and evaluations will form the basis for determining compliance with performance requirements, measures, and standards. Performance reviews will be used to identify the degree of success or failure by the Contractor. Failure to perform due to Contractor delay or failure to comply with the mutually developed project schedule will be considered a failure in performance threatening the execution of the program and will result in a basis for Government consideration. The Government reserves the right to withhold payment of invoices until deficient action is completed and/or consideration is provided.

6. GOVERNMENT RESOURCES AND DEFINITIONS

The following definitions of Government Resources are applicable to this QASP:

Contracting Officer: A person duly appointed with the authority to enter into, administer, or terminate contracts and make related determinations and findings on behalf of the Government.

The Contracting Officer is ultimately responsible for the final determination of the adequacy of the Contractor’s performance.

Contracting Officer’s Representative (COR). The COR is an individual designated and authorized in writing by the Contracting Officer to perform specific technical or administrative functions of a contract. The COR engages in Government surveillance of the Contractor’s performance. The COR may evaluate the Contractor’s performance and document any non-compliance, but only the Contracting Officer may take action against the Contractor for unacceptable performance. The COR is not authorized to make any commitments or changes that will affect price, quality, quantity, delivery, or any other term or condition of the contract.

Attachment (1) to PWS Enclosure (1)

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method

Monthly Status

Report

4.1 Technical

Accuracy, Clarity, and

Completeness

The report accurately addresses:

• All services provided and all events, products, and deliverables completed during the reporting period,

• All on-going activity/tasks for the upcoming reporting period, and

• Issues/concerns or problem areas, and actions planned or recommended solutions for alleviating the problem.

Report adheres to the established format.

Identifies 95% of the on-going activities/tasks.

Inspection

Timeliness The report is delivered on or before the 10 th of each month.

Meets delivery schedule 90% of the time (excluding government caused delays).

Effectiveness Problems avoided or reduced once planned or recommended solutions implemented.

Performance occurs with no required rework at least 80% of the time.

Analysis, Demonstration, and

Customer

Feedback

Test Support 3.1

4.2

4.3

4.4

Technical

Accuracy, Provides SMEs technically qualified to conduct test planning, conduct test, conduct test analysis, and provide accurate test reports based on results of test events using relevant MAGTF C2 architecture.

• Produce test plans, test cases/ scenarios, test procedures/scripts, and test data relevant to the test to be conducted.

• GCCS-TCO/JTCW FoS equipment is safely setup and configured for the test to be executed.

• Troubleshoots test environment to identify critical issues prior to start of test events to identify possible configuration issues.

• Write or verify problem reports for technical accuracy and completeness.

Products adhere to the established

MCTSSA format and are technically accurate 90% of the time.

Inspection, and

Demonstration

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method

• Provide test plans that adhere to the format and content requirements of the Government provided templates.

The final version of each product adheres to the established format, is complete (i.e., all constituent parts are present and each part is addressed in sufficient detail based on its intended use), and incorporates Government review comments.

Timeliness Perform all tasks and produces products per established schedules.

A draft test plan delivered to the

Government 15 days prior to test or engineering evaluation. The final test plan delivered within 7 days after receipt of Government comment as per PWS paragraph

4.3.

Test procedures and individual test scripts are due 10 days prior to a test or engineering evaluation.

Modifications or redlines made to the test procedures during test execution are due 7 days following completion of the test as per PWS paragraph 4.4.

Meets schedule at least 90% of the time (excluding

Government caused

Effectiveness The level of detail for the products produced is based on the intended use and audience, and demonstrates a firm understanding of 95% technical requirements and the test objectives/goals.

Performance of tasks and products produced directly contribute to the successfully execution of the test event.

Performance occurs with no required rework at least 90% of the time.

Analysis, Demonstration, and

Customer

Feedback

Test Execution

Support

3.1

4.5

4.6

Technical

Accuracy, Clarity, and

Conducts test events and accurately documents anomalies and reports issues found during test

Products adhere to the established format and are

Inspection, Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method execution.

• Maintains test logs for every day of testing and delivers the test log to the data collector at the end of each test day. Test logs comply with the format agreed to by the

COR.

technically accurate

90% of the time.

Timeliness Tasks are performed and products are delivered per the established schedule.

Test Logs are delivered to the government representative at the end of each day during the test and at the conclusion of testing as per

PWS paragraph 4.6.

time (excluding

Effectiveness Products delivered demonstrate a firm technical understanding of the task, and meet 90% of the test technical goals and objectives.

and

Demonstration

Post-Test Support 3.1

4.7

4.8

Technical

Accuracy, Post-test activities are conducted in a timely manner and reports accurately depict the test results vides technical and analytical support and produce products that are technically accurate and understandable by the intended audience, tasks include:

• Conducts post-test analysis and reports the test results against all testable requirements defined in the test plan.

• Identify allocated requirements not tested and provide rationale for not testing the requirement.

• Test report contains all elements referenced in Section 2.1 of this

PWS.

adheres to the established format, Products adhere to the established format and are

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method is complete (i.e., all constituent parts are present and each part is addressed in sufficient detail based on its intended use), and incorporates Government review comments.

Timeliness Performs all tasks and produces

A draft test report is delivered per the established schedule. The final test report delivered within 10 days after receipt of Government comment as per PWS paragraph

4.8.

Test procedures and test scripts delivered per the established schedule.

time (excluding produced is based on the intended use and audience, and demonstrates a firm understanding of 95% technical requirements and and

Demonstration

Joint Certification

Testing

3.2

4.2

4.8

Technical

Accuracy, Provides technical and analytical support and produce products that are technically accurate and understandable by the intended audience, tasks include: include:

• Provide technical support for joint certification testing led by the

Joint Interoperability Test

Command (JITC).

• Provide technical support to include test architecture diagrams, test documentation review, requirements analysis, test setup and configuration, test operator support and data collection.

Products adhere to the established format and are technically accurate

90% of the time.

Inspection, Analysis, and feedback

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method

Timeliness Performs all tasks and produces products per established schedules.

Meets schedule at least 90% of the time (excluding produced is based on the intended use and audience, and demonstrates a firm understanding of 90% technical requirements and successfully execution of the test event.

Performance occurs with no required rework at least 80%

Inspection, Analysis, Demonstration

Technical Support to MAGTF C2

Test and engineering events

3.3

4.2

4.8

Technical

Accuracy, Provides technical and analytical support and produce products that are technically accurate and understandable by the intended audience, tasks include:

• Serve as a GCCS-TCO/JTCW subject matter expert (SME) in a

MAGTF environment to test/engineering events outside of

GCCS-TCO/JTCW projects.

• Assist or verify setup and configuration of the test environment and troubleshoots technical problems.

• Write or verify TIRs/technical reports for technical accuracy and completeness.

the established format and are

Demonstration and feedback

Timeliness Performs all tasks and produces

A technical report is provided 7 days following meeting conclusion.

The contractor shall deliver a document review within 7 days after document receipt.

The contractor shall deliver technical write-ups per the established schedule.

time (excluding

Government caused

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method

The final is due 5 days after receipt of Government comments.

produced is based on the intended use and audience, and demonstrates a firm understanding of 90% technical requirements and successfully execution of the test event.

Performance occurs with no required

Demonstration and customer feedback

Working Group

Participation

3.4

4.2

4.5

Technical

Accuracy, Participates in various working groups to provide technical and analytical support and produce technical reports that are technically accurate and understandable by the intended audience, tasks include:

• Participate in weekly GCCS-

TCO/JTCW technical review board

(TRB) working groups.

• Verbally present any submitted

Test Incident Reports (TIR).

• Provide GCCS-TCO/JTCW

Subject Matter Expertise (SME) in the review of GCCS-TCO/JTCW

TIRs.

• Conduct further analysis on any new/existing TIRs as directed by the Government.

• Technical Reports may be required for further engineering analysis as well.

• Participates in weekly

GCCS_TCO/JTCW Test IPT.

• Provide GCCS-TCO/JTCW SME support in technical discussions.

• Provide in-depth technical status of ongoing test and engineering events.

• Provide in-depth technical status of ongoing test and engineering events as required.

the established format and are

Inspection and customer feedback

Performance Requirement Summary

Performance

Requirement

PWS

Para

Performance

Measure

Performance

Standard

Acceptable

Quality Level

(AQL)

Surveillance

Method adheres to the established format, is complete (i.e., all constituent parts are present and each part is addressed in sufficient detail based on its intended use), and incorporates Government review comments.

Timeliness Perform all tasks and produce

Required technical reports are due

15 days prior to test or engineering evaluation. Final report is due 5 days after Government review as per PWS paragraph 4.2.

Required TIRs are to be written and delivered to the Government within 2 working days of systems error discovery, unless otherwise agreed upon by the Government as per PWS paragraph 4.5.

time (excluding

Effectiveness Test Incident Reports identifies

90% of the mandatory information requirements such as detailed description of problem, system parameters, possible work-around and steps to re-create.

Technical Reports contain 90% of relevant technical information to include description, analytical approach, conclusions and recommended courses of action.