Attachment_0005_QASP_ _PRS_for_2017_SSMP_Task_Order.docx

QUALITY ASSURANCE SURVEILLANCE PLAN

Sample Survey of Military Personnel (SSMP)

1.0 INTRODUCTION

1.1. Purpose. The purpose of the Quality Assurance Surveillance Plan (QASP) is to identify the methods and procedures the Government will use to evaluate contractor performance while concurrently determining the contractor is meeting the mission essential elements of the Performance Work Statement (PWS). The QASP is designed to provide an effective surveillance method by monitoring contractor performance for each listed performance objective in the Performance Requirements Summary (See Section 7).

1.1.1. The QASP provides a systematic method to evaluate the services the contractor is required to perform as specified in the PWS and the contract proposal.

1.1.2. The QASP is developed by the requiring activity. It is designed to provide direction to personnel performing contractor surveillance activities. Personnel surveying the contract terms and conditions and PWS requirements will periodically review the QASP throughout the life of the contract.

2.0. ROLES AND RESPONSIBILITIES.

2.1. Government. The role of the Government in quality assurance is to ensure the contractor is performing in accordance with the contract requirements and contract standards are achieved.

2.2. Contracting Officer. The Contracting Officer is responsible for safeguarding the interests of the United States Government in contractual relationships. Only the Contracting Officer is authorized to bind the Government and then, only to the extent of the authority entrusted to them through the issuance of a warrant.

2.2.1. The Contracting Officer designates authority for inspection and/or acceptance responsibilities to the COR – or delegates authority to another certified acquisition professional - in accordance with the FAR/DFARS. This documented authority allows the COR or other certified acquisition professionals to act on the Contracting Officer’s behalf.

2.2.2. The Contracting Officer informs the contractor of the names, duties, and limitations of authority for all quality assurance personnel assigned to the contract.

2.3. Contracting Officer Representative. The Contracting Officer Representative (COR) when designated:

i. develops and creates the QASP

ii. serves as the eyes and ears for the Contracting Officer at the contractor’s site

iii. monitors contractor performance to ensure contract requirements are met for: Performance, Cost, and Schedule

iv. ensures that contract quality requirements, provisions, standards, and thresholds are defined, practical, enforceable, necessary, and verifiable.

v. evaluates and documents contractor performance in accordance with this QASP and the PWS.

vi. notifies the Contracting Officer of any significant performance deficiencies using a Contractor Discrepancy Report with supporting documentation.

vii. maintains surveillance documentation.

viii. recommends improvements to the QASP and PWS throughout the life of the contract.

3.0. DESCRIPTION OF SERVICES

3.1. Scope of Work. The scope of this requirement is for the Contractor to provide ARI with the necessary capabilities to conduct attitude and opinion surveys in support of ARI’s scientific and technology program. The survey(s) will be distributed to samples of junior enlisted Soldiers and non-commissioned, warrant, and commissioned officers. The survey(s) assesses Soldiers’ attitudes and opinions on an array of issues critical to the Army. The accuracy and timeliness of this survey data is of paramount importance in supporting senior leader decision-making.

4.0. QUALITY REQUIREMENTS

4.1. Quality Control Program. The contractor, not the Government, is responsible for management and quality control actions to meet the terms of the contract. Details of these controls will be document (when required) in the contractor’s Quality Control Program document.

5.0 SURVEILLANCE. The COR will perform monthly surveillance based on the quality and effectiveness of the contractor’s data deliverables as well as the services provided. Regardless of the surveillance method, the COR shall always contact the contractor's quality manager or on-site representative when a defect is identified and inform the manager of the specifics of the problem. The COR, when designated, shall be responsible for monitoring the contractor’s performance in meeting a specific performance standard/AQL.

5.1 Unacceptable Performance. If the number of complaints/defects exceeds the performance threshold for any objective, the COR will determine the possible cause of this unacceptable performance. Government-caused complaints/defects will not be counted against the contractor. The same applies to any other requirement of the contract when Government-caused complaints/defects are the cause of unacceptable contractor performance. If the contractor’s performance is judged unacceptable for any requirement by the COR, the COR will document the discrepancy as a non-conformance and inform the contracting officer (if needed) for resolution. Significant (major non-conformance) performance deficiencies must be submitted to the Contracting Officer using a Contractor Discrepancy Report and include supporting documentation.

6.0 DOCUMENTATION REQUIREMENTS.

7.0 PERFORMANCE REQUIREMENTS SUMMARY (PRS)

7.1 Overview. The PRS details and identifies the contractor requirements by performance objectives that relate directly to mission essential elements from the PWS. The performance threshold describes the minimum acceptable levels of service required for each contractor requirement. These thresholds define minimum acceptance standards critical to mission success. Various methods of surveillance exist to monitor performance; see note 2 below.

7.2 Performance Evaluation. Performance of a service will be evaluated to determine whether or not it meets the performance threshold. Revising and resubmitting the documentation at no cost to the Government is the preferred method for correcting unacceptable performance. The contractor shall provide the Government a written response as to why the performance threshold was not met, how performance will be returned to acceptable levels, and how recurrence of the cause will be prevented in the future.

7.3 Performance Objectives, Indicators, Thresholds, and Surveillance Methods. The services required by the contractor are summarized into performance objectives and indicators, along with the minimum standards that relate directly to mission essential items. The performance threshold briefly describes the minimum acceptable levels of quality or service required for each requirement. These thresholds are critical to mission success.

PERFORMANCE REQUIREMENTS SUMMARY

TASK ORDER ADMINISTRATION

PRS #1. Kickoff Meeting and Monthly Report Contractor shall provide updates on survey operations, as required Para: 5.1.1 --Contract shall conduct a kickoff meeting within 10 days of award --Contractor shall provide a monthly report.

--The first monthly report will include documentation of the kickoff meeting --Contractor shall provide progress updates, as requested by the Government

PRS#2 OPSEC Plan: Contractor shall develop an OPSEC SOP or plan for securing any critical information that may be gathered, stored, or processed during contract performance.

Para: 1.5.7.2.5

DATASET DEVELOPMENT

PRS #3. Develop and Update Sample Database

Contractor shall develop, update, and maintain sample, database in accordance with TO specifications.

Para: 5.2.1

--No breach of PII and sensitive data --All databases are complete, accurate, and regularly updated --Sample database contains disposition and eligibility indicators are in accordance with best practices --Report on sample database is complete and accurate No deviation from standard

Random sampling by COR or designee

PRS #4. Develop Preliminary and Final Quantitative Survey Response Datasets

Para: 5.2.2 --No breach of PII and sensitive data --Datasets will be SPSS datasets --Datasets are complete and accurately represent Government requirements --Datasets contain disposition and eligibility indicators are in accordance with best practices --Datasets completely and accurately reflect respondents’ survey responses and administrative file data.

--The preliminary and final SPSS datasets are clean and contain accurate: variable and value labels, coding of all status indicators (e.g., eligibility and disposition), and created variables --Codebook(s) are complete and accurate

PRS #5. Develop and Document Qualitative Survey Response Datasets

Contractor shall develop databases containing verbatim comments (from web survey) and scanned comments (from paper survey).

Para: 5.2.3

PRS #6. Provide Datasets Documentation/ Codebooks for Datasets

Contractor shall develop documentation for dataset development and a codebook for the preliminary and final quantitative survey response datasets Paras: 5.2.2.4.4

--Dataset documentation accurately describes all response and administrative variables on the databases, coding/coding scheme, variable and value labels, skip patterns, and branching --Documentation of survey operations shall comprehensively describe the methodological approach and its implementation.

PRS #7. Develop Linking File

Contractor will develop a file which links the survey ID number with the sample member’s unique identifier Para 5.2.4 --File contains the survey ID number and sample member unique identifier for all survey respondents --File is password protected and encrypted (if possible) --There will be no breach of data

PRODUCE PRINTED AND ON-LINE SURVEY QUESTIONNAIRES

PRS #8. Prepare Printed Survey Questionnaires and Sample Communications

Contractor shall prepare paper/printed survey questionnaires and sample communications.

Para: 5.4.2 --Paper/printed sample communications and survey questionnaires are printed without error.

--Sample member personalization is accomplished without error

--Random sampling of printed materials by COR or designee

PRS #9. Prepare Web Survey Questionnaire and Sample Communications

Contractor shall prepare web survey questionnaires and sample communications.

Para: 5.4.3 --Active Army web survey and sample communications have no typographical or programming (e.g., branching, skip patterns) errors.

--RC web survey and sample communications have no typographical or programming (e.g., branching, skip patterns) errors.

DATA COLLECTION

PRS #10. Distribute Web Survey and Sample Communications

Contractor shall distribute web survey and sample communications to Active and RC subsamples.

Paras: 5.5.1 and 5.5.2

PRS #11. Distribute Printed Survey and Sample Communications

Contractor shall distribute printed survey and sample communications to the RC subsample.

Para: 5.5.2

PRS #12. Monitor Data Collections

Contractor shall monitor data collection.

Para: 5.5.3

PRS #13. Sample Member Contacts

Contractor shall respond to sample members’ questions, problems, or concerns Para: 5.5.4 Contractor will telephonically or via e-mail address sample members concerns, questions, or difficulties within 72 hours of receipt

TRAINING REQUIREMENTS

PRS #14 CITI training certification: All contractor personnel involved in research involving human subjects shall complete CITI Training.

Para: 1.5.13

PRS#15 AT Level 1 training certification: All contractor employees requiring access to Army installations or facilities shall complete AT Level 1 awareness training.

Para: 1.5.7.2.4

PRS#16 iWATCH Training: All contractor employees requiring access to Army installations or facilities shall complete iWATCH training.

Para: 1.5.7.2.3

PRS#17 OPSEC training certification: All contractor employees shall complete Level 1 OPSEC training.

Para: 1.5.7.2.6

Note 1. The evaluation ratings are as follows:

a. Very Good - Performance meets contractual requirements and exceeds some to the Government’s benefit. The contractual performance of the task and sub-task being assessed was accomplished with some minor problems for which corrective actions taken by the contractor were effective.

b. Satisfactory - Performance meets contractual requirements. The contractual performance of the task and sub-task contain some minor problems for which corrective actions taken by the contractor appear or were satisfactory.

c. Marginal - Performance does not meet some contractual requirements. The contractual performance of the task and sub-task being assessed reflects a serious problem for which the contractor has not yet identified corrective actions. The contractor’s proposed actions appear only marginally effective or were not fully implemented.

d. Unsatisfactory – Performance does not meet most contractual requirements and recovery is not likely in a timely manner. The contractual performance of the task or sub-task contains a serious problem(s) for which the contractor’s corrective actions appear or were ineffective.

Note 2. Surveillance methods

The COR must use at least 1 of the surveillance methods listed above in the administration of this QASP.

a. PLANNED - DIRECT OBSERVATION. (Can be performed periodically or through 100% surveillance.)

b. PERIODIC INSPECTION. (Uses a comprehensive evaluation of selected outputs. Inspections may be scheduled [Daily, Weekly, Monthly, Quarterly, or annually] or unscheduled, as required.)

c. PERIODIC SAMPLING. (Variation of random sampling. However, sample is only taken when a deficiency is suspected. Good follow-up to MIS analysis. Sample results are applicable only for the specific work inspected. Since sample is not entirely random, it cannot be applied to total activity performance.)

d. RANDOM SAMPLING. (Designed to evaluate the outputs of the award requirement by randomly selecting and inspecting a statistically significant sample. Highly recommended for large quantity repetitive activities with objective and measurable quality attributes.)

e. USER SURVEY. (Combines elements of validated user complaints and random sampling. Random survey is conducted to solicit user satisfaction. Appropriate for high quantity activities that have historically been satisfactory. May also generate periodic and 100% inspections.)

f. VALIDATED USER/CUSTOMER COMPLAINTS. (Relies on the user of the service to identify deficiencies. Complaints are then investigated and validated. Highly applicable to services provided in quantity and where quality is highly subjective.)

g. 100% INSPECTION. (Evaluates all outputs. Most applicable to small quantity, but highly important services. May be used where there are written deliverables and stringent requirements such as tasks required by law, safety, or security.)