DRAFT PWS _22 Mar 2021.pdf

DRAFT_PERFORMANCE WORK STATEMENT (PWS)

DRAFT PERFORMANCE WORK STATEMENT (PWS)

Manpower Personnel Testing Analysis

Support Services

In Support of:

Defense Human Resources Activity (DHRA) Office of People Analytics (OPA)

Defense Personnel Assessment Center (DPAC)

GSA Client Order ID (COI): ID09210002

ID09210002 – Manpower Personnel Testing and Analysis (MPTA) Support Services

TABLE OF CONTENTS

D.1 Performance Work Statement 5

D.1.1 Background 5

D.1.1.1 DPAC Background 5

D.1.1.2 Objective 6

D.1.1.3 Performance Requirements 6

D.1.1.4 Place of Performance 7

D.1.1.5 Hours of Operation 7

D.1.1.6 Government Holidays 7

D.1.1.7 Period of Performance 7

D.1.1.8 Payment for Authorized Work 8

D.1.2 Performance Based Scope of Tasks 8

D.1.3 Task 1 – Program Management Support 9

D.1.3.1 Subtask 1 - Coordinate a Project Kick - Off Meeting / Post Award

Conference

D.1.3.2 Subtask 2 – Prepare A Monthly Status Report (MSR) 9

D.1.3.3 Subtask 3 – Convene Senior Management Review (SMR) Meetings 10

D.1.3.4 Subtask 4 - Prepare a Project Management Plan (PMP) 10

D.1.3.5 Subtask 5 - Quality Control Plan (QCP) 11

D.1.3.6 Subtask 6 - Update Quality Control Plan (QCP) 11

D.1.3.7 Subtask 7 – Prepare Trip Reports 11

D.1.3.8 Subtask 8 – Staffing Plan 11

D.1.3.9 Subtask 9 – Contract Transition 12

D.1.3.9.1 Phase In 12

D.1.3.9.2 Transition 12

D.1.3.9.3 Transition Plan 12

D.1.3.9.4 Phase-In Activities 12

D.1.3.9.5 Phase-Out Activities 13

D.1.4 Task 2 – Conduct Psychometric Analyses Of Selection, Classification, and Proficiency Tests And Career Exploration Instruments

D.1.5 Task 3 - Develop Test Items for Military Aptitude and Proficiency Tests 13

D.1.6 Task 4 - Develop Test Forms and Survey Instruments for Use in Selection, Proficiency, and Classification Tests and Surveys

D.1.7 Task 5 - Evaluate Test Security 14

D.1.8 Task 6 - Administer Psychological Measurement Instruments 14

D.1.9 Task 7 - Evaluate Characteristics of the Armed Forces 14

D.1.10 Task 8 – Conduct Research on New Types of Test Items, Constructs, and

Selection and Classification and Proficiency Instruments and Methodologies

D.1.11 Task 9 - Provide IT Support For Research Efforts 15

D.1.12 Task 10 - Conduct Analysis and Studies of Geographic and Demographic

Data Files

D.1.13 Task 11 - Support the Defense Personnel Assessment Center's Windows-

Based, Web-Based, and Cloud-Based CAT-ASVAB Systems and Language Testing

Systems

D.1.14 Task 12 - Develop and Evaluate Recruiting-Related Initiatives 16

D.1.15 Task 13 - Research Other Selection and Classification and Accession Policy

Issues

D.1.16 Deliverables 16

D.1.16.2 Deliverable Media 18

D.1.16.3 Deliverable Reporting Requirements 18

D.1.16.4 Notification Regarding Late Delivery / Problem Notification

Reporting

D.1.17 Employment of Department of Defense (DoD) Personnel Restricted 19

D.1.18 Training 19

D.1.19 Key Personnel 20

D.1.19.1 Key Personnel Designation 20

D.1.20 Use of Human Subjects 21

D.1.21 Contractor Facilities 24

D.1.22 Government Furnished Property / Information 24

D.1.22.1 Responsibility of Government Information 24

D.1.22.2 Government Furnished Software 25

D.1.22.3 Contractor Use of Government Equipment 24

D.1.23 DoD Information on Non-DoD Information Systems 25

D.1.24 General Purpose Office Equipment and Information Technology Costs 27

D.1.25 Security 27

D.1.25.4 National Agency Check and Inquiries (NACI) 28

D.1.25.5 Trustworthiness Determination and Security Clearances 28

D.1.25.6 IT Security Compliance 29

D.1.25.7 Disclosure of Information 29

D.1.25.8 Federal Bureau of Investigation (FBI) CJIS 30

D.1.25.9 Denial of Entry 31

D.1.26 Organizational Conflict of Interest 31

D.1.27 Joint Ethics Regulation 33

D.1.28 No-Cost Settlement 33

D.1.29 Contractor Personnel Administration 34

D.1.29.2Non-Supervision of Contractor Employees on Government Facilities 34

D.1.30 Interrelationships of Contractors 34

D.1.31 Ethics and Conduct 35

D.1.32 Government Furloughs 35

D.1.33 Confidentiality of Information 35

D.1.34 Restrictions 36

D.1.35 Service Contract Reporting 36

D.1.36 Contractor Performance Assessment Reporting System (CPARS) 36

D.1.37 Records Management 37

D.1.38 Roles and Responsibilities 37

D.1.39 Quality Assurance Surveillance Plan (QASP) 38

D.1.40 Performance Requirements Summary Matrix 39

D.1.41 508 Compliance 40

D.1.42 Invoicing 40

D.1.43 Performance Work Statement Attachments 41

D.1 MANPOWER PERSONNEL TESTING ANALYSIS (MPTA) SUPPORT SERVICES

PERFORMANCE WORK STATEMENT (PWS)

D.1.1 BACKGROUND

The Office of People Analytics (OPA) is part of a Department of Defense (DoD) Field Activity called the Defense Human Resources Activity (DHRA) which supports major programs and initiatives within the DoD. OPA is the DoD’s premier center for excellence providing information on the total force, families, and veterans through the collection of data and analytical research. OPA is designated to serve in direct analytic support to the Military Services and the Office of the Secretary of Defense (OSD) to conduct comprehensive analysis on how policy or environmental changes will affect the performance or composition of the workforce. Through analysis, OPA is prepared to inform on questions pertaining to recruiting, hiring and retention, succession planning, training, and increased talent-based assignment matching throughout the Department. Data will be used to support a wide spectrum of studies, analyses, policy objectives, research projects, reporting requirements, and the development of enterprise technology solutions for the Department. These activities support primarily OSD, but major support is also provided to the Military Departments, DoD Agencies, OMB, the Congress, the Congressional Budget Office, other Federal Agencies (including DoL, VA, DoED, DHS, HHS, Commerce, OPM), DoD contractors, private research organizations, universities, financial industry, and the general public. OPA is currently organized around four related functions: (1) Recruitment – performed by the Joint Advertising Market Research & Studies (JAMRS) program, (2) Personnel Security – performed by the Personnel & Security Research Center (PERSEREC), (3) Retention and Readiness – investigated by the Research, Surveys, & Statistics Center (RSSC), and (4) Testing and Assessment – performed by the Defense Personnel Assessment Center (DPAC). This contract will provide primary support for the Defense Personnel Assessment Center (DPAC).

D.1.1.1 DEFENSE PERSONNEL ASSESSMENT CENTER (DPAC) BACKGROUND

The DPAC is responsible for the research, development and evaluation of the Armed Services Vocational Aptitude Battery (ASVAB) and the online test delivery of the ASVAB and associated accession and job classification tests, including all DoD language tests. The ASVAB is the single aptitude battery given to all applicants for the U.S. Armed Forces and is used by the Services to determine qualification for enlistment and entry into military specialties. OPA is charged with research and development, in support of two Department of Defense (DoD) testing programs, and for the development and fielding of the ASVAB. The two DoD programs are the Enlisted Testing Program (ETP) and the Career Exploration Program (CEP). The ASVAB is administered in two modes. In the ETP, an adaptive version called the Computerized Adaptive Testing (CAT) version of the ASVAB (CAT-ASVAB) is used in most all locations, while the Paper-and-Pencil ASVAB (P&P- ASVAB) is utilized in a small number of locations. In the CEP, the primary mode of administration is currently P&P-ASVAB with CAT-ASVAB being administered in a small number of high schools. Eventual elimination of P&P-ASVAB is a goal of the program.

D.1.1.1.2 The CAT-ASVAB is currently being administered to applicants that process through the Military Entrance Processing Stations (MEPS) and though nearly all Military Entrance Testing (MET) Sites. About 95+% of all applicants take the CAT-ASVAB. The P&P ASVAB is administered in some remote Military Entrance Testing (MET) Sites to about 1% of military applicants. DPAC is currently responsible for development and sustainment of two versions of the CAT-ASVAB: a Windows based system (called WinCAT) which runs primarily in the MEPS and an internet version (called iCAT) which is administered at MET sites and other remote locations. There are plans for WinCAT to be phased out and replaced by iCAT at all test sites, and for iCAT delivery to be transitioned to a cloud platform.

D.1.1.1.3 It is anticipated that this contract will provide support in the form of manpower and equipment in DPAC’s CAT Laboratory (called the CAT Lab). Support for the CAT Lab is a vital function of this contract since it provides needed resources and manpower for developing operational requirements and programs and troubleshooting systems issues with the CAT- ASVAB system in the operational environment.

D.1.1.1.4 Supporting the ASVAB program also requires a substantial amount of research and development in the area of selection and classification and career exploration. This is necessary in order to maintain the most efficient selection and classification procedures. This contract will provide support for all ASVAB research and development efforts.

D.1.1.1.5 In addition to ASVAB, the DPAC is responsible for delivery of associated accession and job classification tests administered via the CAT-ASVAB platform. The DPAC is also responsible for delivery and select psychometric research for computer-based versions of DoD’s language tests. These tests currently consist of the Defense Language Proficiency Tests (DLPT), the English Comprehension Level (ECL) tests, and the Defense Language Aptitude Battery (DLAB). This contract will provide support for all tests under OPA’s responsibility, including the DoD language testing programs.

D.1.1.2 OBJECTIVE

The contractor shall provide scientific, technical, analytic, marketing and IT support services that lead to the development and execution of studies and applications supporting the Enlisted Testing Program (ETP) and Career Exploration Program (CEP) as well as new DoD personnel programs, research and studies of force readiness and personnel policies to support Deputy Assistant Secretary for Readiness and Director of Accession Policy.

D.1.1.3 PERFORMANCE REQUIREMENTS

The contractor shall provide scientific, technical, analytical, marketing, and IT support services on-site and off-site for Manpower Personnel Testing Analysis (MPTA) Support for the Office of People Analytics (OPA). All work shall be performed in accordance with the Performance Work Statement (PWS). In order to maximize the advantage of rapidly changing technologies and leverage new technological breakthroughs, the contractor shall provide research studies, marketing materials, and technical support for OPA’s primary mission in the following areas:

(A) Development of the ASVAB, in all modes of administration

(B) Development of the CEP

(C) Development and computer delivery of language aptitude and language proficiency tests and psychometric technical support for test development

(D) Research and development of ETP and CEP Improvements

(E) Development and maintenance of software and systems for Computer-based Testing (CBT) selection and classification instruments, to include Computerized Adaptive Testing (CAT) systems, across web and cloud platforms

(F) Development and maintenance of websites for program information and marketing materials

(G) Evaluation of armed forces readiness and representation of today’s youth in the armed forces

(H) Development and evaluation of recruiting-related initiatives related to selection and classification of military applicants

D.1.1.4 PLACE OF PERFORMANCE

Place of performance shall be at the contractor’s facility, as well at the Government site in Seaside, CA. Some Information Technology (IT) work, identified in tasks D.1.11 and D.1.13, and some test development work, identified in tasks D.1.3, D.1.5, D.1.6, and D.1.10 may be performed at the Government site, DoD Center, 400 Gigling Road, Seaside, CA 93955-6771.

Most other work will be performed at the contractor’s facility or at field locations.

D.1.1.5 HOURS OF OPERATIONS

The Contractor shall ensure support and coverage between the core hours of 0830-1700 Monday through Friday except Federal holidays or when the Government facility is closed due to local or national emergencies, administrative closings, or similar Government-directed facility closings.

D.1.1.6 GOVERNMENT HOLIDAYS

The following Government holidays are normally observed by Government personnel: New Year’s Day, Martin Luther King’s Birthday, Presidential Inauguration Day (metropolitan DC area only), President’s Day, Memorial Day, Independence Day, Labor Day, Columbus Day, Veteran’s Day, Thanksgiving Day, Christmas Day, any other day designated by Federal Statute, Executive Order, and/or Presidential Proclamation, or any other kind of administrative leave such as acts of God (i.e. hurricanes, snow storms, tornadoes, etc.), Presidential funerals or any other unexpected Government closures.

D.1.1.7 PERIOD OF PERFORMANCE

This will be as stated in the contract.

D.1.1.8 PAYMENT FOR AUTHORIZED WORK

No payments will be made for any unauthorized supplies and/or services or for any unauthorized changes to the work specified herein. This includes any services performed by the Contractor of their own volition or at the request of an individual other than a duly appointed Contracting Officer. Only a duly appointed Contracting Officer is authorized to change the specifications, terms, and conditions under this effort.

D.1.2 PEFORMANCE BASED SCOPE OF TASKS

. The Contractor shall effectively participate in planning and strategy sessions, effectively interact with customers, resolve complaints and problems, and keep management properly informed as to operational issues, problems, future needs, and technological developments. The Contractor shall have experience working with MySQL, Oracle, and Microsoft Access databases, Java, C++, Python, SPSS, SAS, Excel, and Word. They should have experience working with eQIP data, JPASE data, CATS data, and OPM DIF data.

● TASK 1 – PROGRAM MANAGEMENT SUPPORT

● TASK 2 – CONDUCT PSYCHOMETRIC ANALYSES OF SELECTION, CLASSIFICATION, AND

PROFICIENCY TESTS AND CAREER EXPLORATION INSTRUMENTS

● TASK 3 – DEVELOP TEST ITEMS FOR MILITARY APTITUDE AND PROFICIENCY TESTS

● TASK 4 -- DEVELOP TEST FORMS AND SURVEY INSTRUMENTS FOR USE IN SELECTION,

PROFICIENCY, AND CLASSIFICATION TESTS AND SURVEYS

● TASK 5 – EVALUATE TEST SECURITY

● TASK 6 – ADMINISTER PSYCHOLOGICAL MEASUREMENT INSTRUMENTS

● TASK 7 – EVALUATE CHARACTERISTICS OF THE ARMED FORCES

● TASK 8 – CONDUCT RESEARCH ON NEW TYPES OF TEST ITEMS, CONSTRUCTS, AND SELECTION

AND CLASSIFICATION AND PROFICIENCY INSTRUMENTS AND METHODOLOGIES

● TASK 9 – PROVIDE IT SUPPORT FOR RESEARCH EFFORTS

● TASK 10 – CONDUCT ANALYSIS AND STUDIES OF GEOGRAPHIC AND DEMOGRAPHIC

DATA FILES

● TASK 11 – SUPPORT THE DEFENSE PERSONNEL ASSESSMENT CENTER’S WINDOWS-

BASED, WEB-BASED, AND CLOUD-BASED CAT-ASVAB SYSTEMS AND LANGUAGE

TESTING SYSTEMS

● TASK 12 – DEVELOP AND EVALUATE RECRUITING-RELATED INITIATIVES

● TASK 13 – RESEARCH OTHER SELECTION AND CLASSIFICATION AND ACCESSION POLICY

ISSUES

D.1.3 TASK 1 – PROGRAM MANAGEMENT SUPPORT

The contractor shall provide program management and project management support under this Contract. This includes the management and oversight of all activities performed by contractor personnel, including subcontractors, to satisfy the requirements identified in this Performance Work Statement (PWS). The contractor shall identify, by name, a Program Manager (PM), who shall provide management, direction, administration, quality control, and leadership of the execution of this contract. The contractor shall schedule meetings and provide deliverables in accordance with (IAW) Section D.1.16

D.1.3.1 SUBTASK 1 – COORDINATE A PROJECT KICK-OFF MEETING/ POST- AWARD

CONFERENCE

The Contractor PM shall schedule and coordinate a Project Kick-Off Meeting at the location approved by the Government. The meeting will provide an introduction between the Contractor personnel and Government personnel who will be involved with the contract. The meeting will provide the opportunity to discuss technical, management, security issues, and travel authorization and reporting procedures. The purpose of the kick-off meeting is to aid both the Contractor and the Government in achieving a clear and mutual understanding of all contract requirements in the Contract and identify and resolve potential issues (See FAR Subpart 42.5 Post award Orientation). The meeting may be conducted at a location within the local Seaside/Monterey commuting area at the Government’s discretion. At a minimum, the attendees shall include Key Contractor personnel, key stakeholders, other relevant Government personnel, and the GSA Region 9 Contracting Officer (CO) and Project Manager (PM). The Contractor shall provide the following at the Kick-Off meeting:

(1) Kick-Off Meeting PowerPoint Slides

(2) Project Management Plan (PMP) - Which was accepted at the time of award and will be reviewed and discussed at the Kick-Off meeting. The Contractor will submit the Final PMP per the deliverables schedule in D.1.16.1.

(3) Draft Quality Control Plan (QCP) – Which was accepted at the time of award and will be reviewed and discussed at the Kick-Off meeting. The Contractor will submit the Final QCP per the deliverables schedule in D.1.16.1.

D.1.3.2 SUBTASK 2 – PREPARE A MONTHLY STATUS REPORT (MSR)

The Contractor PM shall develop and provide an MSR using Microsoft (MS) Office Suite applications, by the 10th of each month via electronic mail to the GSA PM, Contracting Officer’s Representative (COR) and the CO. The MSR report shall summarize for each contract line item:

Financial Review/Expenses, accomplishments during the period, problems met or anticipated, activities anticipated during the next reporting period, and utilization of personnel. The MSR report will be provided in the format provided as D.1 Attachment 2: Monthly Status Report. The MSR shall include the following:

(1) Activities during reporting period, by task order/ project (include: on-going activities, new activities, activities completed; progress to date on all above mentioned activities). Start each section with a brief description of the task.

(2) Problems and corrective actions taken. Also include issues or concerns and proposed resolutions to address them.

(3) Personnel gains, losses, and status (security clearance, etc.).

(4) Government actions required.

(5) Schedule (show major tasks, milestones, and deliverables; planned and actual start and completion dates for each).

(6) Summary of trips taken, conferences attended, etc. (attach trip reports to the MSR for the relevant reporting period).

(7) Accumulated invoiced cost for each CLIN up to the previous month.

(8) Projected cost of each CLIN for the current month.

(9) Badging roster or updates per PWS D.1.25.5.4.

D.1.3.3 SUBTASK 3 – CONVENE SENIOR MANAGEMENT REVIEW (SMR)

MEETINGS

The Contractor PM shall convene a monthly Senior Management Review and contract activity meeting with the COR, and other vital Government stakeholders. The purpose of this meeting is to ensure all stakeholders are informed of the monthly activities and MSR, provide opportunities to identify other activities and establish priorities, and coordinate resolution of identified problems or opportunities. The Contractor PM shall provide minutes of these meetings, including attendance, issues discussed, decisions made, and action items assigned, to the COR following the meeting. The monthly SMR report shall summarize for each contract line item: Financial Review/Expenses, accomplishments during the period, problems met or anticipated, activities anticipated during the next reporting period, and utilization of personnel.

D.1.3.4 SUBTASK 4 – PREPARE A PROJECT MANAGEMENT PLAN (PMP)

The Contractor shall document all support requirements in a PMP. The PMP shall:

(1) Describe the proposed management approach.

(2) Contain detailed Standard Operating Procedures (SOPs) for all tasks/projects.

(3) Include milestones, tasks, subtasks and projects required by this contractor.

(4) Provide for an overall Work Breakdown Structure (WBS) and associated responsibilities and partnerships between Government organizations.

D.1.3.4.1 The Contractor shall provide the Government with a Draft PMP at time of proposal, upon which the Government will accept the PMP virtue of contract award and provide comments at the kick-off meeting.

D.1.3.4.2 The final PMP shall incorporate the Government’s comments within timeframe specified in D.1.16. The PMP is an evolutionary document that shall be updated annually at a minimum. The Contractor shall work from the latest Government-accepted version of the PMP at time of award.

D.1.3.5 SUBTASK 5 – QUALITY CONTROL PLAN (QCP)

The contractor shall provide a detailed draft (QCP) that is applicable to the contract and in consideration of all requirements. The QCP should detail how the contractor intends to monitor, inspect and correct deficiencies for the requirements of the PWS. At a minimum, the plan shall provide its methodologies to be utilized in achieving the Government’s objective within acceptable levels of quality as outlined in the Performance Requirements Summary (PRS) (D.1.40).

The plan should address:

(1) Type, level and frequency of Contractor’s Quality Control actions, including remediation, if necessary.

(2) Inspection checklists and records

(3) Deficiencies reported to COR

(4) Reports

(5) Meetings

D.1.3.6 SUBTASK 6 – UPDATE QUALITY CONTROL PLAN (QCP)

The Contractor shall update the QCP submitted with their proposal and provide a final QCP as specified in

D.1.16 The Contractor shall periodically update the QCP, as specified in D.1.16, as changes in program processes are identified.

D.1.3.7 SUBTASK 7 – PREPARE TRIP REPORTS

The Government will identify the need for a Trip Report when the request for travel is submitted. The contractor shall keep a summary of all long-distance travel including, but not limited to, the name of the employee, location of travel, duration of trip, and point of contact (POC) at travel location. If a Trip Authorization requirement is identified by the Government, the contractor shall provide a Travel Authorization Request (PWS Attachment 5) within five days after trip completion.

D.1.3.8 SUBTASK 8 – STAFFING PLAN

The Contractor shall submit a Staffing Plan that describes the understanding and requirements and details the number of personnel by skill level/ labor category needed to satisfy the objectives and requirements of the contract and demonstrates that it will possess available staff with the requisite education/experience/skills to successfully perform the contract requirements. The Staffing plan must provide at a minimum:

(1) A detailed discussion of the methods and approach that will be taken to acquire and/or retain skilled staff that will meet or exceed the contract requirements.

(2) A discussion of the offerors approach to effectively communicate and coordinate with the

Government.

D.1.3.9 SUBTASK 9 – CONTRACT TRANSITION

D.1.3.9.1 PHASE IN

To minimize any decreases in productivity and to prevent possible negative impacts on additional services, the Contractor must have a transition plan per section D.1.3.9.3 that will ensure requirements will continue with minimal disruption to the OPA. During the phase in period, the Contractor must become familiar with performance requirements in order to commence full performance of services on the contract start date. Submit requests for physical and network access at performance locations. The Contractor must provide to OPA information on all transition tasks. Establish procedures with the predecessor to ensure transition of provided services without any degradation of service.

D.1.3.9.2 TRANSITION:

Contract award is planned to be made before transition. The Contractor must begin the process of transitioning personnel in coordination with the Contracting Officer’s Representative (COR) and user organizations immediately following completion of all security requirements. Contractor shall be required to adhere to OPA’s Contractor in/out processing requirements, section D.1.3.9.4 and D.1.3.9.5. Full Contractor performance begins upon completion of all transition activities with incumbent for up to one hundred eighty (180) days of contract award. Task Orders may specify a more specific transition period. The Contractor must complete the transition of its workforce within one hundred eighty (180) days of contract award.

D.1.3.9.3 TRANSITION PLAN

The Contractor must provide a detailed transition plan with associated timelines for tasks that addresses both phase-in and phase-out for the contract. This plan must be submitted with the Contractor’s proposal and should be updated as required.

D.1.3.9.4 PHASE-IN ACTIVITIES

The Contractor must include in its transition plan and perform, at a minimum, the following activities during the phase-in period:

(1) Submit requests for physical and network access at performance locations

(2) The Contractor must provide to OPA information on all transition tasks.

(3) Establish procedures with the predecessor to ensure transition of provided services without any degradation of service.

(4) The contractor shall identify how it will coordinate with the incoming contractor and/or Government personnel to transfer knowledge regarding the following:

(a) Project management processes.

(b) Points of contact.

(c) Location of technical and project management documentation.

(d) Status of ongoing technical initiatives.

(e) Appropriate contractor–to-contractor coordination to ensure a seamless transition.

(f) Schedules and milestones.

(g) Actions required of the Government.

(h) The contractor shall also establish and maintain effective communication with the incoming contractor/Government personnel for the period of the transition via weekly status meetings

D.1.3.9.5 PHASE-OUT ACTIVITIES

The Contractor must include in its transition plan and perform, at a minimum, the following activities during the phase-out period:

(1) Ensure all services and performance objectives required by the PWS and contract are met throughout the phase-out period.

(2) The Contractor must provide to OPA information on all transition tasks.

(3) Establish procedures with the successor to ensure transition of provided services without a degradation of service.

(4) Provide copies of all instructions, records, databases, contract performance metric data, vendor points of contact, and all other procedures developed by the Contractor or in the performance of this contract to the successor.

D.1.4 TASK 2 – CONDUCT PSYCHOMETRIC ANALYSES OF SELECTION,

CLASSIFICATION, AND PROFICIENCY TESTS AND CAREER EXPLORATION INSTRUMENTS

Evaluate issues and instruments in the realms of selection and classification and career exploration. Perform analyses of cognitive and non-cognitive measures; conduct statistical modeling using Item Response Theory (IRT) methods, or other mathematical modeling techniques. Perform analyses of test and item scores and compute item level statistics. These analyses could include factor analyses of test scores, structural equation modeling, advanced applications of IRT, machine learning, and other multivariate techniques. Develop criterion measures such as job samples or knowledge, skills, and abilities (KSAs), or using other modern approaches to criterion measurement. Examine test validity utilizing approaches such as validity framework, validity argument, theory of action, or other modern approaches.

D.1.5 TASK 3 – DEVELOP TEST ITEMS FOR MILITARY APTITUDE AND PROFICIENCY

TESTS

Subject Matter Experts and Item Writers/Editors will write and edit test items and accompanying graphics for military aptitude and proficiency tests. Conduct content and sensitivity reviews and provide item development reference material and equipment as needed. Item development will include coordinating with test developers on pool and form development, writing or editing of test specifications, and reviewing and implementing new item development procedures, as required.

D.1.6 TASK 4 -- DEVELOP TEST FORMS AND SURVEY INSTRUMENTS FOR USE IN

SELECTION, PROFICIENCY, AND CLASSIFICATION TESTS AND SURVEYS

Develop item pools, test forms, interest inventories, surveys, and other types of psychological measurement instruments, as needed to evaluate testing program issues and meet accession goals. As necessary, scan paper answer sheets and build analysis databases. Provide test development reference material and equipment as needed. Conduct content and sensitivity reviews of test items in accordance with professional testing standards. Develop and revise test specifications and test development procedures.

D.1.7 TASK 5 – EVALUATE TEST SECURITY

Develop, evaluate, and implement procedures for detecting test compromise. This will include statistical procedures as well as procedures to use during site observations and web patrols for content.

D.1.8 TASK 6– ADMINISTER PSYCHOLOGICAL MEASUREMENT INSTRUMENTS

Set up test sites, either computer-based or paper-and-pencil, train test administrators, administer tests or surveys, and build the necessary analysis files. This includes obtaining Office of Management and Budget (OMB) and Human Subject Protection Program (HSPP) approvals, as necessary, scanning of paper answer sheets, processing of computer-based item level data, developing user guides, test administration instructions, and other training documents, and developing on-line training systems.

D.1.9 TASK 7 – EVALUATE CHARACTERISTICS OF THE ARMED FORCES

Gather data, conduct analyses, and document results of evaluations of characteristics of the Armed Forces. This includes developing population representation reports, evaluating capabilities of the all-volunteer force, and evaluating other aspects of military force readiness.

D.1.10 TASK 8 – CONDUCT RESEARCH ON NEW TYPES OF TEST ITEMS, CONSTRUCTS, AND

SELECTION AND CLASSIFICATION AND PROFICIENCY INSTRUMENTS AND METHODOLOGIES

Evaluate new types of test items, constructs, and selection, classification, proficiency and career exploration instruments. Design and conduct research studies or focus groups to evaluate the new item types, constructs, instruments, and methodologies. Develop criterion measures such as job samples or knowledge, skills, and abilities (KSAs), or using other modern approaches to criterion measurement. Examine test validity utilizing approaches such as validity framework, validity argument, theory of action, or other modern approaches. Work with stakeholder groups to implement promising new approaches operationally into the ETP and CEP. Research and evaluation will address both cognitive and non-cognitive measures.

Testing methodologies will include unidimensional and multidimensional IRT and span both adaptive and conventional testing. Other automated instruments will be developed to research the feasibility of leveraging social media for prioritizing recruiting leads, finding additional recruiting leads, and potentially assisting the military enlistment selection process

D.1.11 TASK 9 – PROVIDE IT SUPPORT FOR RESEARCH EFFORTS

Provide programming and technical support for research projects that involve collecting computer-based testing data. This includes developing computer programs using C++, Java, and other such computer languages. Programming will include documentation of both computer-based conventional testing systems and computerized adaptive testing systems.

Work also involves conducting analysis of software system performance and performing troubleshooting of software and hardware systems, providing general troubleshooting for issues that arise as part of the development and data collection efforts, conducting Quality Assurance (QA) software testing on the computer-based testing systems, and providing procedural documentation, including user’s guides, software installation procedures, and other such documents. Provide psychometric quality assurance for checking item selection and scoring of adaptive and conventional computer administered tests.

D.1.12 TASK 10 – CONDUCT ANALYSIS AND STUDIES OF GEOGRAPHIC AND

DEMOGRAPHIC DATA FILES

Conduct analyses and studies of the OPA data files containing geographic and demographic data. The files include the Recruit Market Network and Relocations systems files and other data fields of military units and installations as well as if the civilian work force and other geopolitical entities.

D.1.13 TASK 11 – SUPPORT THE DEFENSE PERSONNEL ASSESSMENT CENTER’S

WINDOWS-BASED, WEB-BASED, and CLOUD-BASED CAT-ASVAB SYSTEMS AND LANGUAGE

TESTING SYSTEMS

Provide architectural, programming, and technical support for the Computer-based testing operational activities. This involves developing and maintaining computer programs and websites using C++, Java, and other such computer languages. Primary programming efforts will support the CAT-ASVAB, other accession and job classification tests administered via the CAT-ASVAB platform, and language testing delivery systems, for Windows versions, web-based versions, and cloud-based versions, along with the CEP. Programming must be performed in accordance with Government guidelines and security requirements. Programming will include documentation of both computer-based conventional testing systems and computerized adaptive testing systems. Programming includes development of web applications for the purpose of dissemination of official selection and classification information.

D.1.13.1 Other computer technical support includes system support to field testing locations, HQ United States Military Entrance Processing Command (USMEPCOM), and Defense Language Institute Foreign Language Center (DLIFLC), in addition to the CAT Lab. This involves supporting maintenance of the certification and accreditation process, resolving equipment problems within the CAT Lab, procuring equipment to resolve CAT Lab problems, conducting analysis of software system performance and performing troubleshooting of software systems and equipment hardware, providing general troubleshooting for issues that arise for the ASVAB and language testing systems, including network troubleshooting.

Technical support also includes providing Configuration Management (CM) procedures and conducting Quality Assurance (QA) software testing on computer-based testing systems, providing computer programs and utilities to support the operations of the CAT Lab and the field-testing locations, providing procedural documentation, including user’s guides, software installation procedures, and other such documents, and providing technical support for development of learning management systems focused on training test administrators.

D.1.13.2. Other computer technical support includes moving existing internet based testing systems to a cloud architecture. This support involves setting up and sustaining cloud-related services for new and existing testing systems and software to a secure DoD compliant cloud delivery platform.

D.1.14 TASK 12 – DEVELOP AND EVALUATE RECRUITING-RELATED INITIATIVES

Provide research and development on a wide variety of recruiting-related initiatives in the area of selection and classification of military applicants and personnel. Such efforts will include initiatives such as developing English skills in military applicants who appear to be otherwise qualified for military service, researching the use of calculators during ASVAB, researching retest score gains, researching using ASVAB as an alternative to Defense Language Aptitude Battery (DLAB) for entrance into language training. Provide research, development, and maintenance in the area of career exploration for the purpose of generating recruiting leads and exposing participating students to careers in the military Services. Develop and maintain career exploration instruments for the CEP and supporting program materials (to include websites, marketing materials, and publications) for various stakeholders, including students, parents, and counselors. Establish and refine business processes to support administration of the CEP.

D.1.15 TASK 13 – RESEARCH OTHER SELECTION AND CLASSIFICATION AND ACCESSION

POLICY ISSUES

Conduct research, development, and evaluation of contemporary manpower and personnel issues facing the United States and the NATO Alliance. Evaluate and document the latest developments in strategic military Human Resources (HR) and the HR research community.

D.1.16 DELIVERABLES

The following schedule of milestones will be used by the OPA COR to monitor timely progress under this contract. The following abbreviations are used in this schedule:

NLT: No Later Than

All references to Days: Government Workdays

D.1.16.1 All deliverables and reports shall be submitted to the Contracting Officer’s Representative (COR) and with a courtesy copy to the Contracting Officer (CO) and Project Manager (PM) via e-mail. Deliverables are due the next Government workday if the due date falls on a holiday or weekend. The contractor shall submit the deliverables listed in the following table:

PROJECT DELIVERABLE /

CONTRACT DELIVERABLE

MILESTONE/DELIVERABLE PWS

REFERENCE

PLANNED /COMPLETION DATE

Milestone Project Start (PS) D.1.3.1 At contract award

Milestone Kick-Off Meeting/ Post Award

Conference

D.1.3.1 Within 5 workdays of contract award

Contract Deliverable Kick-Off Meeting Slides D.1.3.1 (1) 1 Day before Kick-off meeting

Contract Deliverable Monthly Status Report D.1.3.2 Monthly (10th calendar day of the next month)

Contract Deliverable Senior Management Review (SMR) D.1.3.3 15th Calendar day of each month

Contract Deliverable Project Management Plan – D.1.3.4;

D.1.3.4.1

Considered draft and accepted at time of contract award.

Contract Deliverable Project Management Plan – Final D.1.3.4.2 10 workdays after receipt of Government comments on accepted Project Management Plan

Contract Deliverable Quality Control Plan (QCP) D.1.3.5 The QCP submitted with the offerors proposal will be accepted by the Government by virtue of the award.

Updates shall be submitted, as necessary, during the life of the contract.

Contract Deliverable Final Quality Control Plan D.1.3.6 10 workdays after receipt of Government comments on accepted Quality Control Plan

Project Deliverable Trip Report D.1.3.7 5 days after Trip Completion

Contract Deliverable Transition Plan D.1.3.9.3 At time of proposal submission

Contract Deliverable Service Contract Reporting (eCMRA Reporting)

D.1.35 NLT 31 October of each calendar year

Project Deliverable Technical Reports D.1.2 To be determined at task order level

Project Deliverable Informal Technical

Information

D.1.2 To be determined at task order level

Project Deliverable Technical Recommendation involving management actions, policies, or procedures.

D.1.2 To be determined at task order level

Project Deliverable Data collection instruments or methodology

D.1.2 To be determined at task order level

Project Deliverable Detailed research, evaluation or data collection design documents

D.1.2 To be determined at task order level

Project Deliverable Briefing and briefing materials D.1.2 To be determined at task order level

Project Deliverable Adjunct lessons learned technical write-ups, reports, or other forms of documentation

D.1.2 To be determined at task order level

Project Deliverable Diagrams; chart exhibits; graphs;

slides, or photographs; or combination of these forms.

D.1.2 To be determined at task order level

Project Deliverable User maintenance manuals for implementation of any models, systems, or other software designed to meet specific requirements of a TO or the contract.

D.1.2 To be determined at task order level

Project Deliverable Empirical databases including file formats, layouts, and other documentation

D.1.2 To be determined at task order level

Project Deliverable All executable and source code developed under this contract

D.1.2 To be determined at task order level

Project Deliverable Documentation necessary for interpreting and maintaining computer programs developed under this contract.

D.1.2 To be determined at task order level

Project Deliverable Problem Notification Report (PNR) D.1.16.4 Per Government Request

Contract Deliverable Key Personnel Designation D.1.19.1 At time of proposal submission

Milestone CPARS D.1.36 Annually (at the Contract Level only)

Contract Deliverable 508 Compliance confirmation D.1.41 At time of proposal submission

Contract Deliverable Disclosure of Information D.1.25.7 At time of proposal submission, and as necessary thereafter.

D.1.16.2 DELIVERABLE MEDIA

The contractor shall provide electronic copies of each deliverable. Electronic copies shall be delivered via email attachment or other media by mutual agreement of the parties. The electronic copies shall be compatible with current MS Office products or other applications as appropriate and mutually agreed to by the parties.

D.1.16.3 DELIVERABLE REPORTING REQUIREMENTS

All applicable deliverables, their required delivery dates, and destination of delivery will be specified under this contract, or otherwise specified by the COR. The schedule for completion of work to be performed under this contract will be delineated under this contract, as applicable. For purposes of delivery, all deliverables shall be made by close of business (COB) 5:00 P.M. local time (Seaside, California) at destination on the date due.

D.1.16.3.1 All deliverables submitted in electronic format shall be free of any known computer viruses or defects. If a virus or defect is found, the deliverable will not be accepted. The replacement file shall be provided within two (2) business days after notification of the presence of a virus.

D.1.16.3.2 Each deliverable shall be accompanied by a cover letter from the Contractor on company letterhead. Multiple deliverables may be delivered with a single cover letter describing the contents of the complete package.

D.1.16.4 NOTIFICATION REGARDING LATE DELIVERY / PROBLEM NOTIFICATION (PNR)

The Contractor shall notify the OPA COR via a Problem Notification Report (PNR), D.1 Attachment 1: Problem Notification Report, as soon as it becomes apparent to the Contractor that a scheduled delivery will be late. The Contractor shall include in the PNR the rationale for late delivery, the expected date for the delivery, and the project impact of the late delivery.

The GSA OPA COR will review the new schedule and provide guidance to the Contractor. Such notification in no way limits any Government contractual rights or remedies including, but not limited to, termination.

D.1.17 EMPLOYMENT OF DEPARTMENT OF DEFENSE (DoD) PERSONNEL RESTRICTED

In performing this contract, the contractor will not use a subcontractor at any tier, as a consultant or employ (on either a full or part-time basis) any active-duty DoD personnel (civilian or military) without the prior written approval of the Contracting Officer. Such approval may be given only in circumstances where it is clear that no laws or DoD, or service instruction, regulations, or policies might possibly be contravened and no appearance of a conflict of interest will result.

D.1.18 TRAINING

The Government will not allow costs, nor reimburse costs associated with the Contractor’s training of Contractor employees in an effort to attain and/or maintain any minimum personnel qualification requirements that may be established for performance of this contract.

Requirement-specific training costs shall be approved in advance by the COR and related to the program as determined by the CO. The Contractor will maintain the professional qualifications and certifications of its personnel through on-going training. Unless specifically authorized by the Contract, the Contractor will not directly bill the Government for any training.

The Contractor shall provide personnel with expertise to successfully perform the aforementioned tasks and maintain a training program to ensure their staff is adequately trained and current on required skills, certifications and qualifications. Personnel shall demonstrate good communication skills and shall be flexible and adaptable in a dynamic environment. The Contractor shall effectively participate in planning and strategy sessions, effectively interact with customers, resolve complaints and problems, and keep management properly informed as to operational issues, problems, future needs, and technological developments.

The Contractor shall have experience working with Oracle and Microsoft Access databases, Python, SPSS, SAS, Excel, and Word. They should have experience working with eQIP data, JPASE data, CATS data, and OPM DIF data.

D.1.18.1 The Government will not pay training costs for replacement personnel or for the purpose of keeping Contractor personnel abreast of advances in the State of the art or for training of Contractor personnel on equipment, computer languages, and computer operating systems that are available on the commercial market. The Contractor will have full responsibility for keeping Contractor personnel abreast of advances in the State of the Art.

D.1.19 KEY PERSONNEL

The following are the minimum personnel who shall be designated as “Key.” The Government does not intend to dictate the composition of the ideal team to perform this contract.

Therefore, the Government encourages and will evaluate additional Key Personnel as proposed by the offeror. The overall contract requires a Project Manager be available throughout the order to assume responsibility for overall contract performance, individual project performance, and deliverables, communication between the contractor and the Government as well as all subcontractors that are part of the contractor’s team supporting the Government. The Contractor shall:

(1) Assign to this contract those key personnel listed in table below. No substitutions shall be made except in accordance with the terms below.

(2) Agree that during the first 12 months of the contract performance period no key personnel substitutions will be permitted unless such substitutions are necessitated by an individual's sudden illness, death, or termination of employment. In any of these events, the Contractor shall promptly notify the COR and Contracting Officer and provide the information required by paragraph (3) below. After the initial 12 month period, all proposed substitutions must be submitted in writing, at least 15 calendar days (30 days if a security clearance is to be obtained) in advance of the proposed substitutions to the COR and Contracting Officer. These substitution requests shall provide the information required below.

(3) Requests for approval of substitutions under this PWS must be in writing and provide a detailed explanation of the circumstances necessitating the proposed substitutions. They must contain a complete resume for the proposed substitute or addition, and any other information requested by the Government to approve or disapprove the proposed substitutions. The Government reserves the right to meet all proposed substitutions to ensure they meet qualifications for the proposed position.

D.1.19.1 KEY PERSONNEL DESIGNATION

For the purpose of the overall performance of this effort, the following Contractor Personnel shall be designated as key persons:

(1) Expert Contributor (Behavioral)

(2) Task Leader/Senior Contributor (Behavioral)

(3) Mid-Range Technical Contributor (Behavioral)

(4) Junior Technical Contributor (Behavioral)

(5) Expert Contributor (Analytic)

(6) Task Leader/Senior Contributor (Analytic)

(7) Mid-Range Technical Contributor (Analytic)

(8) Junior Technical Contributor (Analytic)

(9) Task Leader/Senior Contributor (Data Collection Operations)

(10) Senior Technical Editor

(11) Programmer / Analyst

The Government desires that Key Personnel be assigned for the duration of the contract. The Contractor shall be responsible for managing and overseeing the activities of all Contractor personnel, as well as subcontractor efforts used in performance of this effort. The Contractor's management responsibilities shall include all activities necessary to ensure the accomplishment of timely and effective support performed in accordance with the requirements contained in the performance works statement

D.1.19.1.1 The Contractor shall submit resumes for employees designated as “Key Personnel” and shall contain documented experience directly applicable to the functions to be performed.

Further, these prior work experiences shall be specific and of sufficient variety and duration that the employee is able to effectively and efficiently perform the functions assigned. The Government expects the key person identified in the offeror’s quote to meet or exceed the education and experience identified for the labor category. See D.1 Attachment 3: Key Personnel Requirements Summary document for additional information regarding Key Personnel Qualifications.

D.1.20 USE OF HUMAN SUBJECTS

The following are used in this clause:

(1) Definition.

(a) Risk: For the purpose of these regulations, unusual and potentially hazardous conditions are those which may be reasonably expected to involve the risk, beyond the normal call of duty, or privation, discomfort, distress, pain, damage to health, bodily harm, physical injury, or death.

(b) Exemptions: The following categories of activities and investigative programs are exempt from the provisions of these regulations:

i. Research and non-research programs, tasks and tests which may involve inherent occupational hazards to health or exposure of personal to potentially hazardous situation encountered as part of training or other normal duties, e.g.; flight training, jump training, marksmanship training, ranger training, fire drills, gas drills, and handling of explosives.

ii. That portion of human factors research which involves normal training or other military duties as part of an experiment, wherein disclosure of experimental conditions to participating personnel would reveal the special nature of such conditions and defeat the purpose of the investigation.

(c) Human subject. Human subjects are those volunteer participants in an effort, the whole or…