RFP Attachment 5 - Sample Task Order A PWS.pdf

SAMPLE TASK ORDER A PWS - RFP 47QFPA21R0010 Attachment 5

General Services Administration (GSA) Federal Acquisition Service (FAS)

Assisted Acquisition Services (AAS) Region 9

MPTA SAMPLE TASK ORDER A

PERFORMANCE WORK STATEMENT

1.0 TITLE

Technical CAT-ASVAB Support – Routine Maintenance.

2.0 BACKGROUND

The Office of People Analytics (OPA) is responsible for the development and maintenance of several computer-based testing systems used by the Department of Defense (DoD). The Armed Services Vocational Aptitude Battery (ASVAB) is a multiple aptitude test battery used by all military Services to select and classify military applicants. Until 1990, the ASVAB was administered as a traditional, paper-and-pencil test. At that time a new method of ASVAB administration was introduced at several Military Entrance Processing Stations (MEPS) -- Computerized Adaptive Testing (CAT).

CAT-ASVAB is now operational at all MEPS and some Military Entrance Testing Sites (METS). The CAT-ASVAB is the largest of these computer-based testing systems. CAT- ASVAB is now available on two different platforms: a local area network (LAN) / Windows-based platform, called WinCAT, and an Internet-based platform, called iCAT.

WinCAT is operational at all Military Entrance Processing Stations (MEPS) and some Military Entrance Testing (MET) sites, but is scheduled to be decommissioned by the end of 2020 or early 2021. All testing will transition to the iCAT platform. The iCAT platform is currently available at many MEPS and MET sites, and also is being evaluated for use in high schools.

In addition to the computer-based testing systems described above, other tests are being computer-administered, as implementation of CAT-ASVAB has demonstrated the efficiency of computer-based testing. For this reason, DoD is exploring ways to expand the use of computer-based testing, not only for CAT-ASVAB but for language testing as well. For CAT-ASVAB, the expansion is focused on expanding the use of CAT-ASVAB by moving to other platforms, such as the Internet, or other locations such as existing Service computer-based training facilities. In the area of language testing, expansion of computer-based testing focuses mainly on the Defense Language Aptitude Battery

Assisted Acquisition Services (AAS) Region 9

(DLAB), with development of new test forms and development of a DLAB screening test, along with development of a Computerized Adaptive Testing version of the English Comprehension Level (CAT-ECL) test. The Defense Language Aptitude Battery (DLAB) is used to test both military applicants and military personnel and is used to determine ability to learn a new language. As of July 2007, a computer-based DLAB is being given at MEPS to military applicants. A web version of this test is given to military personnel interested in language training. New cognitive and non-cognitive measures are being developed for computer administration and are currently being administered on the WinCAT platform. In-Service tests, such as the Armed Forces Classification Test (AFCT), have been converted to iCAT Web administration.

3.0 SCOPE

The objective of this effort is to perform routine maintenance of the OPA’s computer-based testing systems, including cognitive, non-cognitive, and proficiency tests, in particular those related to CAT-ASVAB. This includes computer system configuration, maintaining current systems, such as implementing software changes, acceptance testing of new software versions, review and editing of new CAT-ASVAB test items, development of documents, evaluating various computer platforms and computer networks, evaluating and setting up various computer system configurations, testing various aspects of the system, developing and modifying systems, as necessary, and providing support to the users. The focus of this effort is on the routine maintenance and sustainment of operational testing systems.

4.0 REQUIREMENTS

4.1 WinCAT Platform Support. The contractor shall provide technical support for maintaining the Windows-based CAT-ASVAB (WinCAT) Test Delivery System.

This includes modifications required for changing operational requirements, including changes in operating systems and computer hardware and software.

During the course of this task order, such changes will include modifying WinCAT user interfaces and evaluating procedures for formatting test items, equations, and graphics. It also includes providing troubleshooting support and other technical support to WinCAT test sites.

4.2 Test Driver. The contractor shall provide technical support for the Test Driver program used for delivering CAT-ASVAB, DLAB, Web-based tests, and Special Tests on the WinCAT Platform. Modifications to the Test Driver will primarily focus on changes required from the field to make the Test Driver more user-friendly and configurable by the Authorized personnel.

4.3 CAT-ASVAB Web-based Testing. The contractor shall modify ASVAB-related websites, as needed. These sites include the Internet-based CAT-ASVAB (iCAT), the iCAT Authorization and Reporting, the Manpower Accession Policy Working Group (MAPWG) site on DODHRA SharePoint, the Official ASVAB site, and any supporting web applications. The iCAT A&R shall be modified to incorporate authorization and reporting for the Career Exploration Program (CEP), including transfer of data to USMEPCOM (as well as continued maintenance of transfer of data for the Examinee Testing Program (ETP)) and to incorporate requirements from the testing locations. The iCAT A&R shall also be modified to accommodate the AFQT Predictor Test (APT), PiCAT, and the ASVAB Verification Test (VTEST) reporting requirements.

4.4 Configuration Technical Support. The contractor shall provide technical support for modifying/maintaining system configurations and network configurations.

This includes applying and documenting Information Assurance (IA) security requirements. The contractor shall provide support in evaluating new systems and networking tools and equipment. The contractor shall provide support in troubleshooting system problems at field sites. The contractor shall maintain the Windows Private Desktop (WPDT), based on the IA security requirements and in accordance with the Defense Information Systems Agency (DISA) Enterprise Mission Assurance Support Service (eMASS).

4.5 Functionality Testing of Computer-based Tests. The contractor shall provide technical support in testing all computer-based tests and software versions to ensure that the software functions as specified. The primary focus of this testing is on failure/recovery, score report printing, session reports, file transfers, and other non-psychometric system functions. Support shall include developing testing plans and developing and using procedures for computer-based testing using commercial tools and best practices in software and system testing.

4.6 Psychometric Acceptance Testing. The contractor shall provide technical support in testing computer-based tests to ensure that the tests are functioning in accordance with psychometric specifications. The primary focus of this testing is accurate item selection and scoring and any other functionality that could affect examinee scores.

4.7 Document Computer-based Tests and Procedures. The contractor shall provide

Assisted Acquisition Services (AAS) Region 9 documentation on all computer programs and tests, including a description of the program structure, input and output variables and files, and instructions for compilation. Documentation of the technical aspects of the test or software, such as hardware specifications and system configuration, is also required.

Documentation shall include User’s Guides, Setup and Installation Procedures, and other documentation required to deploy computer-based test. The contractor shall also submit Functional Specification and Technical Specification documents that follow OPA approved templates.

4.8 Review of ASVAB Test Items. The contractor shall provide editorial support, as well as software tools and other technologies, in support of reviewing ASVAB test items to ensure the test items meet item writing guidelines.

4.9 Support Maintenance of Proctored Internet-based CAT-ASVAB (iCAT) in the

Career Exploration Program (CEP). The contractor shall provide technical support in documenting requirements, preparing manuals, developing software, processing data, providing help desk support, and collecting and evaluating user feedback.

4.10 Support Maintenance of Proctored Internet-based CAT-ASVAB (iCAT) Armed

Forces Classification Testing (AFCT). The contractor shall provide technical support in documenting requirements, preparing manuals, developing software, processing data, providing help desk support, and collecting and evaluating user feedback.

4.11 Support Maintenance of the Prescreen ASVAB. The contractor shall provide technical support in documenting requirements, preparing manuals, developing software, processing data, providing help desk support, and collecting and evaluating user feedback. The Prescreen ASVAB, identified as PiCAT, is a web-based test used as a recruiting tool.

4.12 Support Maintenance of the AFQT Predictor Test (APT). The contractor shall provide technical support in documenting requirements, preparing manuals, developing software, processing data, providing help desk support, and collecting and evaluating user feedback.

4.13 Quality Assurance: The contractor shall conduct the following activities:

4.13.1 Develop test plans/procedures

4.13.2 Document and conduct quality assurance of all system deployment products.

4.13.3 Conduct acceptance testing of WinCAT-based and iCAT aptitude and proficiency testing applications

4.13.4 Develop and use automated testing as available.

4.13.5 Record all acceptance testing and QA results in Jira or other OPA approved products used for this purpose.

4.13.6 Test the web-based production systems during maintenance hours that can be scheduled outside of regular business hours to ensure they are operational, when required, due to changes to the OPA infrastructure.

4.14 User Troubleshooting Support. The contractor shall assist in the following activities:

4.14.1 Provide Tier-2 phone support to LAN-based and web-based testing locations. The Tier-2 support shall be provided 24 hours a day, 7 days a week, throughout the year.

4.14.2 Evaluate and document all problems that occur either at the testing locations or within OPA that affect testing applications.

4.14.3 Replicate system anomalies when required and work with system and software engineers to resolve these anomalies.

4.14.4 Develop troubleshooting guidelines for use at OPA and at testing locations.

4.15 System/Security/Network Administration Duties.

The contractor shall assist in the following activities:

4.15.1 Run security scans and Security Technical Implementation Guide (STIG) compliance manual that will include automated tools against OPA software and computer equipment on LAN and Web-based software products to determine Information Assurance (IA) vulnerabilities.

Assisted Acquisition Services (AAS) Region 9

Documented scan reports shall be stored at OPA designated network resource. The scans shall be done at least weekly and on as needed basis.

4.15.2 Prepare written remediation for each security finding which could not be addressed via a change to the system. Document and explain why a waiver/exception to IA policies is required.

4.15.3 Deploy the Computer-based Testing Systems. Prepare the WinCAT server/workstation baseline and operational discs that are deployed by the Government.

4.15.4 Troubleshoot networking, server, and application problems with the test delivery LAN/web-based applications.

4.15.5 Support OPA efforts in preparation and during FISMA and other Certification and Accreditation activities.

4.16 OPA workspace maintenance. The Government shall require contract personnel to maintain or reconfigure the workspaces and the lab environment within the OPA, Network Operation Center (NOC), and the attached to Office of People Analytics (OPA) or its offices, warehouse, rooms, and facilities. Contract personnel will be required to adhere to DoD regulations on disposing of the E- Waste, paper products, and other materials.

4.17 Contractor Manpower Reporting. If required for this task order after resolution of DFARS case 2018-D063, the contractor shall report contractor labor hours

(including subcontractor labor hours) required for performance of services provided under this contract and associated data via a secure collection method, through www.sam.gov. Reporting inputs will be for the labor executed during the POP during each Government fiscal year (FY), which runs October 1 through

September 30.

Assisted Acquisition Services (AAS) Region 9

5.0 DELIVERABLES and REPORTING REQUIREMENTS

5.1 Monthly Status Reports. The contractor shall document the status of the effort each month.

5.2 Technical Documents. The contractor shall provide written documentation of evaluations and developed procedures, as well as documentation of all computer software.

5.3 Computer Software. The contractor shall provide all software developed under this task order, including source code and executable files.

5.4 System Documentation and Computer Source Code. The contractor shall provide written documentation of all computer programs, to include flow charts of all main and other routines. System documentation shall include electronic versions of computer programs. Computer source code shall be delivered in electronic format.

5.5 Schedule of Deliverables.

Deliverable Due Date

Monthly Progress Report Monthly, starting with the second month after start of delivery order.

Technical Documents As Required.

System Documentation Final documentation is due NLT End of Task Order (EOTO) and will incorporate changes resulting from Government review of the documents. Draft documentation is due on an “as required” basis.

Computer Software Final versions of all software are due NLT EOTO and will incorporate changes resulting from Government review of the software. Draft software is due on an “as required” basis.

6.0 PLACE OF PERFORMANCE.

The place of performance will be at the contractor’s facilities or at OPA, Seaside, Calif., facilities, as required.

7.0 PERIOD OF PERFORMANCE.

The period of performance shall be 12 months

8.0 GOVERNMENT ITEMS AND INFORMATION

The Government will provide access to equipment necessary for computer-based test development, testing, and CAT-ASVAB development. All equipment will remain at the Government location. The contractor will be responsible for providing equipment and materials necessary for evaluating and implementing new procedures. Any materials that the contractor must obtain to conduct work under this task order shall be provided to the Government at the conclusion of the order.

Government-furnished information will include specifications for any modification to existing computer-based tests such as new item selection and scoring algorithms, specifications for new testing instruments, system changes, and general specifications for changes in procedures (including test administration procedures), which impact the design and development of incorporating the new functionality into computer-based testing systems.

9.0 SECURITY CLEARANCE.

No classified work will be done under this delivery order; however, all item files and computer programs generated under this effort shall be treated as “Controlled Items- Test Material” and will be safeguarded and controlled in accordance with United States Military Entrance Processing Command (USMEPCOM) regulation 611-1. User’s Guides and Computer-based Testing system documentation shall be treated as “For Official Use Only”.

10.0 TRAVEL

Travel: Local or long-distance travel may be required to various locations, as directed by the Government, in order to perform the tasks delineated in this PWS. All non-local

Assisted Acquisition Services (AAS) Region 9 travel must be pre-approved by the government. Contractors shall not start any travel without prior approval by the government. All cost reimbursable travel shall be in accordance with FAR 31.205-46 and applicable travel regulations (Joint, Federal or Standardized). Contractor payment claims shall include applicable documentation to support actual costs incurred (e.g. airfare and hotel/lodging receipts) as well as any receipts valued at or above $75.00. Failure to provide appropriate documentation may result in loss of reimbursement of travel expenses. The contractor shall notify the COR and obtain written authorization prior to travel. Anticipated travel is as follows:

10.1 Three (3) trips by one (1) Task Leader/Senior Contributor for a period of three (3) days to OPA, Seaside, CA or Chicago or various MEPS or other field sites are estimated. Three (3) trips by one (1) Programming and Analytic Support Staff for a period of three (3) days to OPA, Seaside, CA or various MEPS are estimated.

Two trips to Defense Advisory Committee locations are estimated. The purpose of these trips is to coordinate system design and development, resolve anticipated problems, and document technical discussions.

11.0 OTHER DIRECT COSTS (ODCs)

If applicable, the Contractor shall include Other Direct Charges (for any necessary software, etc.) in their proposal to cover any costs associated with ODCs. After award, all ODCs shall receive government COR approval prior to funds being expended. The COR must approve all requests for final ODCs prior to the contractor incurring costs. The actual pricing of the required ODCs provided by the Contractor will be validated by the COR. The Contractor shall attach back up documentation/receipts to the invoice.

Invoices for materials will not be paid until proper verification of backup documentation including purchase approval, competition documentation, and receipts.