ID09180038_D.1_ATTACHMENT_6_SAMPLE_TASK_ORDER_2.pdf

ID09180038 – Sample Task Order 2

D.1 ATTACHMENT 6_SAMPLE TASK ORDER 2 -

TECHNICAL SUPPORT FOR CAT-ASVAB - NEW TESTS

U.S. General Services Administration Federal Acquisition Services

Contracting Division

Contract Number # _______

ITSS Number _______________

TASK ORDER Number: ______________

1. Title. Technical Support for CAT-ASVAB - New Tests.

2. Background. The Office of People Analytics (OPA) is responsible for the development and maintenance of several computer-based testing systems used by the Department of Defense (DoD). The Armed Services Vocational Aptitude Battery (ASVAB) is a multiple aptitude test battery used by all military Services to select and classify military applicants. Until 1990, the ASVAB was administered as a traditional, paper-and-pencil test. At that time a new method of ASVAB administration was introduced at several Military Entrance Processing Stations (MEPS) -- Computerized Adaptive Testing (CAT). CAT-ASVAB is now operational at all MEPS and some Military Entrance Testing Sites (METS). The CAT-ASVAB is the largest of these computer-based testing systems. CAT-ASVAB is now available on two different platforms: a local area network (LAN) / Windows-based platform, called WinCAT, and an Internet-based platform, called iCAT.

WinCAT is operational at all Military Entrance Processing Stations (MEPS) and some Military Entrance Testing (MET) sites. The iCAT platform is available at many MEPS and MET sites, and also is being evaluated for use in high schools.

In addition to the computer-based testing systems described above, other tests are being computer-administered, as implementation of CAT-ASVAB has demonstrated the efficiency of computer-based testing. For this reason, DoD is exploring ways to expand the use of computer-based testing, not only for CAT-ASVAB but for language testing as well. For CAT-ASVAB, the expansion is twofold: 1) expand the use of the Windows-based CAT-ASVAB (WinCAT) platform by adding special purpose tests, when practical, and 2) expand the use of CAT-ASVAB by moving to other platforms, such as the Internet, or other locations such as existing Service computer-based training facilities. In the area of language testing, expansion of computer-based testing focuses mainly on the Defense Language Aptitude Battery (DLAB), with development of new test forms and development of a DLAB screening test, along with development of a Computerized Adaptive Testing version of the English Comprehension Level (CAT-ECL) test. The Defense Language Aptitude Battery (DLAB) is used to test both military applicants and military personnel and is used to determine ability to learn a new language. As of July 2007, a computer-based DLAB is being given at MEPS to military applicants. A web version of this test is given to military personnel interested in language training. New cognitive and non-cognitive measures are being developed for computer administration and are currently being administered on the WinCAT platform. In-Service tests, such as the Armed Forces Classification Test (AFCT), have been converted to iCAT Web administration.

3. Objective. The objective of this effort is to provide technical support for the development, evaluation, and expansion of the OPA’s computer-based testing systems, including cognitive, non-cognitive, and proficiency tests, in particular those related to CAT-ASVAB. This includes computer system design and configuration, maintaining current systems, such as implementing software changes, acceptance testing of new software versions, development of documents, evaluating various computer platforms and computer networks, evaluating and setting up various computer system configurations, testing various aspects of the system, developing and modifying systems, as necessary, and providing support to the users. The focus of this effort is on the development and sustainment evaluation of software for tests delivered non-operationally, where test scores are not necessarily used for individual enlistment or classification decisions. The data collected from these tests will be used to evaluate the potential for these tests for future operational use on the CAT-ASVAB platform.

4. Specific Tasks.

4.1. Special or New Tests. The contractor shall provide technical support for writing requirements for special (non-ASVAB) tests or tests being considered as new ASVAB tests, incorporating the tests into WinCAT and/or iCAT, developing test administration procedures, and other related tasks. The contractor shall program changes to the DLAB to incorporate the next generation DLAB, subsequent to the DLAB bridging study, and any/all modifications to the DLAB software. The contractor shall modify various non-verbal reasoning tests to accommodate special study requirements.

4.2. Psychometric Acceptance Testing. The contractor shall provide technical support in testing computer-based tests to ensure that the tests are functioning in accordance with psychometric specifications. The primary focus of this testing is accurate item selection and scoring and any other functionality that could affect examinee scores.

4.3. Document Computer-based Tests and Procedures. The contractor shall provide documentation on all computer programs and tests, including a description of the program structure, input and output variables and files, and instructions for compilation.

Documentation of the technical aspects of the test or software, such as hardware specifications and system configuration, is also required. Documentation shall include User’s Guides, Setup and Installation Procedures, and other documentation required to deploy computer-based test. The contractor shall also submit Functional Specification and Technical Specification documents that follow OPA approved templates.

4.4. Document Psychometric and Policy Requirements. The contractor shall document the Defense Advisory Committee and Manpower Accession Policy Working Group meetings, as needed, so that psychometric and policy requirements can be incorporated in the ASVAB development process. The contractor shall organize and document all psychometric and related reports that are retained in both electronic and paper format by OPA.

4.5. Support Evaluation and Implementation of Non-Cognitive and Special Tests. The contractor shall provide technical support in developing and documenting hardware and software requirements, preparing manuals, developing software, processing data, providing help desk support, and collecting and evaluating user feedback. Such tests include TAPAS, Abstract Reasoning, and other tests that run on the WinCAT platform or are web-based but are not part of the ASVAB.

4.6. Provide Technical Support for Future Computer-based Testing Systems. The contractor shall evaluate new hardware and new operating systems to be used in future deployments of the Windows-based CAT-ASVAB system or web-based test delivery systems. This will include conversion of all software for deployment in a 64-bit environment or equivalent web-based infrastructure provided by OPA.

4.7. Quality Assurance: The contractor shall conduct the following activities:

4.7.1. Develop test plans/procedures

4.7.2. Document and conduct quality assurance of all system deployment products.

4.7.3. Conduct acceptance testing of WinCAT-based and iCAT aptitude and proficiency testing applications.

4.7.4. Develop and use automated testing as available.

4.7.5. Record all acceptance testing and QA results in Jira or other OPA approved products used for this purpose.

4.7.6. Test the web-based production systems during maintenance hours that can be scheduled outside of regular business hours to ensure they are operational, when required, due to changes to the OPA infrastructure.

5. User Troubleshooting Support. The contractor shall assist in the following activities:

5.1. Provide Tier-2 phone support to LAN-based and web-based testing locations. The Tier-2 support shall be provided 24 hours a day, 7 days a week, throughout the year.

5.2. Evaluate and document all problems that occur either at the testing locations or within OPA that affect testing applications.

5.3. Replicate system anomalies when required and work with system and software engineers to resolve these anomalies.

5.4. Develop troubleshooting guidelines for use at OPA and at testing locations.

5.5. OPA workspace functionality. The Government shall require contract personnel to reconfigure or maintain the workspaces and the lab environment within the OPA, Network Operation Center (NOC), and the attached to Office of People Analytics (OPA) or its offices, warehouse, rooms, and facilities. Contract personnel will be required to adhere to DoD regulations on disposing of the E-Waste, paper products, and other materials.

6. Deliverables and Reporting Requirements.

6.1. Monthly Status Reports. The contractor shall document the status of the effort each month.

6.2. Technical Documents. The contractor shall provide written documentation of evaluations and developed procedures, as well as documentation of all computer software.

6.3. Computer Software. The contractor shall provide all software developed under this project, including source code and executable files.

6.4. System Documentation and Computer Source Code. The contractor shall provide written documentation of all computer programs, to include flow charts of all main and other routines. System documentation shall include electronic versions of computer programs.

Computer source code shall be delivered in electronic format.

7. Schedule of Deliverables.

Deliverable Due Date

Monthly Progress Report Monthly, starting with the second month after start of delivery order.

Technical Documents As Required.

System Documentation Final documentation is due NLT End of this project and will incorporate changes resulting from Government review of the documents. Draft documentation is due on an “as required” basis.

Computer Software Final versions of all software are due NLT EOTO and will incorporate changes resulting from Government review of the software. Draft software is due on an “as required” basis.

8. Place of Performance. The place of performance will be at the contractor’s facilities or at OPA, Seaside, Calif., facilities, as required.

9. Travel: No travel required.

10. Period of Performance. The period of performance shall be 10 months

11. Government Furnished Property. The Government will provide equipment necessary for computer-based test development, testing, and other testing development. The contractor will be responsible for providing equipment and materials necessary for evaluating and implementing new procedures. Any materials that the contractor must obtain to conduct work under this project shall be provided to the Government at the conclusion of the order.

12. Government Furnished Information. Government-furnished information will include specifications for any modification to existing computer-based tests such as new item selection and scoring algorithms, specifications for new testing instruments, system changes, and general specifications for changes in procedures (including test administration procedures), which impact the design and development of incorporating the new functionality into computer-based testing systems.

13. Security Clearance. No classified work will be done under this delivery order; however, all item files and computer programs generated under this effort shall be treated as “Controlled Items- Test Material” and will be safeguarded and controlled in accordance with United States Military Entrance Processing Command (USMEPCOM) regulation 611-1. User’s Guides and Computer-based Testing system documentation shall be treated as “For Official Use Only”.