55-7000-19_REQUIREMENTS.pdf

PROGRAM: C34311P INQUIRY OF AVAILABILITY CREATION: 10/24/2019 10:10

Run: 10/24/2019 10:10

BUYER: BROWN LASONIA P FOLDER: 55-7000

VEND NBR

I

VENDOR

Bus Size: s Small Business

ADDRESS

PHONE

FAX NBR Published Price List Available? [] Yes [] No

POC

Tax ID#

CAGE CD

*VENDOR NOTE: In order to do business with the Gove:rnment, all vendors *

* must be registered in the System for Award Management (SAM), *

* http://www.sam.gov. All invoices must be submitted via Wide *

* Area WorkFlow (WAWF) at https://wawf.eb.mil/. Exception to *

* WAWF submission MUST include a statement why electronic invoice*

* submission is an undue burden. Statement MUST be included with*

* quote. *

DISCOUNT DAYS NET

The Gove:rnment Prefers Destination

FOB [ ] DEST [ ]

EST COST EST SHIPPING COST:

SHIPPING POINT:

Principle Place of Perfo:r:mance City/State

GSA/FSS [ ] YES NBR: [ ] NO

001 <;trY: 672.00 HR

Engineering Psychologist I

Unit Price Total Price Est Delivery Date

I I

002 <;tr'f: 420.00 HR

RFQ # N00173-20-Q-0011

PROGRAM: C34311P INQUIRY OF AVAII.J.\BILITY CREATION: 10/24/2019 10:10

Run: 10/24/2019 10:10

FOLDER: 55-7000 BUYER: BROWN LASONIA p

003 QTY:

004 QTY:

Senior Research Physchologist

Unit Price Total Price

336.00 HR

Engineering Psychologist II

Travel

Unit Price Total Price

1.00 EA

Costs

Unit Price Total Price

Total $:

Est Delivery Date

I I

Est Delivery Date

I I

Est Delivery Date

I I

How you will be evaluated:

1. Significant Level of Expertise in the following: Technology and Application Identification, Evaluating , Assessing and Recommending New Approaches in DS, PDS, and CDDM software;

Providing Strategic Planning and Technical Analysis; Software Development; Performing Experiments and Field Trials; Prototype Development; and Integration and Engagement Support

2. Documentation that reflects Expertise and Professional Experience as per "Position Requirements" within this package.

3. Cost See Additional Information for more details.

Position Requirements for 55-7000-20

Offcrors should provide detailed documentation to allow the government to assess personnel qualifications against the position requirements.

Engineering Psychologist I - The position requires demonstrated experience in the programming languages E-Prime or C# in order to make changes to existing anention control tasks as well as to be able to program new tasks. The position requires an ability to link any of the attention control tests being developed with eye tracking hardware and software and maintain timing precision. The position requires an ability to run initial data analysis on the results from the validation experiments using item response theory, reliability analysis, and assessing the degree to which a test has adverse impact. A proficient working knowledge and experience is necessary with R or SPSS.

Engineering Psychologist II - This position requires in depth knowledge of cognitive test development and moderate knowledge and understanding of cognitive measures of fluid intelligence, working memory capacity, and attention control and a strong ability to assess what construct a specific test is measuring. A working knowledge of the current cognitive tests used by the DoD to assess cognitive ability for purposes of selection is also required. The position requires an individual that is well versed in structural equation modeling and factor analysis and knowledgeable in either LISREL or R. This individual will help the Pl in the development and design of the experiments assessing new measures of anention control (such as the Sustained Attention to Control Task or the Visual Arrays Task). Specifically they must be able design experiments to detennine the appropriate test length to maintain reliability and understand how to change the test to be sensitive to differences in subsets of the population with high levels of cognitive ability.

Senior Research Psychologist - The position requires an extensive experience in developing and validating tests of individual differences in working memory capacity and attention control. A thorough understanding of these fields is required in order to ensure sufficient sensitivity of these tests in measuring cognitive ability while minimizing measurement biases. The position also requires a thorough understanding and experience in using the existing selection tests such as the Aviation Selection Test

Battery and Anned Services Vocational Aptitude Battery

Prototype cognitive measures for Naval Aviation Selection

1. Background: The United States Navy and Marine Corp face a unique challenge in that they must identify which individuals' possess the skills necessary to succeed in jobs for which they have no prior experience. This is a particularly difficult task for positions which require significant training and education such as Naval Aviators and Air Traffic Controllers. Currently, the Navy employs the

Aviation Selection Test Battery (ASTB} to identify which candidates to select as Naval Aviators and

Navy Flight Officers. Approximately 10,000 individuals apply each year to fill just over 1000 positions.

While the latest ASTB has helped reduce training attrition it is still at about 20%, and the problems associated with adverse impact remain. That is individuals in different subgroups do not perform as well on the test and the test has less predictive validity for those subgroups. A similar problem exists for enlisted individuals selected to be air traffic controllers. The Navy's Air Traffic Control School has an attrition rate of around 30%. The underlying issue is that many of the tests being used have problems with reliability (performance varies when assessed multiple times} and they may be measuring more crystalized intelligence (what an individual has already learned, e.g. reading comprehension or video game experience}, rather than fluid intelligence (the ability to learn new skills). The Navy is interested in identifying new tests which can assess an individual's ability to acquire new skills and perform in cognitively demanding military tasks such as directing air traffic.

The goal of this effort is to identify and adapt new cognitive tests that are highly reliable, demonstrate minimal adverse impact, and can predict performance in different military school houses (e.g., Air Traffic Control School and Flight School).

2. Scope of Work: The goal of this work is to identify new computer based cognitive tasks that can be used to predict an individual's ability to learn and acquire new skills. Specifically, we are interested in how well an individual can learn and perform in a complex multi-tasking environment (such as NRL's

Supervisory Control Operations User Testbed). The vendor will compare performance on the new tests against the cognitive ability tests currently used by the Navy for selection and screening, the

ASTB and ASVAB (i.e., dichotic listening, direction orientation, coding speed; provided by the Naval

Aeromedical Institute} as well as other validated tests of fluid intelligence (e.g., Ravens Progressive

Matrices). The primary objective of the effort is to demonstrate how well the new measures predict performance in a complex environment compared to the cognitive measures currently used by the

Navy. The second objective is to determine how well these new measures and the measures currently used by the Navy load onto the cognitive constructs of fluid intelligence, attention control and working memory. The final objective is to assess the reliability and predictive validity for Naval training of the new cognitive measures.

3. Period of Performance:

Award through 09/30/2020

4. Place of Performance:

US Naval Research Laboratory, contractor's facility, customer's facility or the most suitable place to accomplish the given task.

5. Work Requirements:

Task 1: Research and Software Development:

The contractor will develop and refine a set of at least three new computer-based measures of cognitive ability aimed at measuring attentlon control. Attention control is an individual's ability to direct and maintain their attention on a specific task while Ignoring irrelevant Information. Initial evidence has found that measures of attention control may be predictive of performance in complex tasks. However, a general understanding of attention control measures Is still quite limited. Due to this limited understanding of the construct, new measures of attention control should be Integrated wlth eye tracking to further understand the differences within Individuals beyond their behavioral performance on the new tasks. Gazepoint GP3 eye tracking system and any new task should synchronize data from the eye tracker with the task performance. The contractor will support the

Integration of eye tracking with their attention control measures.

Task 2: Verification and Validation:

This effort should compare the new measures developed by the contractor against other cognitive ability measures currently used by the Navy for selection purposes (i.e., cognitive ability tests within the Armed Services Vocational Aptitude Battery (ASVAB) and the Aviation Selection Test Battery

(ASTB)). The contractor will show how well the current tests as well as the new measures account for performance in a complex cognitive task such as NRL's Supervisory Control User Testbed or other multi-tasking environment. This wlll be used as a proxy for training and job performance to be used as a first level valldatlon assessment.

The new measure must be sensitive to individual differences and should be shown to have high test retest rellabllity. The contractor will compare measures from the same individuals across different days to demonstrate that the values obtained are stable within the same individual. Further, the contractor will assess the adverse impacts associated wlthin their new measures. The adverse

Impact Is the extent to which sub groups, such as females or minorities, have lower average scores and there is a reduction In predictive validlty. lf the measures of attention control are measuring a basic cognitive construct they should show less adverse Impact than other measures of cognitive ability.

The contractor will also determine the minimum time required to obtain a reliable measure for each of the new attention control tasks.

Deliverables:

I. Bimonthly technical and financial reports: A report documenting how well the measures created by the contractor can predict performance on a complex task. This report should also detail how the measures compare with those currently In use by the Navy. Specifically, the report should address the amount of variance both the new and old measures account for within the complex cognitive task used. The report should detail the extent to which adverse Impact was found in any sub groups. Further the reports should detail the reliabllity of the new tests. The government will provide written notices (via email) regarding the acceptability of the deliverable. This deliverable is listed In the CORL documentation (CORL Data Item 001).

II. Briefings (as requested): Briefing materials developed by contractor delivered to NRL for presentation to Government Sponsors. NRL will provide feedback on materials to allow contractor to revise If necessary. The briefing materials will be of a technical nature and will summarize, In presentation form, the more detailed technical status and financial reports. The government will provide written notices (via email) regarding the acceptability of the deliverable. This deliverable Is listed In the CORL documentation (CORL Data Item 002).

Ill. Software prototypes and supporting documentation (as required): A set of at least 2 computer based attention control tasks which can be run on a Windows PC. The final versions must be Integrated with the Gazepolnt GP3 eye tracking system. Associated documentation must be provided such as user manuals or guides, known bugs, test plans and associated reports, etc.

NRL will provide feedback to allow the contractor to Incorporate suggested revisions. The government will provide written notices (via email) regarding the acceptablllty of the deliverable(s). This deliverable is listed in the CORL documentation (CORL Data Item 003}.

IV. Quarterly program reviews with the government: As required, the contractor shall meet with the Government team at the Government's chosen facility to provide a detailed technical and financial presentation for review. The presentation shall include a description of the work conducted during the given three month period and will Include at a minimum a description of the objective of the work technical approach, presentation of results, discussion of results, studies conducted, conclusion, and work planned for the next quarter. This deliverable is listed in the CORL documentation (CORL Data Item 004).

V. Final Report and software Implementation (as required): Reports document significant technical accomplishments. NRL will review the reports and provide feedback to allow the contractor to Incorporate suggested revisions. This report shall contain, at a minimum an executive summary, technical overview outlining the approach taken to address the research challenges, description of military scenarios used to evaluate the software (If applicable), discussion of metrics used to evaluate the software, technical challenges that were encountered and how they were addressed, as well as challenges that could not be addressed due to llmltatlons of time and/or resources. The format of the technical Information report may be of the contractors choosing, and must be provided to the government In advance In order to reviewed and approved as a sufficient template, prior to the first delivery of the actual report. The government will provide written notices (via email) regarding the acceptability of the deliverable. This deliverable ls listed In the CORL documentation (CORL Data Item 005).

6. Schedule/Milestones:

The vendor will be responsible for sharing financial and technical reports, meetings and briefings with the government to assess progress and address dlfflcultles, provide software and deliver their final report. Other than the schedule of bimonthly technical and financial reports, all other scheduled milestones/deliverables In the CORL documentation are ASREQ.

7. Quality Assurance Surveillance Plan (QASP):

The contractor shall submit as part of their proposal, a quality assurance surveillance plan (QASP), detailing how they will ensure that quality work will be produced. In addition, the QASP shall include procedures for ensuring sensitive Information is safeguarded. The contractor shall submit as part of their proposal, a tlmeline for Implementation and milestone for task completion. The specific priority for file conversion will be determined after award.

8. Acceptance Criteria:

The government will accept deliverables via email (COR), and will acknowledge receipt and acceptance of the deliverables via email.

9. Other Requirements: N/ A

10. Enterprise-wide Contractor Manpower Reporting Application (ECMRA)

The contractor shall report ALL contractor labor hours (Including subcontractor labor hours) required for performance of services provided under this contract for the US Naval Research

Laboratory via a secure data collection site. The contractor Is required to completely fill In all required data fields using the following web address: http://www.ecmra.ml1/.

Reporting Inputs will be for the labor executed during the period of performance during each

Government fiscal year (FY), which runs October 1 through September 30. While Inputs may be reported any time during the FY, all data shall be reported no later than October 31 of each calendar year, beginning with 2013. Contractors may direct questions to the help desk at help desk at:

http:/ /www.ecmra.mlll.