RFP 693JJ924R000088 Telematics Technology and Distracted Driving_8.1.24.pdf

693JJ924R000088

SOLICITATION, OFFER AND AWARD

4. TYPE OF SOLICITATION2. CONTRACT NUMBER 3. SOLICITATION NUMBER

7. ISSUED BY CODE 8. ADDRESS OFFER TO (If other than Item 7)

ORDER UNDER DPAS (15 CFR 700)

6. REQUISITION/PURCHASE NUMBER

NOTE: In sealed bid solicitations "offer" and "offeror" mean "bid" and "bidder".

NEGOTIATED (RFP)

SEALED BID (IFB)

5. DATE ISSUED

1. THIS CONTRACT IS A RATED RATING PAGE OF PAGES

1 85

C. E-MAIL ADDRESS

EXT.NUMBERAREA CODE

B. TELEPHONE (NO COLLECT CALLS)A. NAME

10. FOR

INFORMATION

CALL:

CAUTION: LATE Submissions, Modifications, and Withdrawals: See Section L, Provision No. 52.214-7 or 52.215-1. All offers are subject to all terms and conditions contained in this solicitation.

(Date)(Hour) depository located in copies for furnishing the supplies or services in the Schedule will be received at the place specified in Item 8, or if hand carried, in the

SOLICITATION

9. Sealed offers in original and

PART IV - REPRESENTATIONS AND INSTRUCTIONS

OTHER STATEMENTS OF OFFERORS

EVALUATION FACTORS FOR AWARD

INSTRS., CONDS., AND NOTICES TO OFFERORS

REPRESENTATIONS, CERTIFICATIONS AND

LIST OF ATTACHMENTS

CONTRACT CLAUSES

PART III - LIST OF DOCUMENTS, EXHIBITS AND OTHER ATTACH.

I

J

K

L

M SPECIAL CONTRACT REQUIREMENTS

CONTRACT ADMINISTRATION DATA

DELIVERIES OR PERFORMANCE

INSPECTION AND ACCEPTANCE

PACKAGING AND MARKING

DESCRIPTION/SPECS./WORK STATEMENT

SUPPLIES OR SERVICES AND PRICES/COSTS

SOLICITATION/CONTRACT FORM

PART II - CONTRACT CLAUSESPART I - THE SCHEDULE

H

G

F

E

D

C

B

A

SEC. DESCRIPTION PAGE(S) (X) DESCRIPTION SEC. (X)

11. TABLE OF CONTENTS

18. OFFER DATE17. SIGNATURE

SUCH ADDRESS IN SCHEDULE.

IS DIFFERENT FROM ABOVE - ENTER

15C. CHECK IF REMITTANCE ADDRESS

EXT.NUMBERAREA CODE

15B. TELEPHONE NUMBER

(Type or print)AND

ADDRESS

OF

OFFEROR

CODE FACILITY

16. NAME AND TITLE OF PERSON AUTHORIZED TO SIGN OFFER15A. NAME

DATEAMENDMENT NO.DATEAMENDMENT NO.

and related documents numbered and dated):

amendments to the SOLICITATION for offerors

(The offeror acknowledges receipt of

14. ACKNOWLEDGEMENT OF AMENDMENTS

CALENDAR DAYS (%)30 CALENDAR DAYS (%)20 CALENDAR DAYS (%)10 CALENDAR DAYS (%)

(See Section I, Clause No. 52.232.8)

13. DISCOUNT FOR PROMPT PAYMENT

designated point(s), within the time specified in the schedule.

by the offeror) from the date for receipt of offers specified above, to furnish any or all items upon which prices are offered at the price set opposite each item, delivered at the

NOTE: Item 12 does not apply if the solicitation includes the provisions at 52.214-16, Minimum Bid Acceptance Period.

OFFER (Must be fully completed by offeror)

IMPORTANT - Award will be made on this Form, or on Standard Form 26, or by other authorized official written notice.

28. AWARD DATE

(Signature of Contracting Officer)

27. UNITED STATES OF AMERICA

25. PAYMENT WILL BE MADE BY

26. NAME OF CONTRACTING OFFICER (Type or print)

CODE 24. ADMINISTERED BY (If other than Item 7)

ITEM

(4 copies unless otherwise specified)

23. SUBMIT INVOICES TO ADDRESS SHOWN IN

41 U.S.C. 253 (c) ( 10 U.S.C. 2304 (c) (

22. AUTHORITY FOR USING OTHER THAN FULL AND OPEN COMPETITION:

21. ACCOUNTING AND APPROPRIATION20. AMOUNT19. ACCEPTED AS TO ITEMS NUMBERED

AWARD (To be completed by government)

CODE

693JJ924RQ00031308/01/2024

X

693JJ9

National Highway Traffic Safety Adm Office of Acquisition Management 1200 New Jersey Avenue, S.E.

Washington DC 20590 until 1300 ED local time 09/02/2024

THOMAS VANDELL 202

thomas.vandell@dot.gov

366-0626

X

X

X

X

X

X

X

X

X

X

X

X

X

PAGE(S)

Sherese Gray

AUTHORIZED FOR LOCAL REPRODUCTION

Previous edition is unusable

STANDARD FORM 33 (Rev. 9-97)

Prescribed by GSA - FAR (48 CFR) 53.214(c)

1-2

4-19 20-21 22-23 24-29 30-38 39-44

45-54

56-67

68-80

80-85

12. In compliance with the above, the undersigned agrees, if this offer is accepted within _____0_________ calendar days (60 calendar days unless a different period is inserted

ITEM NO. SUPPLIES/SERVICES QUANTITY UNIT UNIT PRICE AMOUNT

NAME OF OFFEROR OR CONTRACTOR

2 85

CONTINUATION SHEET

REFERENCE NO. OF DOCUMENT BEING CONTINUED PAGE OF

693JJ924R000088

(A) (B) (C) (D) (E) (F)

TITLE: Telematics Technology and Distracted

Driving

OPTIONAL FORM 336 (4-86)

Sponsored by GSA

FAR (48 CFR) 53.110

NSN 7540-01-152-8067

REQUEST FOR PROPOSAL

Telematics Technology and Distracted Driving

RFP 693JJ924R000088

PART I - THE SCHEDULE

SECTION B – SCHEDULE OF PRICES

B.1 SUPPLIES/SERVICES

a. The Contractor shall furnish the necessary qualified personnel, facilities, materials, supplies, equipment, and services to execute a Cost Plus Fixed-Fee or Cost (No-Fee) Contract in accordance with the Statement of Work, Section C, and other terms and conditions of this contract.

b. The Government anticipates award of a Cost-Plus Fixed Fee (CPFF) contract as a result of this solicitation accordance with FAR 16.306.

B.2 ESTIMATED TOTAL COST AND FIXED FEE AMOUNT

Item No.

Item Description Quantity Unit of

Measure Estimated Cost Fixed Fee

Total Estimated Cost and Fixed Fee

Telematics Technology and Distracted Driving, in accordance with the Statement of Work

60 Months $ $ $

Note: The Contracting Officer (CO) is the only individual who can legally commit or obligate the Government to the expenditure of public funds. No cost chargeable to the proposed Contract can be incurred before receipt of a fully executed Contract or specific written authorization from the Contracting Officer.

(End of Section B)

SECTION C - DESCRIPTION, SPECIFICATIONS, WORK STATEMENT

C.1 BACKGROUND

The National Highway Traffic Safety Administration (NHTSA) is an operating administration within the U.S. Department of Transportation (DOT). NHTSA’s mission is to save lives, prevent injuries, and reduce economic costs due to road traffic crashes through education, research, safety standards, and enforcement activity. In 2021, 8% of fatal crashes were distraction-affected crashes, with distracted driving motor vehicle crashes claiming 3,522 lives.1 In 2021, 12% of distracted-affected fatal crashes were reported as having cell phone use as a distraction, resulting in 377 fatal crashes and 410 fatalities. Distraction, whether cell phone-related or non-cell phone-related, can have a negative impact on driving and increase the likelihood of collisions.2, 3, 4 Understanding which forms of technology can be used to study distracted driving effectively and which technologies can be used as part of countermeasures may help to decrease the number of crashes, injuries, and fatalities.

Prevalence of distracted driving has traditionally been measured through observational surveys (e.g., the National Occupant Protection Use Survey [NOPUS]),5 a census on fatal motor vehicle traffic crashes (i.e., the Fatality Analysis Reporting System [FARS])1, and naturalistic driving studies (NDS) such as the Second Strategic Highway Research Program Naturalistic Driving Study (SHRP 2).6 However, telematics technology may represent another option for measuring and transmitting information about distracted driving engagement. Telematics technology involves “services where telecommunications are employed to transmit information provided by sensors.”7 One form of telematics technology involves smartphone-based technology.

Smartphone-based telematics technology involves the use of built-in smartphone sensors to collect data on driver behavior and performance, then transmit the information to interested stakeholders. The information collected by the technology also includes vehicle speed, location, and, in addition, smartphone use by the driver.8 NDSs often involve data acquisition systems

1 National Center for Statistics and Analysis. (2023, May). Distracted driving in 2021 (Research Note. Report No.

DOT HS 813 443). National Highway Traffic Safety Administration.

2 Caird, J. K., et al. (2014). A meta-analysis of the effects of texting on driving. Accident Analysis and Prevention, 71, 311–318.

3 Caird, J. K., et al. (2018). Does talking on a cell phone, with a passenger, or dialing affect driving performance?

An updated systematic review and meta-analysis of experimental studies. Human Factors, 60, 101–133. doi:

10.1177/0018720817748145 4 Klauer, S. G., et al. (2014). Distracted driving and risk of road crashes among novice and experienced drivers. N Engl J Med., 370(1), 54–59.

5 National Center for Statistics and Analysis (2022, August). Driver electronic device use in 2021 (Traffic Safety Facts Research Note. Report No. DOT HS 813 357). National Highway Traffic Safety Administration.

6 Dingus, T. A., et al. (2016). Driver crash risk factors and prevalence evaluation using naturalistic driving data.

PNAS, 113(10), 2636–2641.

7 Wahlstrӧm, J., et al. (2017). Smartphone-based vehicle telematics: A ten-year anniversary. IEEE Transactions on Intelligent Transportation Systems, 18(10), 2802–2825.

8 Grimberg, E., et al. (2020). Smartphones vs. in-vehicle data acquisition systems as tools for naturalistic driving studies: A comparative review. Safety Science, 131, 104917.

(DAS) that collect information from the on-board diagnostic (OBD) port (usually the OBD II port), which is an “in-vehicle sensor system designed to monitor and report on the performance of a large number of vehicle components.”7 In addition, NDS DASs can include sensors that collect information from accelerometers, video cameras (which can collect distracted driving engagement), and other sensory data.6

For this contract, the first step will involve a literature review and scan of technologies that can be used for studying data collection of driver behavior and distracted driving engagement. Next, the contract will focus on different forms of data collection, specifically focusing on NDS DAS and smartphone-based telematic apps in terms of accuracy at providing information, resources required for utilizing each technology, and ease of use and distribution (Study 1). Last, the contract will conduct data collection and analyses using these two technologies in terms of general driving and distracted driving engagement according to the two forms of technology (Study 1) and according to participant sex and age (which will be analyzed using the current project’s data sets) (Study 2).

The data that are collected will be analyzed to compare the two technologies (Study 1) and according to sex and age in a 2 by 2 design (Study 2). It is anticipated that the design will involve at least one hundred twenty (120) participants (approximately sixty (60) men and sixty

(60) women and sixty (60) younger drivers [e.g., between the ages of 20 and 30] and sixty (60) middle-aged drivers [e.g., between the ages of 45 and 55], for cells of approximately thirty (30) participants). It is also anticipated that data collection will take place for at least a period of one

(1) month to ensure sufficient data is available for examining the relevant behaviors. In addition, this project will have a diverse sample in terms of race and ethnicity.

The intent of this project is to create two (2) final reports, one for each study, a journal article, and data sets from each study and the raw data sets that can be analyzed in the future. This project will support NHTSA’s efforts to study distracted driving engagement, giving the agency information regarding what measurement techniques are effective for different forms of distracted driving, and behavior, in general, as well as providing the agency with prevalence estimates for distracted driving engagement.

C.2 OBJECTIVE

The primary research question for Study 1 is: How can smartphone-based telematics technologies be used to measure information on driver behavior and performance in general and in terms of distracted driving engagement? Additional research questions include: When can smartphone-based telematics technologies be used for data collection? When are smartphone-based telematics technologies as accurate or less accurate than traditional NDS DASs in terms of recording driver behavior and performance (for distracted driving or in general)?

The primary research question for Study 2 is: Are there differences according to sex and age for distracted driving engagement and for risky behaviors related to distracted driving engagement for the data collected via smartphone-based telematics technology and NDS DAS?

Other objectives of this Contract are to:

1) Analyze the different kinds of data collection technologies available for studying distracted driving and driving, in general;

2) Use two (2) different approaches, i.e., the NDS DAS and smartphone-based telematics technology, in terms of data collection involving driver behavior and performance, in general, and in terms of distracted driving;

3) Analyze the two (2) forms of technology in terms of driver behavior and performance, in general, and in terms of distracted driving to ascertain accuracy of the smartphone-based telematics technology compared to the NDS DAS (Study 1);

4) Analyze the data collected by the two (2) different approaches according to sex and age for distracted driving engagement and risky behaviors related to distracted driving engagement (Study 2); and

5) Produce a final report for each study (i.e. two (2) final reports), a journal article, and data sets from each study and the raw data sets.

C.3 ACRONYMS

The following is a list of key acronyms used throughout the Statement of Work (SOW).

This list may not be exhaustive.

ACOR Alternate Contracting Officer’s Representative CO Contracting Officer COR Contracting Officer’s Representative CS Contract Specialist DAS Data Acquisition Systems DOT U. S. Department of Transportation FARS Fatality Analysis Reporting System ICR Information Collection Request NHTSA National Highway Traffic Safety Administration NDS Naturalistic Driving Studies OBD On-board Diagnostic OMB Office of Management and Budget PIA Privacy Impact Assessment PII Personally Identifiable Information SOW Statement of Work TAR Transportation Acquisition Regulations

C.4 GENERAL REQUIREMENTS

The Contractor shall review the literature and scan for examples of the two (2) kinds of technology that will be used in the study, i.e., NDS DAS and smartphone-based telematics technology. Based on the findings, the Contractor shall design and conduct the study that will compare the technologies to each other in terms of how each can be used, what information can be collected by each kind of technology, costs, and which is most effective in data collection in terms of distracted driving, including both cell phone use and non-cell phone use distracted driving, and driving, in general (Study 1). The design is anticipated to be within-subjects such that each participant would have data collected through the two (2) kinds of technologies at the same time. It is anticipated that the Contractor shall conduct a power analysis to determine the number of participants needed to compare different variables (e.g., vehicle speed; acceleration;

hard braking; distracted driving behavior [where relevant]; etc.) across the two (2) kinds of technologies for Studies 1 and 2. The second study is to have a 2 by 2 analysis design according to sex and age.

C.5 SCOPE OF WORK

The Contractor shall furnish the necessary personnel, equipment, and facilities, and otherwise perform all things necessary for or incidental to the performance of work (the accomplishment of specific requirements) as set forth in Sections C.5 and below in C.6.

C.6 SPECIFIC REQUIREMENTS

C.6.1 Kickoff Meeting

One (1) week prior to the kickoff meeting, the Contractor shall work with the COR to prepare appropriate briefing materials on their proposed approach prior to the meeting. Materials for the briefing shall be completed and submitted to the COR for review and approval.

Within three (3) days of receipt, the COR will provide feedback on the presentation.

Within one (1) month of award, the Contractor shall attend a virtual kickoff meeting with the COR, CO and/or CS, and any other interested NHTSA personnel to discuss the administration of the contract, objectives, scope and anticipated challenges of the effort. The meeting will serve to identify any gaps or potential barriers and solutions to ensure successful completion of the project.

This shall also be a working meeting for the Contractor (allowing up to two (2) hours for the meeting). The COR will take the lead in the discussions and provide the background for the study.

The Contractor shall then discuss the firm’s approach for the study.

The Contractor’s description of their approach shall include the following:

• Understanding of project objectives;

• Schedule of project activities; and

• Understanding of deliverable requirements and specifications.

C.6.2 Literature Review, Synthesis and Scan of Technology

No later than four (4) months after award, the Contractor shall conduct a literature review and produce a a letter report to the COR that includes the following two (2) sections:

• Synthesized findings from the literature relevant to the two (2) kinds of technology. The literature shall consist of articles (peer-reviewed and gray literature) involving smartphone-based telematics and NDS DAS technology in the context of driving that have been or could be applied to distracted driving engagement. The synthesis portion of the report shall be between ten (10) to fifteen (15) pages. The synthesis may be the basis of the Introduction section of Study 2’s Final Report;

• A scan and table describing different forms of the two (2) kinds of technology for application to data collection. This scan is intended to provide detail regarding smartphone-based telematics and NDS DAS technologies that have been applied to risky driving and, specifically, to distracted driving. The findings of the technology scan may be included in Study 1’s Final Report as relevant to compare the technologies. The Contractor shall, based on the findings from the literature review and other sources, rank-order the examples within each technology (e.g., ranking of the different kinds of smartphone-based telematics technology) according to strength of the recommendation.

Some of the findings from the table and scan may be used for the analyses conducted in Study 1’s Final Report, i.e., for comparisons between the technologies. The table and scan shall include, but is not limited to:

o Descriptions of the kinds of two (2) technologies that exist and may be used within the current study, including, where relevant, different versions of the technologies (e.g., if there are different smartphone-based telematics technologies that can collect the data);

o Where and how the technologies have been used, including if the technologies have been used specifically to measure information about distracted driving and driver behaviors/performance, as well as what driver behaviors/performance can be measured by each kind of technology;

o Whether data collected using the technologies can be accessed in raw form for analyses;

o Whether both kinds of technologies can collect driving/vehicle data simultaneously, so as to compare the technologies’ data on each participant for the same time period;

o Cost of the technologies, i.e., installation and use, which may be used for technologies selection and described in the Final Report for Study 1;

o Ease of installation and use of the technologies;

o Strengths and weaknesses (or obstacles) for each technology; and o Other, relevant factors for choosing the specific version(s) of each of the two (2) technologies.

No later than two (2) weeks after receipt, the COR will provide comments to the Contractor regarding the report. If needed, the Contractor shall make revisions to the document to address the COR’s comments. Additional drafts shall be submitted as needed until the document is accepted by the COR.

No later than two (2) weeks after receipt, the COR will select the two (2) versions of the technology (NDS DAS and smartphone-based technology) to use within the study; however, this selection may be reviewed at a later time. The COR will make the final selection of the technologies to test. Different versions of the technologies may be selected for data collection, e.g., more than one smartphone-based telematics technology may be selected.

C.6.3 Work Plan

No later than five (5) months after award, the Contractor shall finalize its Work Plan and submit it to the COR. The Finalized Work Plan shall be based on the plan submitted in the Contractor’s proposal and final proposal revisions and discussions at the Kickoff Meeting (Task C.6.1), as well as the findings of the Literature Review and Synthesis and Scan of Technology (Task C.6.2). The Finalized Work Plan shall include a plan for conducting a Pilot Study and the Main Data Collection. The Finalized Work Plan shall include a description of all data collection approaches and provide a description of the planned analyses for answering the research questions. In addition, the plan shall include a complete list of project milestones and deliverables (including due dates).

No later than two (2) weeks after receipt, the COR will either approve the plan or contact the Contractor for revisions.

C.6.4 Develop Design Methodology, Documents, and Questionnaire

No later than seven (7) months after award, the Contractor shall develop the design and methodology (including all documents, e.g., design, protocols, recruitment materials, questionnaires, informed consent, debriefing, etc.) for the research questions and shall submit all documents to the COR. The design shall be fully within-subjects with participants having both kinds of data collection technologies operating at the same time to compare data that can be collected using the different technologies. Two (2) kinds of data collection technologies are listed, but there may be multiple versions of the kind of technology used in the study, e.g., there may be two (2) different smartphone-based telematics apps that could collect data at the same time, depending upon what technologies are found within task C.6.2’s scan of technologies. The sample size shall be based on a power analysis conducted by the Contractor to ensure that a sufficient number of participants are participating for analytical purposes. The number of participants shall be sufficient to compare different variables (e.g., vehicle speed; acceleration;

hard braking; distracted driving behavior [where relevant]; etc.) across the two (2) kinds of technologies (Study 1) and between participant groups (sex and age) (Study 2).

Notwithstanding the power analysis, the design shall involve no less than one hundred twenty

(120) participants (approximately sixty (60) men and sixty (60) women and sixty (60) younger drivers [e.g., between the ages of 20 and 30] and sixty (60) middle-aged drivers [e.g., between the ages of 45 and 55], for cells of approximately thirty (30) participants). The study shall have a diverse sample in terms of race and ethnicity. The data collection shall take place for a minimum of one (1) month to ensure sufficient data is available for examining the relevant behaviors. The questionnaires shall address behaviors, e.g., how often participants engage in different distracted driving behaviors; experience with and knowledge of the technologies; and other, relevant concepts that relate to the research questions. The Contractor is encouraged to use questions that come from the literature review and scan. Demographic information shall be collected. For informed consent, the Contractor shall adhere to the Department of Transpiration Regulations at 49 CFR. Part 11, Protection of Human Subjects and may consult the Department of Health and Human services on obtaining informed consent [https://www.hhs.gov/ohrp/regulations-and-policy/guidance/informed-consent/index.html], including the checklist of content to include in consent forms (https://www.hhs.gov/ohrp/regulations-and-policy/guidance/checklists/index.html)

No later than three (3) weeks after receipt, the COR will provide comments to the Contractor regarding the documents.

No later than nine (9) months after award, the Contractor shall incorporate the COR’s comments and submit the documents. Additional revisions shall be made as required.

C.6.5 Data Collection and Analysis Plan

No later than ten (10) months after award, the Contractor shall submit a Draft Data Collection and Analysis Plan that details how data would be collected and analyzed for the studies.

The Draft Data Collection and Analysis Plan shall be a revised version of the data collection and analysis plan submitted in the proposal that addresses comments from the kickoff meeting, information gleaned from the literature review and technologies scan, and discussions with the NHTSA COR during tasks C.6.1 through C.6.4. The Draft Collection and Analysis Plan shall include a description of all data collection and analysis to address the research questions in C.2, including the questionnaire (C.6.4), and shall include measures to ensure protection of participant data (including Personally Identifiable Information [PII]).

In addition, the Data Collection and Analysis Plan shall include the following:

• Experimental methodology created in C.6.4, as well as all of the documents created in

C.6.4;

• Method for planned instrumentation of participants’ vehicles and for inclusion of smartphone-based telematics technology on participants’ phones;

• Method for recruiting up to nine (9) participants for a Pilot Study and the one hundred twenty (120) participants (or more, depending upon design) for the Main Data Collection, who have smartphones, use them frequently, and travel for long enough distances where they may engage in distracted driving, in general and via cell phone;

https://www.hhs.gov/ohrp/regulations-and-policy/guidance/informed-consent/index.html https://www.hhs.gov/ohrp/regulations-and-policy/guidance/checklists/index.html

• Description of what will be recorded by the DAS and what will be collected on the smartphone-based telematics technology;

• Whether, and to what extent, CANbus data will be used for finding crashes/near crash events and related driving behaviors. If the CANbus data will not be used, alternatives shall be listed for finding this information for the DAS data collection;

• Detailed description for recruiting the proposed number of participants (from C.6.4), including accounting for sex and age categories and race/ethnicity inclusion;

• Detailed table of dependent variables and planned analyses for both a Pilot Study and Main Data Collection (which may include, but not be limited to, comparisons between the two forms of data collection [NDS DAS and smartphone-based telematics technology] for cell phone use and other distracted driving engagement, reaction time, collisions, lane positioning, speed, headway, acceleration, deceleration, hard braking, and other variables). The analyses shall, at a minimum, compare the extent of risky driving behaviors and distracted driving behaviors recorded between the NDS DAS and smartphone-based technologies (Study 1), and both the extent of distracted driving engagement and related risky driving behaviors in terms of sex and age (Study 2). For Study 2, the analyses shall, at a minimum, compare the extent of risky driving behaviors that occur while participants are engaged in distracted driving to when they are not engaged in distracted driving (comparing different epochs), and may also examine the extent of risky driving behaviors that occur right before and right after participants engage in distracted driving. An example of the table is:

Research Question

Data Source Data Description Analysis type Groups analyzed e.g., Study1, RQ 3 e.g., data collected from the NDS DAS and the smartphone-based telematics apps e.g., whether there are differences in driver behaviors/performance measures according to recording technology e.g., regression model, ANOVA, etc.

e.g., different technology conditions, etc.

• Participant reimbursement schedule for both the Pilot Study and Main Data Collection, including the amount participants would be reimbursed and when they would receive their reimbursements;

• Pilot Study and Main Data Collection protocols that describe the implementation of the design. The protocols will include the following elements:

o Administration of informed consent;

o Administration of the questionnaire (including when participants will be administered the questionnaire, such as before the vehicle and smartphone data collection and/or after vehicle and smartphone data collection);

o Installation of the DAS recording equipment in the vehicles and the smartphone-based telematics technology(ies); and o After the vehicle data collection, returning phones and vehicles to their original configuration and provision of final incentive to participants; and

• Templates for figures to display analysis results.

No later than three (3) weeks after receipt, the COR will contact the Contractor with comments or required revisions.

No later than twelve (12) months after award, the Contractor shall submit a Final Data Collection and Analysis Plan that addresses the COR comments.

C.6.6 Data Management Plan

No later than thirteen (13) months after award, the Contractor shall submit a draft Data Management Plan (DMP). Research projects involving data collection conducted for the Department of Transportation are required to comply with the Department’s Public Access Plan including development and approval of a DMP. The DMP describes how researchers will handle digital data both during and after a research project. The DMP should be a 2- or 3-page narrative description (no more than 5 pages) covering five key topics: a description of the data; the standards used; access policies; re-use, redistribution, and derivative products policies; and archiving and preservation plans. Once approved by the COR, the DMP will be provided to the National Transportation Library for final approval. The Department of Transportation’s Public Access Plan and additional information on preparing a DMP, including examples, may be found at https://ntl.bts.gov/ntl/public-access/creating-data-management-plans-extramural-research.

No later than two (2) weeks after receipt, the COR will contact the Contractor with comments or required revisions if additional revisions are necessary for deliverable acceptance. The Contractor shall make revisions if required.

C.6.7 Prepare Information Collection Support for Regulatory Requirements

Paperwork Reduction Act

The Office of Management and Budget (OMB) implements the Paperwork Reduction Act through regulations governing Federal information collections. The Contactor shall be familiar with OMB’s Guidance on Agency Survey and Statistical Information Collections9 and ensure that all data collection conforms to the OMB regulations, see 5 CFR Part 1320. Federal agencies are required to obtain OMB approval for certain data collections. The initial step in the approval process is to publish a Notice in the Federal Register that notifies the public about the planned information collection and provides sixty (60) days for the public to offer comments. The

9 See OMB website: https://www.whitehouse.gov/wp-content/uploads/legacy_drupal_files/omb/assets/OMB/inforeg/pmc_survey_guidance_2006.pdf https://ntl.bts.gov/ntl/public-access/creating-data-management-plans-extramural-research complete Information Collection Request submitted to OMB includes Supporting Statements A and B, as well as all forms and questionnaires that would be used in the Main Data Collection.

No later than fourteen (14) months after award, the Contractor shall submit a draft Information Collection Request (ICR) 60-Day Notice, Supporting Statements A and B, and any forms participants will complete or that will be used for recruitment, including the Informed Consent Form and the questionnaire (C.6.4). Informaton related to the information collection review process can be located here: https://pra.digital.gov/clearance-process/#issue-a-60-day-request-for-comment-in-the-federal-register.

No later than two (2) weeks after reciept, the COR will either approve the OMB submission, or will contact the contractor for revisions.

No later than sixteen (16) months after award, the Contractor shall address the COR’s comments and submit the second Draft OMB ICR package. Revision submission and feedback shall continue until the documents are ready for submission.

No later than eighteen (18) months after award, the Contractor shall submit a draft final OMB ICR package (not including the 30-day notice) to the COR. Note: for the purpose of developing technical and cost proposals, Offerors shall assume that receiving OMB approval of the final, submitted ICR will take at least fourteen (14) months.

Privacy

Federal law and DOT policy requires that any new information collection be reviewed to assess privacy risk and ensure compliance with privacy requirements when appropriate to protect personally identifiable information (PII).10 Prior to data collection, a Privacy Threshold Assessment (PTA) and, possibly, a Privacy Impact Assessment (PIA) must be completed by NHTSA’s Office of the Chief Information Officer and approved by the Office of the Secretary of Transportation (OST) to ensure that any PII collected for the project is necessary information and to review project protocols for protecting PII to ensure that they are appropriate and sufficient.

The Contractor may have to modify an existing PIA if deemed necessary through the PTA process.

No later than fourteen (14) months after award, the Contractor shall submit the PTA package.

No later than one (1) month after receipt, the NHTSA Privacy Officer will review the PTA and will provide comments to the Contractor via the COR.

No later than one (1) week of receipt of comments, the Contractor shall address the NHTSA Privacy Officer’s comments.

10 See OMB website: https://www.whitehouse.gov/wp-content/uploads/2017/11/203-M-03-22-OMB-Guidance-for- Implementing-the-Privacy-Provisions-of-the-E-Government-Act-of-2002-1.pdf/ https://pra.digital.gov/clearance-process/#issue-a-60-day-request-for-comment-in-the-federal-register https://pra.digital.gov/clearance-process/#issue-a-60-day-request-for-comment-in-the-federal-register

C.6.8 Institutional Review Board Approval

The Contractor shall obtain approval for conducting the research from an Institutional Review Board (IRB) prior to beginning the recruitment of study participants for the Pilot Study and Main Data Collection. The Contractor shall use its own IRB or a certified IRB that is registered and covered by an approved assurance of compliance under the Department of Health and Human Services, Office for Human Research Protections.

No later than nineteen (19) months after award, the Contractor shall submit a draft IRB package for conducting the Pilot Study and the Main Data Collection to the COR.

No later than two (2) weeks after receipt, the COR will provide feedback and the Contractor shall make any revisions necessary to the IRB package until it is accepted. Once the COR approves the Package, the Contractor is responsible for submitting the materials to the selected IRB and responding to any revisions necessary to obtain IRB approval. The COR will be available to assist in answering questions from the IRB.

No later than twenty-one (21) months after award, the Contractor shall have received IRB approval from the selected IRB (proposed by the Contractor) and submit to the COR electronic copies of the approved IRB Package, including all materials submitted to the IRB, and the Approval Letter.

C.6.9 Conduct Pilot Study

No later than twenty-four (24) months after award, (after IRB approval), the Contractor shall conduct a Pilot Study to test the effectiveness of the different aspects of the design and provide a letter report to the COR of the results of the Pilot Study and proposed changes to the protocol.

The Pilot Study does not have to be the same length of time as the Main Data Collection. The Pilot Study shall include nine (9) or fewer participants.

No later than two (2) weeks of receipt, the COR will provide feedback on the report and whether changes should be made to the design or other aspects of the Main Data Collection.

C.6.10 Update Information Collection Request Materials for Submission to OMB based on Pilot Study

No later than twenty-five (25) months of award, based on the findings of the Pilot Study, the Contractor shall update the OMB Information Collection Request Materials to accommodate any necessary changes (if needed), submitting these materials to the COR.

C.6.11 Draft Final Reports’ Introduction, Methods Sections

No later than twenty-eight (28) months after award, the Contractor shall submit the Draft Final Reports’ Introduction and Methods Sections. These shall include complete introduction and methods sections for the two (2) Draft Final Reports (See section C.6.14) one each for Study 1 and Study 2 and outlines for the remaining sections of the reports. The Contractor shall be aware that each Final report shall not exceed sixty (60) pages long (each, excluding appendices) and shall include the following sections:

• Introduction, which may include the literature review conducted in C.6.2 for Study 2

• Methods

• Results

• Discussion

• Conclusions

• References

• Appendices

All print materials shall be provided to the NHTSA COR in the proper format as per Section D.

No later than three (3) weeks after receipt, the COR will contact the Contractor with comments or required revisions.

No later than thirty (30) months after award, the Contractor shall resubmit the two (2) Draft Final Reports’ Introduction and Methods Sections after making the necessary edits.

C.6.12 Develop Dataset Deliverables and Transfer Plan

No later than thirty-two (32) months after award, the Contractor shall submit to the COR the Dataset Deliverables and Transfer Plan. This document shall describe the datasets to be delivered to NHTSA, as well as potential approaches for accomplishing the transfer of the datasets to

NHTSA.

Dataset Deliverables

In the Dataset Deliverables and Transfer Plan, the Contractor shall describe the datasets resulting from this study that will be delivered to NHTSA.

The Contractor shall use machine-readable, open, non-proprietary formats for data capture, unless the format is not available to capture the data. The file or files must be in a format acceptable and readily available to integrate into NHTSA’s data repository without having additional purchases or software or licensing requirements (for example, *.csv or *.txt). Each dataset delivered to NHTSA shall also be accompanied by documentation describing the dataset, e.g., a data dictionary or codebook, relevant meta-data, etc.

At a minimum, the Contractor shall deliver the following datasets to NHTSA:

• Raw Dataset(s): this dataset(s) shall correspond to the raw data collected in the study, from the in-vehicle DAS, the smartphone app(s), and the questionnaires. The dataset may have minimal post-processing applied, e.g., to remove non-driver trips, to remove instances of equipment failure, to transform sensor-specific data to machine-readable formats, to time synch data from multiple sensors, etc. The raw dataset will likely contain PII, e.g., from video cameras included with the in-vehicle DAS.

• Final Reports Analysis Dataset(s): this dataset(s) shall correspond to the dataset(s) used to conduct the descriptive and inferential analyses included in the Final Reports (See Section C.6.16) that address the research questions in Section C.2. This dataset(s) shall be de-identified (per the Safe Harbor method, https://www.hhs.gov/hipaa/for-professionals/privacy/special-topics/de-identification/index.html) and shall be appropriate for public release. In addition to the Final Reports Analysis Datasets and their associated documentation (e.g., data dictionary/codebook, meta-data), the Contractor shall also submit the following materials related to the descriptive and inferential analyses required for the Final Reports (Section C.6.16):

o Programming code or syntax from statistical software used to generate the descriptive and inferential statistical analyses included in the Final Reports, including sufficient information or comments for a user of that software to reproduce the main analyses.

o Information needed to generate any tables or figures included in the Final Reports

(Section C.6.16), e.g., the values of means and confidence intervals plotted in a figure; a series of x-y pairs plotted in a figure; this information shall be contained within a text file or spreadsheet. This information is required in case any figures and tables included in the Final Reports need to be modified to ensure they are compliant with the requirements of Section 508 of the Rehabilitation Act (https://www.section508.gov/). See Section F.5.

Datasets Transfer

In the Dataset Deliverables and Transfer Plan, the Contractor shall also describe potential approaches for transferring the dataset deliverables to NHTSA. Although it is not feasible to transfer the Final Report Analysis Dataset(s) to NHTSA prior to the end of data collection, the Contractor may propose to transfer the Raw Dataset(s) to NHTSA in batches during the data collection period. Potential transfer approaches include, for example, copying the datasets to a NHTSA-specified cloud location or copying data to a NHTSA-owned system that will then be physically connected to the NHTSA storage infrastructure. The plan should also describe the nature of the datasets to be transferred and the estimated size of each dataset.

No later than two (2) weeks after receipt, the COR will submit feedback on the Dataset Deliverables and Transfer Plan. The COR and the Contractor will then work collaboratively with the appropriate offices within NHTSA, including the Office of the Chief Information Officer (OCIO), to further develop the Dataset Deliverables and Transfer Plan, particularly the details of the transfer of the datasets to NHTSA.

No later than thirty-eight (38) months after award, the Contractor will submit the Final Dataset Deliverables and Transfer Plan. The Contractor shall not proceed with any proposed plan for transferring the datasets to NHTSA without approval from the COR.

C.6.13 Recruit Participants, Collect Data, and Conduct Analysis for Main Data Collection

No later than one (1) month after obtaining OMB approval, (and only after IRB and PTA approval), the Contractor shall begin the Main Data Collection.

No later than fifty-two (52) months after award, the Contractor shall have conducted the Main Data Collection of the project and shall provide a letter report to the COR of the results for Studies 1 and 2 (the Contractor may use the letter report as a first draft of the Results sections of the final reports). The report shall include the results of the analyses described in the Data Collection and Analysis Plan (C.6.5).

No later than two (2) weeks after receipt, the COR will provide feedback on the letter report to the Contractor that the Contractor may use in writing the final reports.

C.6.14 Draft Final Reports

No later than fifty-three (53) months after award, the Contractor shall submit a Draft of the two (2) Final Reports, one for Study 1 and one for Study 2, that are formatted and comply with the the Publication manual of the American Psychological Association (APA) 7th Edition style manual, in line with the NHTSA Level 3 report template and Style Guide, and shall be Section 508 compliant (see Section F.5). Each Final Report shall not exceed sixty (60) pages long, single-spaced, (excluding appendices) and shall include the following sections:

• Introduction, which may include the literature review conducted in C.6.2 for Study 2

• Methods

• Results

• Discussion

• Conclusions

• References

• Appendices

No later than three (3) weeks after receipt, the COR will provide the Contractor with comments.

No later than fifty-five (55) months after award, the Contractor shall submit two (2) Revised Draft Final Reports after making the necessary edits to address the COR’s comments.

C.6.15 Final Briefing

Two (2) weeks prior to conducting the final briefing, the Contractor shall submit final briefing materials to the COR.

No later than one (1) week after receipt, the COR will provide comments to the Contractor.

No later than fifty-six (56) months after award, the Contractor shall develop and conduct collaboratively with the COR the final briefing virtually. This virtual briefing shall consist of a 20-30 minute presentation of the studies that includes the background on the project, the methodology for the studies, the results of data analyses for the studies, and a discussion, followed by a question and answer period for the studies.

C.6.16 Revised Drafts of Final Reports

No later than fifty-seven (57) months after award, the Contractor shall submit two (2) Revised Draft Final Reports (Studies 1 and 2), incorporating comments from the final briefings and any other comments received. The COR shall be listed as an author if the COR contributes significantly to the writing and/or design of the project.

No later than three (3) weeks of receipt of the reports, the COR will contact the Contractor to approve the reports or discuss needed revisions.

C.6.17 Journal Article

No later than fifty-nine (59) months after award, the Contractor shall submit one (1) draft journal article to the COR. The Contractor shall ensure the article is ready to be published in a peer-reviewed journal. The COR and Contractor may collaborate on the manuscript. The COR shall be listed as an author if the COR contributes significantly to the writing and/or design of the project.

C.6.18 Data Sets

No later than fifty-nine (59) months after award, the Contractor shall submit the raw and processed datasets and associated documents to NHTSA in accordance with the Dataset Deliverables and Transfer Plan (See Section C.6.12).

(End of Section C)

SECTION D – PACKAGING AND MARKING

FORMATTING TEXT AND IMAGE DELIVERABLES

For those items that must be ready for printing, the following NHTSA guidelines shall be used:

D.1 TEXT

Text files shall be provided in a .DOC, DOCX, or .RTF file format via email, or flash drive using the fewest number of formatting tools as possible (i.e. avoid columns, multiple fonts, etc.). Keep it simple. Avoid using any design/layout elements. If the publication has charts and graphs, the contractor shall insert the chart or graph (produced preferably in Microsoft Excel) at the appropriate locations in the publication.

D.2 CHARTS AND GRAPHS

Charts and graphs should be provided with descripted text and data.

First, they should be inserted within the text as described above so that the Communication Services Division can see what type of chart of graph is desired (i.e., pie chart, bar chart, etc.).

Second, the contractor should include the data files on a flash drive (preferably in Microsoft Excel) that were used to create the either the charts or graphs used in the publication.

D.3 ILLUSTRATIONS

Illustrations can take two forms:

a. Graphics – The Communication Services Division will develop any needed graphics in collaboration with the COR and if desired, the CORs contractor. The Contractors shall provide only the text files in Word to the COR. In the event that it is necessary for the contractor to develop the graphics, only GPO-approved software such as Adobe Illustrator shall be used.

b. Photographs – When photos are used in Agency publications, the Communication Services Division typically uses existing photos or photos purchased through various sources. If a contractor or other source will supply photos for use in a publication, the photos must be high resolution images preferably at 300 dpi (4” by 5” in size) or higher. They should be supplied on a CD (or submitted electronically) in either a tif (usually from a photo that was taken, developed, printed, and then scanned) or a jpg (usually taken using a digital camera and then downloaded onto a computer) file.

NOTE: If a photograph is supplied by an outside source (contractor, grantee, national organization, etc.), a release form must accompany the photo indicating that the human subjects in the photo authorize NHTSA to use the photo in its publications and on its Internet site. In addition, please use caution when allowing contractors to supply photos. Make sure that you know the contractual arrangements they have made with the photographer and the subjects in the photo to ensure that NHTSA has unlimited rights to use the images in print on the web. You must obtain a written statement from your contractor indicating that NHTSA has unlimited, unrestricted use of the photos.

D.4 WEB-BASED IMAGES

Occasionally, web-based images may be used in NHTSA publications. The Contractor is cautioned that copyright laws restrict use of many of these images even if this is not expressly indicated at the website. Additionally, the resolution of most web-based images is not high enough to provide a clear image when published. For these reasons, web-based images should not be used.

(End of Section D)

SECTION E – INSPECTION AND ACCEPTANCE

E.1 52.252-2 CLAUSES INCORPORATED BY REFERENCE (FEB 1998)

The Contract incorporates one or more clauses by reference, with the same force and effect as if they were given in full text. Upon request, the Contracting Officer will make their full text available. Also, the full text of a clause may be accessed electronically at this address: https://www.acquisition.gov/?q=browsefar. The following clauses are hereby incorporated by reference:

52.246-5 INSPECTION OF SERVICES – COST-REIMBURSEMENT (APR 1984)

E.2 INSPECTION AND/OR ACCEPTANCE

The vendor must comply that any research work undertaken and submitted shall be original and free from any form of plagiarism. The vendor represents and warrants that the research work, including all written content, analysis, findings, and citations, is the result of original work and does not infringe upon the intellectual property rights of any third party.

NHTSA expects all works produced under this contract to be of the highest quality and adhere to the highest standards of academic integrity.