693JJ922R000005 Older Driver Research Feasibility Study.pdf

693JJ922R000005

SOLICITATION, OFFER AND AWARD

4. TYPE OF SOLICITATION2. CONTRACT NUMBER 3. SOLICITATION NUMBER

7. ISSUED BY CODE 8. ADDRESS OFFER TO (If other than Item 7)

ORDER UNDER DPAS (15 CFR 700)

6. REQUISITION/PURCHASE NUMBER

NOTE: In sealed bid solicitations "offer" and "offeror" mean "bid" and "bidder".

NEGOTIATED (RFP)

SEALED BID (IFB)

5. DATE ISSUED

1. THIS CONTRACT IS A RATED RATING PAGE OF PAGES

1 67

C. E-MAIL ADDRESS

EXT.NUMBERAREA CODE

B. TELEPHONE (NO COLLECT CALLS)A. NAME

10. FOR

INFORMATION

CALL:

CAUTION: LATE Submissions, Modifications, and Withdrawals: See Section L, Provision No. 52.214-7 or 52.215-1. All offers are subject to all terms and conditions contained in this solicitation.

(Date)(Hour) local timeuntildepository located in copies for furnishing the supplies or services in the Schedule will be received at the place specified in Item 8, or if hand carried, in the

SOLICITATION

9. Sealed offers in original and

PART IV - REPRESENTATIONS AND INSTRUCTIONS

OTHER STATEMENTS OF OFFERORS

EVALUATION FACTORS FOR AWARD

INSTRS., CONDS., AND NOTICES TO OFFERORS

REPRESENTATIONS, CERTIFICATIONS AND

LIST OF ATTACHMENTS

CONTRACT CLAUSES

PART III - LIST OF DOCUMENTS, EXHIBITS AND OTHER ATTACH.

I

J

K

L

M SPECIAL CONTRACT REQUIREMENTS

CONTRACT ADMINISTRATION DATA

DELIVERIES OR PERFORMANCE

INSPECTION AND ACCEPTANCE

PACKAGING AND MARKING

DESCRIPTION/SPECS./WORK STATEMENT

SUPPLIES OR SERVICES AND PRICES/COSTS

SOLICITATION/CONTRACT FORM

PART II - CONTRACT CLAUSESPART I - THE SCHEDULE

H

G

F

E

D

C

B

A

SEC. DESCRIPTION PAGE(S) (X) DESCRIPTION SEC. (X)

11. TABLE OF CONTENTS

18. OFFER DATE17. SIGNATURE

SUCH ADDRESS IN SCHEDULE.

IS DIFFERENT FROM ABOVE - ENTER

15C. CHECK IF REMITTANCE ADDRESS

EXT.NUMBERAREA CODE

15B. TELEPHONE NUMBER

(Type or print)AND

ADDRESS

OF

OFFEROR

CODE FACILITY

16. NAME AND TITLE OF PERSON AUTHORIZED TO SIGN OFFER15A. NAME

DATEAMENDMENT NO.DATEAMENDMENT NO.

and related documents numbered and dated):

amendments to the SOLICITATION for offerors

(The offeror acknowledges receipt of

14. ACKNOWLEDGEMENT OF AMENDMENTS

CALENDAR DAYS (%)30 CALENDAR DAYS (%)20 CALENDAR DAYS (%)10 CALENDAR DAYS (%)

(See Section I, Clause No. 52.232.8)

13. DISCOUNT FOR PROMPT PAYMENT

designated point(s), within the time specified in the schedule.

by the offeror) from the date for receipt of offers specified above, to furnish any or all items upon which prices are offered at the price set opposite each item, delivered at the

NOTE: Item 12 does not apply if the solicitation includes the provisions at 52.214-16, Minimum Bid Acceptance Period.

OFFER (Must be fully completed by offeror)

IMPORTANT - Award will be made on this Form, or on Standard Form 26, or by other authorized official written notice.

28. AWARD DATE

(Signature of Contracting Officer)

27. UNITED STATES OF AMERICA

25. PAYMENT WILL BE MADE BY

26. NAME OF CONTRACTING OFFICER (Type or print)

CODE 24. ADMINISTERED BY (If other than Item 7)

ITEM

(4 copies unless otherwise specified)

23. SUBMIT INVOICES TO ADDRESS SHOWN IN

41 U.S.C. 253 (c) ( 10 U.S.C. 2304 (c) (

22. AUTHORITY FOR USING OTHER THAN FULL AND OPEN COMPETITION:

21. ACCOUNTING AND APPROPRIATION20. AMOUNT19. ACCEPTED AS TO ITEMS NUMBERED

AWARD (To be completed by government)

CODE

693JJ922RQ00003312/06/2021

X

693JJ9

National Highway Traffic Safety Adm Office of Acquisition Management 1200 New Jersey Avenue, S.E.

Washington DC 20590

1400 ET 01/07/2022

DAVID LARSON 202

david.larson@dot.gov

366-4843

X

X

X

X

X

X

X

X

X

X

X

X

X

PAGE(S)

DAVID LARSON

AUTHORIZED FOR LOCAL REPRODUCTION

Previous edition is unusable

STANDARD FORM 33 (Rev. 9-97)

Prescribed by GSA - FAR (48 CFR) 53.214(c)

1-2

4-13 14-15 17-20 21-27 28-35

36-40

42-50

51-63

64-67

12. In compliance with the above, the undersigned agrees, if this offer is accepted within _____0_________ calendar days (60 calendar days unless a different period is inserted

ITEM NO. SUPPLIES/SERVICES QUANTITY UNIT UNIT PRICE AMOUNT

NAME OF OFFEROR OR CONTRACTOR

2 67

CONTINUATION SHEET

REFERENCE NO. OF DOCUMENT BEING CONTINUED PAGE OF

693JJ922R000005

(A) (B) (C) (D) (E) (F)

TITLE: Older Driver Research Feasibility Study

OPTIONAL FORM 336 (4-86)

Sponsored by GSA

FAR (48 CFR) 53.110

NSN 7540-01-152-8067

Request for Proposal

Older Driver Research Feasibility Study

RFP # 693JJ922R000005

PART I - THE SCHEDULE

SECTION B – SUPPLIES OR SERVICES AND PRICES/COSTS

B.1 SUPPLIES/SERVICES

a. The Contractor shall furnish all the necessary qualified personnel and services to perform the effort entitled: “Older Driver Research Feasibility Study” to support the National Highway

Traffic Safety Administration’s (NHTSA), Office of Injury Prevention Research in accordance with the Statement of Work, Section C, and as itemized in Section F, “Deliveries or Performance.” All support services provided to the Government shall be performed by the

Contractor’s employees or personnel otherwise retained by the Contractor to fulfill specific work requirements of the resultant Contract.

b. The Government anticipates award of a Cost-Plus Fixed Fee (CPFF) Contract issued in accordance with FAR 16.306.

B.2 ESTIMATED TOTAL COST AND FEE AMOUNT

The total estimated amount for the resultant Contract is $TBD which comprises of a total estimated cost of $TBD and a fixed fee of $TBD.

Note: The Contracting Officer (CO) is the only individual who can legally commit or obligate the Government to the expenditure of public funds. No cost chargeable to the proposed Contract can be incurred before receipt of a fully executed Contract or specific written authorization from the Contracting Officer.

(End of Section B)

SECTION C – DESCRIPTION/ SPECIFICATIONS/ WORK STATEMENT

C.1 BACKGROUND

The National Highway Traffic Safety Administration (NHTSA) is an agency of the U.S. Department of Transportation (DOT). NHTSA’s mission is to save lives, prevent injuries, and reduce traffic-related health care and other economic costs. The agency develops, promotes, and implements educational, engineering, and enforcement programs with the goal of preventing tragedies and reducing economic costs associated with vehicle use and highway travel.

NHTSA has been directed by Congress to explore the efficacy of smart phone apps as an intervention for older drivers. Congressional staff expressed a particular interest in Road Coach, a smart phone app originally developed to reduce risky driving in teens, based on findings from Older

Driver Support System Field Operational Test (Libby, D., Morris, N. L., & Craig, C. M., 2019)1 that tested effects of the app on a sample of 28 participants with an average age of 69.5. Libby and colleagues reported that RoadCoach use resulted in reduced hard braking events and stop sign violations. Participants’ attitudes toward RoadCoach were generally positive, but some noted that the app's setting for hard braking and stop sign running were too sensitive. While RoadCoach may prove beneficial to older drivers, NHTSA is concerned that an app that provides in-vehicle assistance could pose a distraction to the oldest drivers and that the behaviors the app addresses are not well matched to the behaviors that contribute to crashes among the oldest drivers.

This contract will document the way that the RoadCoach system used by Libby et al., as well as similar smart phone apps, provide support to drivers, including how they determine when to alert the driver to a potentially risky behavior, the information provided to the driver, and the way the information is provided (e.g., visual, auditory). The project will also involve conducting a literature review that explores the kinds of errors most likely to result in crashes among two groups of drivers:

those 18-25 (young adult) and those 75 older (older adult). The literature review will be accompanied by an analysis of NHTSA’s Crash Report Sampling System (CRSS) data to determine specific driving errors associated with crash contribution among young adult and older adult drivers.

These activities will inform a final report that maps RoadCoach’s and the other apps’ features on to the errors associated with crashes among young adult and older adult drivers.

C.2 OBJECTIVE

The objective of this contract is to provide a thorough description of the RoadCoach app's functions, specifically how the system detects and alerts drivers to risky behaviors, identify and describe other driver support smart phone apps, conduct a literature review and crash data analysis to identify driving behaviors commonly associated with crashes among young adult, and older adults drivers, and report the findings in a report that discusses the likelihood that each identified system would be effective in reducing risky driving behaviors among these cohorts of drivers. Because the app was

1 Libby, D. A., Morris, N. L., & Craig, C. M. (2019). Older Driver Support System Field Operational Test. Final Report

CTS 19-13. Roadway Safety Institute. https://rosap.ntl.bts.gov/view/dot/42705 https://rosap.ntl.bts.gov/view/dot/42705 initially developed to reduce risk for teen drivers, the study will also include similar research on teen and young adult drivers.

C.3 GENERAL REQUIREMENTS

The Contractor shall:

1. Document RoadCoach’s functions through describing specific conditions that trigger the sensors, the information the system provides to the driver, and how the system provides this information in terms of feedback timing and modality. This description shall include the relationship between the conditions that trigger RoadCoach and the behaviors RoadCoach is designed to reduce.

2. Conduct a scan to identify other smart phone apps like RoadCoach that claim to improve driver safety. Describe these other smart phone apps, including their functionality and the behaviors they aim to change, and compare and contrast these apps with RoadCoach.

3. Conduct a systematic literature review to explore the kinds of driving errors associated with crashes, particularly crash contribution, among young adult and older adult drivers. Also explore issues related to driver feedback effectiveness based on timing and modality for young adult and older adult drivers. Highlight research literature that explicitly includes studies that sampled participants of different races and ethnicities and socioeconomic status to explore opportunities to increase safety of historically excluded groups.

4. Conduct a crash data analysis of the kinds of driving errors associated with crashes among young adult and older adult drivers.

5. Produce a final report describing findings from the smart phone app scan and review, the literature review, and the crash data analysis. This report shall discuss the extent to which

RoadCoach’s and other apps’ designs, including feedback timing and modality, are optimal for each driver age group, and how they could be expected to change drivers’ behavior under conditions associated with elevated crash risk for each age group. This report shall explain whether RoadCoach could be expected to reduce crash risk for young adult and older adult drivers and whether any of the other apps could be expected to reduce crash risk for these two groups.

C.4 SCOPE OF WORK

The Contractor shall furnish the necessary personnel, equipment, and facilities, and otherwise perform all things necessary for or incidental to the performance of work (the accomplishment of specific requirements) as set forth below in Section C.5.

C.4.1 ACRONYMS

The following is a list of key acronyms used throughout the Statement of Work (SOW). This list may not be exhaustive.

ACOR Alternate Contracting Officer’s Representative

APA American Psychological Association

CO Contracting Officer

COR Contracting Officer’s Representative

CRSS Crash Report Sampling System

CS Contract Specialist

DOT U.S. Department of Transportation

NHTSA National Highway Traffic Safety Administration

SOW Statement of Work

TRID Transportation Research International Documentation

C.5 SPECIFIC REQUIREMENTS

C.5.1 Kick-Off Meeting

Within one (1) month of contract award, the Contractor shall attend a virtual Kick-Off Meeting with the COR, CO and/or CS, and any other interested NHTSA personnel. The purpose of this meeting is to discuss the administration of the Contract and the goal, objective, scope, and anticipated challenges for the effort. The meeting will serve to identify any potential problems and their solutions to ensure successful completion of the project.

This shall also be a working meeting for the Contractor and NHTSA, allowing up to four (4) hours for the meeting. The COR will take the lead in the discussions and provide the background for the project. The Contractor shall then discuss the approach for accomplishing the contract objectives and include the understanding of project objectives and design, schedule of project activities and understanding of deliverable requirements and specifications.

The Contractor shall work with the COR prior to the meeting to prepare appropriate briefing materials on the approach. Materials for the Kick-Off Meeting shall be completed and submitted to the COR for review and approval at least one (1) week prior to the Kick-Off Meeting. The

COR will send feedback to the Contractor on Kick-Off Meeting materials within three (3) days of receipt. The Contractor shall submit revised Kick-Off Meeting Materials at least one (1) day before Kickoff Meeting.

C.5.2 Chapter Topics Plan

The objective of this task is to develop, refine, and finalize the chapters for the Draft Final Report

(C.5.7); the remaining tasks shall follow from decisions made in this one. The Chapter Topics Plan shall contain detailed information about the content, scope, and organization of each chapter.

Each chapter shall present a summary and synthesis of the findings relevant to that chapter. Each chapter shall address similarities and differences between findings for young and older adult drivers.

When writing each chapter, the Contractor shall be aware that it is not useful to have the chapter be, at one extreme, essentially a list of findings (e.g., a list of abstracts or an annotated bibliography).

On the other hand, it is not useful to only present a set of conclusions about chapter topics that are too abstracted or go beyond what the body of research supports.

Below is a list of chapters and topics that shall be included in the report. However, the Contractor shall propose the nature and organization of topics within each chapter and shall suggest any additional chapters or topics they believe are critical for covering the breadth or depth of the topic.

Note that each chapter should, to some extent, inform the next.

Chapters within the final report shall include, but are not limited to:

1. Smart Phone Driver Support Apps Scan. This first chapter shall explain the reason for the study in terms of crash risk for young and older adult drivers. It shall describe how smart phone apps can influence driver behaviors. Topics shall include, but are not limited to:

a. Discussion of the behaviors that smart phone apps have the potential to change.

Discuss mechanisms the apps employ to detect potentially risky driver behaviors or situations and the way they alert drivers to those behaviors.

b. A description of smart phone apps (other than RoadCoach) available to the public that are advertised to enhance driver safety, and a brief description based on marketing materials of how these apps detect and alert drivers to potentially risky behaviors, and any information about their effects on driver behaviors including unintended consequences (e.g., driver distraction).

c. A description of RoadCoach’s sensors, and of behaviors or conditions that trigger the app. Discuss how sensitive RoadCoach is to various driver behaviors (e.g., hard braking), and how those sensitivity levels were selected, and how these characteristics compare to those of other apps identified in 1(b).

d. An explanation of the quantity and type of information RoadCoach provides to the driver, including any delay between an event/behavior and system feedback as well as feedback modality and how this was selected; discuss how this compares to information provided by other apps identified in 1(b)..

e. A discussion of how the conditions that trigger smart phone driver support apps relate to behaviors RoadCoach is designed to change.

2. Systematic Literature Review. This chapter shall describe methods and findings from a systematic literature review exploring driving behaviors and errors associated with crashes, focusing on those related to behaviors that smart phone apps address, and on the effectiveness of apps designed to change driver behavior. This chapter shall not include research related to alcohol and/or drug impaired driving. Documents used in the review shall include peer-reviewed journals, conference proceedings, State and Federal Government reports (including NHTSA reports), and grey literature. Each topic in the chapter shall address findings on young adults and on older adults and shall discuss how young and older drivers’ experiences/responses are similar and how they differ, particularly in terms of behaviors that can be addressed by a smart phone app. This chapter shall highlight research literature that explicitly sampled participants of different races and ethnicities and socioeconomic status to explore opportunities to increase safety of historically excluded groups. Chapter topics shall include but are not limited to:

a. Systematic literature review methodology.

b. Findings regarding characteristics most often associated with crashes: What types of crashes (e.g., intersection crashes, loss of control, distracted driving) are more typical of young adult drivers, of older adult drivers, and common to both age groups?

c. Findings regarding driver feedback effectiveness: What factors (e.g., feedback timing and modality, feedback validity) are associated with effective driver feedback like that provided by smart phone apps, and do these factors differ for younger and older drivers? What unintended consequences are likely to emerge?

d. Findings regarding driver acceptance of such systems: What system features are associated with higher user acceptance, and does this differ between younger and older users?

3. Data Analysis. This chapter shall describe CRSS crash data analysis to confirm the literature review findings identified in Chapter 2 regarding crash types that are common among young drivers, older drivers, and to both groups. The chapter shall discuss data selection and analysis methods and findings. Each topic within the chapter shall address driver behaviors and/or traffic situations associated with crashes in young adults and in older adults and shall discuss how young and older drivers’ experiences/responses are similar and how they differ.

The analysis must use appropriate sample weights and hypothesis testing that considers the complex sample design. Topics shall include but are not limited to:

a. Crash characteristics

i. Crash configuration (e.g., head-on, angle).

ii. Movement prior to critical event (e.g., passing, turning).

iii. Initial impact point (e.g., front/corner, left side).

b. Roadway characteristics

i. Speed limit.

ii. Number of traffic lanes.

iii. Junction/non-junction.

iv. Traffic control type.

4. Discussion and Conclusions. This chapter shall summarize findings from the smart phone driver support app scan (Chapter 1), the literature review (Chapter 2), and the crash data analysis (Chapter 3), highlighting areas where RoadCoach and other apps are well-matched to driver errors, and those where they are not, comparing and contrasting findings for young adult and older adult drivers. This chapter shall discuss the extent to which RoadCoach’s, and other app’s, designs, including feedback timing and modality, are optimal for each driver age group’s crash types, and how they could be expected to change drivers’ behavior under conditions associated with elevated crash risk for each age group. This chapter shall explain whether RoadCoach could be expected to reduce crash risk for young adult and older adult drivers and whether any of the other apps could be expected to reduce crash risk for these two groups

The Contractor is free to recommend and justify inclusion of other topics to be considered for inclusion.

The Chapter Topics Plan shall refine and finalize the above topics, including any proposed additional chapter topics. The plan shall provide detail about the topic for each chapter, as well as the sub-topics within each chapter that will contribute to the overall chapter topic. When developing the Chapter Topics Plan, the Contractor shall do an initial brief scan of the literature and the CRSS database to obtain the information necessary to refine and finalize the chapter topics.

The Contractor shall submit the Chapter Topics Plan within two (2) months of contract award; the

COR will give feedback on the plan to the Contractor within two (2) weeks of receipt.

The Contractor shall submit the revised Chapter Topics Plan within three (3) months of contract award.

C.5.3 Smart Phone Driver Support Apps Scan

The objective of this task is to develop and then carry out a plan to collect and discuss information about driver support smart phone apps and specifically about RoadCoach. The Plan shall provide details regarding how the scan will be conducted and synthesized to address each topic identified for this chapter under C.5.2.

Within four (4) months of contract award, the Contractor shall submit a Draft Smart Phone

Driver Support Apps Plan documenting how the Contractor will address each topic listed in C.5.2.

The COR shall review the Draft Final Report and submit comments within two (2) weeks of receipt.

Upon receipt of COR approval of the Draft Smart Phone Driver Support Apps Plan, the Contractor shall carry out the plan as described under C.5.2.

Within six (6) months of contract award, the Contractor shall submit the draft Smart Phone Driver

Support App chapter. The COR will submit comments on the Chapter Draft within two (2) weeks of receipt.

Within seven (7) months of contract award, the Contractor shall submit the revised draft

Smart Phone Driver Support App chapter that addresses all COR comments.

C.5.4 Systematic Literature Review

The objective of this task is to develop a plan to conduct the systematic literature review that will address the topics determined under C.5.2. The Systematic Literature Review Plan shall describe how the review will be conducted, as well as additional information that may be unique to a topic.

The Contractor shall review original research studies or reviews of original research published between 2014 and the date of the review. The plan will also explain how the Contractor plans to extract the necessary information from and critically evaluate each study selected for inclusion in the literature review. While it is not necessary for the Contractor to evaluate study quality in a quantitative way, the Contractor shall, at a minimum, describe procedures for qualitatively, but systematically, assessing each study’s quality. For each topic, the Contractor shall identify commonalities or, where relevant, discrepancies in findings while simultaneously considering the quality of the information source.

The Systematic Literature Review Plan shall include, but is not limited to:

• A list of sources that will be searched to identify relevant studies, including studies published in peer-reviewed journals, conference proceedings, State and Federal Government reports (including NHTSA reports), grey literature, and any other sources the Contractor believes relevant. Sources may include, for example, Google Scholar, Web of Science, Transportation Research International Documentation (TRID), and PsycINFO.

• General criteria for inclusion/exclusion that will be applied to all topics (e.g., English language publication, date of publication).

• The overall procedure or method the Contractor shall use to identify and review relevant abstracts, including how any disagreements about study inclusion will be resolved. The

Contractor shall also explain how existing reviews or meta-analyses on a chapter topic will be treated in the review.

• The specific search strings (including Boolean operators) that will be used to identify relevant studies for the chapter in the above databases or other sources; and

• Any inclusion/exclusion criteria specific to a topic.

• Procedures for extracting the relevant information from each study (e.g., methods, results, and conclusions) for later use in the narrative synthesis of results.

• Factors to be considered when evaluating study quality, including internal validity (e.g., in a case-control experimental design, the way in which controls were selected), external validity

(e.g., the relevance of the outcome measure to crash risk), as well as any other risks to study quality identified by the Contractor (e.g., conflicts of interest among study authors).

• Procedures for evaluating study quality, for example, which staff will assess study quality, how conflicts between assessors regarding study quality will be resolved, and how assessments of study quality will be used in the narrative synthesis of results.

o To assist in identifying appropriate questions regarding study quality, the Contractor shall consult study quality scales such as the Newcastle-Ottawa Scale2 and the RTI

Item Bank;3 the Contractor shall also be guided by similar procedures used in other high-quality systematic reviews.

Within seven (7) months of contract award, the Contractor shall submit to COR a draft

Systematic Literature Review Plan. The COR will return comments on the documents within two (2) weeks of receipt.

Upon receipt of COR approval of the Systematic Literature Review Plan, the Contractor shall carry out the plan to address the topics described under C.5.2.

2 Wells, G. A., O’Connell, D., Peterson, J., Welch, V., Losos, M., & Tugwell, P. (n.d.). The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Retrieved June 15, 2018, from http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp 3 Viswanathan, M., & Berkman, N. D. (2012). Development of the RTI item bank on risk of bias and precision of observational studies. Journal of

Clinical Epidemiology, 65(2), 163–178. https://doi.org/10.1016/j.jclinepi.2011.05.008

Within 9 (nine) months of contract award, the Contractor shall submit the draft Systematic

Literature Review chapter. The COR will submit comments on the Chapter Draft within two (2) weeks of receipt.

Within eleven (11) months of contract award, the Contractor shall submit the revised draft

Systematic Literature Review chapter that addresses all COR comments.

C.5.5 Crash Data Acquisition and Analysis

The objective of this task is to develop a plan to conduct an analysis of CRSS data that will comprise the data analysis chapter of the report to address the topics determined under C.5.2.

Information from the literature review shall inform selection of CRSS variables to include in the analyses. For each crash type or driver behavior in the analysis, the chapter shall discuss whether it occured in similar proportions for young adult and older adult drivers, or whether one age group was over-represented compared to the other. The Crash Data Acquisition and Analysis Plan shall describe inclusion criteria, justification for each variable and describe how cases meeting those criteria will be coded, organized and analyzed.

The data analysis plan shall include, but is not limited to:

• Method to use in developing CRSS data files.

• Driver, crash, and roadway variables selected for inclusion.

• Planned data analyses to identify significant group differences. All estimates must use the sample weights, and testing of statistical significance using CRSS data must must use standard errors adjusted for the sample design and weights.

Within eleven (11) months of contract award, the Contractor shall submit to COR a draft Crash

Data Acquisition and Analysis Plan. The COR will return comments on the documents within two

(2) weeks of receipt.

Upon receipt of COR approval of the Crash Data Acquisition and Analysis Plan, the Contractor shall carry out the plan to address the topics described under C.5.2.

Within thirteen (13) months of contract award, the Contractor shall submit the draft Crash Data

Acquisition and Analysis chapter. The COR will submit comments on the Chapter Draft within two

(2) weeks of receipt.

C.5.6 Discussion and Conclusions

The objective of this task is to summarize findings from the previous chapters, and to discuss the extent to which the RoadCoach app, and other similar apps, would be expected to reduce young adult and older adult driver behaviors associated with crashes as described in the literature review and CRSS data analysis. The discussion shall also cover the extent to which the apps’ feedback timing and modality are optimal for each age group based on findings from the literature review.

The discussion shall address the topics listed for this chapter under C.5.2.

Within fifteen (15) months of contract award, the Contractor shall submit the draft Discussion and Conclusions chapter.

The COR will submit comments on the Chapter Draft within two (2) weeks of receipt.

C.5.7 Prepare Draft Final Report

The objective of this task is to create a Draft Final Report that provides the results of the research activities that comprise each chapter. The Draft Final Report shall include: Technical

Documentation page, Executive Summary, and each chapter identified in the Chapter Topics Plan

(Section C.5.2). The Draft Final Report shall adhere to standards detailed in the 6th Edition, Publication Manual of the American Psychological Association (APA).

Individual chapters in the Draft Final Report must each present a summary and synthesis of the findings relevant to that chapter. When writing each chapter, the Contractor shall be aware that it is not useful to have the chapter be, at one extreme, an unconnected list of abstracts or data analyses.

On the other hand, it is not useful to only present a set of conclusions about a chapter topic that are too abstracted from individual findings or go beyond what the chapter content supports.

Within eighteen (18) months of contract award, the Contractor shall submit a Draft Final Report that contains the findings relevant to each chapter. The COR shall review the Draft Final Report and submit comments within two (2) weeks of receipt.

Within twenty-one (21) months of contract award, the Contractor shall resubmit the Draft Final

Report after making the necessary edits suggested by the COR.

The COR shall be listed as an author if the COR contributes significantly to the writing of the report. Order of authorship shall reflect the relative contributions of the authors.

C.5.8 Final Briefing

Within twenty-two (22) months of contract award, the Contractor shall develop and conduct collaboratively with the COR a Final Briefing for this contract at NHTSA Headquarters in

Washington, DC. The Final Briefing shall consist of a 20- to 30-minute presentation of the project that includes the background of the project, a description of the specific tasks conducted, and the study’s findings, followed by a question and answer period. Materials for the Final Briefing Meeting shall be completed and submitted to the COR for review and approval at least one (1) week prior to the Final Briefing Meeting. The COR will send feedback to the Contractor on Final Briefing

Meeting materials within 3 days of receipt.

C.5.9 Revised Draft Final Report

Within one (1) month after the Final Briefing, the Contractor shall submit a Revised Draft Final

Report that incorporates comments from the Final Briefing and agency review (if available). The

COR shall submit comments within three (3) weeks of receiving the Revised Draft Final Report.

C.5.9 Submit Final Report & Materials

Within twenty-four (24) months of contract award, the Contractor shall submit the Final Report, incorporating any remaining comments or edits generated from agency review, the Final Briefing, or the COR.

Along with the Final Report, the Contractor shall also submit all copies of journal articles or study publications included in the review, any databases that were used to manage references, CRSS analysis data set, and any other materials that were created and used during the project (e.g., forms used when extracting study results or evaluating study quality).

(End of Section C)

SECTION D - PACKAGING AND MARKING

D.1 GENERAL INSTRUCTIONS

Preservation and packaging of all shipments or mailing of all work delivered under this contract shall be done in accordance with good commercial practices and to insure acceptance by common carrier (if applicable) and safe transportation at the most economical rate(s).

Any deliverables required by this contract shall be submitted to the applicable personnel identified in Section F of this contract. Due to security concerns, deliverables transmitted via regular U.S.

Mail experience significant delay in reaching an intended destination and, as part of the screening process, may be damaged. For these reasons, the U.S. Mail should not be used to transmit deliverables. Rather, the Contractor is encouraged to use electronic mail to the maximum extent possible.

D.2 FORMATTING TEXT AND IMAGE DELIVERABLES

For those deliverables submitted electronically as text or image files, the following specifications apply.

D.2.1 Text

Text files shall be delivered in Microsoft WORD 2016 format. Font type of Times New Roman with a font size of 12 shall be used throughout the document. The Contractor shall minimize additional formatting as much as possible (e.g., avoid use of columns) Avoid using any design/layout elements (however, see D.2.2, D.2.3, and D.2.4 below).

D.2.2 Charts and Graphs

The Contractor shall develop charts or graphs using Microsoft EXCEL 2016 and shall insert these in the appropriate places within the text document. The Contractor shall also provide the Microsoft

EXCEL source file from which charts or graphs were developed.

D.2.3 Illustrations

NHTSA’s Office of Communication Services is responsible for developing or acquiring most illustrations found in NHTSA publications. These illustrations can take two forms:

Graphics – In the majority of cases, the Office of Communication Services will develop any needed graphics in collaboration with the COR. The Contractor shall provide text, graphs, and charts following the guidelines stipulated in D.2.1 and D.2.2 above. In some cases, the Contractor may be required to develop graphics. In these cases, the Contractor shall use only software approved by the

U.S. Government Printing Office (e.g. Adobe Illustrator).

Photographs – When photos are used in Agency publications, the Office of Communication

Services typically uses existing photos or photos purchased through royalty-free sources. In the event the Contractor must supply photos for use in a publication, the photos must be high resolution images at least 300 dpi at the size used in the publication. Photos shall be supplied on a CD or DVD in either .tif format (for scanned images) or .jpg (for images downloaded to the CD or DVD directly from the digital camera).

NOTE: If a photograph is supplied by an outside source (Contractor, grantee, national organization, etc.), a release form must accompany the photo indicating that the human subjects in the photo authorize NHTSA to use the photo in its publications and on its Internet site. The Contractor is responsible for ensuring that the necessary arrangements have been made with the photographer and the subjects in the photo to ensure that NHTSA has unlimited rights to use the images in print and on the web. The Contractor shall obtain, and provide to NHTSA, a written statement indicating that

NHTSA has unlimited, unrestricted rights to the use of the photos.

D.2.4 Web-based Images

Occasionally, web-based images may be used in NHTSA publications. The Contractor is cautioned that copyright laws restrict use of many of these images even if this is not expressly indicated at the website. Additionally, the resolution of most web-based images is not high enough to provide a clear image when published. For these reasons, web-based images should not be used.

(End of Section D)

SECTION E - INSPECTION AND ACCEPTANCE

E.1 FAR 52.252-2 CLAUSES INCORPORATED BY REFERENCE (FEB 1998)

The contract incorporates one or more clauses by reference, with the same force and effect as if they were given in full text. Upon request, the Contracting Officer will make their full text available.

Also, the full text of a clause may be accessed electronically at this address:

https://www.acquisition.gov/?q=browsefar.

NOTE: Those clauses marked with an “X” are hereby incorporated by reference.

[X] 52.246-5 Inspection of Services. Cost Reimbursement. (APR 1984)

E.2 INSPECTION AND/OR ACCEPTANCE

The COR shall also be responsible to the Contracting Officer for recommending acceptance or replacement/correction of nonconforming supplies or services that fail to meet the Contract requirements. Rejection of a final report will delay final payment of costs due under the Contract.

The most common causes for rejecting final reports are:

a. Incomplete description of the work objective and its relationship to other work performed in the area,

b. Inadequate description of methodology,

c. Insufficient or inconsistent technical information to support the findings or conclusions,

d. Poorly conceived graphs, charts, and displays

e. Incorrect spelling and grammar.

(End of Section E) https://www.acquisition.gov/?q=browsefar

SECTION F – DELIVERIES OR PERFORMANCE

F.1 FAR 52.252-2 CLAUSES INCORPORATED BY REFERENCE (FEB 1998)

This contract incorporates one or more clauses by reference, with the same force and effect as if they were given in full text. Upon request, the Contracting Officer (CO) will make their full text available. Also, the full text of a solicitation provision may be accessed electronically at this/these address: www.acquisition.gov/far/.

Federal Acquisition Regulation (FAR) Clauses:

CLAUSE TITLE DATE

X 52.242-15 Stop Work Order AUG 1989

X 52.247-35 F.O.B. Destination, Within Consignee’s Premises APR 1984

F.2 PERIOD OF PERFORMANCE

All work required hereunder, including preparation, submission, review of any and all reports, shall be completed within the twenty-four (24) months from the effective date of the contract award.

F.3 PERFORMANCE MILESTONES (M) AND DELIVERABLES (D)

F.3.1 MILESTONES / DELIVERABLES SCHEDULE

The following milestone and deliverables apply to this Contract and are considered important to the successful completion of the project:

Item Task Deliverables (D) & Milestones (M) Due Date

1 C.5.1 Submit Kick-Off Meeting materials (D) At least 1 week prior to

Kick-Off Meeting

2 C.5.1 COR submits feedback on Kick-Off Meeting materials (M)

Within 3 days of receipt

3 C.5.1 Submit Revised Kick-Off Meeting materials

(D)

At least 1 day prior to Kick-

Off Meeting

4 C.5.1 Kick-Off Meeting (M) Within 1 month of contract award

5 C.5.2 Submit Chapter Topics Plan (D) Within 2 months of contract award 6 C.5.2 COR provides feedback on plan (M) Within 2 weeks of receipt

7 C.5.2 Submit revised Chapter Topics Plan (D) Within 3 months of contract award http://www.acquisition.gov/far

8 C.5.3 Submit Smart Phone App Scan Plan (D) Within 4 months of contract award

9 C.5.3 COR provides feedback on plan (M) Within 2 weeks of receipt

10 C.5.3 Begin Smart Phone App Scan (M) Upon COR approval of plan

11 C.5.3 Submit Draft Smart Phone App Chapter (D) Within 6 months of contract award

12 C.5.3 COR provides feedback on chapter (M) Within 2 weeks of receipt

13 C.5.3 Submit Revised Smart Phone App Chapter (D) Within 7 months of contract award

14 C.5.4 Submit Literature Review Plan (D) Within 7 months of contract award

15 C.5.4 COR provides feedback on plan (M) Within 2 weeks of receipt

16 C.5.4 Begin Literature Review (M) Upon COR approval of plan

17 C.5.4 Submit Draft Literature Review Chapter (D) Within 9 months of contract award

18 C.5.4 COR provides feedback on chapter (M) Within 2 weeks of receipt

19 C.5.4 Submit Revised Literature Review Chapter

(D)

Within 11 months of contract award

20 C.5.5 Submit Data Acquisition and Analysis Plan

(D)

Within 11 months of contract award

21 C.5.5 Begin Data Acquisition and Analysis (M) Within 11 months of contract award

22 C.5.5 Submit Data Acquisition and Analysis Chapter

(D)

Within 2 weeks of receipt

23 C.5.5 COR provides feedback on chapter (M) Within 13 months of contract award

24 C.5.5 Submit Revised Data Acquisition and

Analysis Chapter (D)

Within 2 weeks of receipt

25 C.5.5 Submit Draft Discussion and Conclusions

Chapter (D)

Within 14 months of contract award

26 C.5.6 COR provides feedback on chapter (M) Within 15 months of contract award

27 C.5.5 Submit Draft Final Report (D) Within 2 weeks of receipt

28 C.5.6 COR provides feedback on Draft Final Report

(M)

Within 18 months of contract award

29 C.5.6 Submit Draft Final Report after edits (D) Within 2 weeks of receipt

30 C.5.6 Submit Final Briefing Materials (D) Within 21 months of contract award

31 C.5.7 COR provides feedback on Final Briefing

Materials (M)

At least one week before

Final Briefing

32 C.5.7 Final Briefing (M) Within 3 days of receipt

33 C.5.7 Begin Data Acquisition and Analysis (M) Within 22 months of contract award

34 C.5.8 Submit Revised Draft Final Report (D) Within 1 month after final briefing

35 C.5.8 COR provides feedback on Revised Draft

Final Report (M)

Within 2 weeks of receipt

36 C.5.9 Submit Final Report and Materials (D) Within 24 months of contract award

37 F.4.1 Submit Monthly Reports (D) Ongoing, on the 10th of each month

F.4 PLACE OF DELIVERY:

Unless otherwise specified, deliverables shall be furnished, electronically, to the following addresses:

Item No. Address

1, 3, 5, 7, 8, 11, 13, 14, 17, 19, 20, 22, 24, 25, 27, 29, 30, 34, 36, 37

Department of Transportation

National Highway Traffic Safety Administration (NPD-120)

Attention: TBD at Contract Award

1200 New Jersey Avenue, SE, WXX-XXX

Washington, DC 20590

Telephone: 202-366-XXX

Email: TBD@dot.gov

Department of Transportation

National Highway Traffic Safety Administration

Office of Acquisition Management

Attention: David Larson

1200 New Jersey Avenue, SE, W53-411

Washington, DC 20590

Telephone: 202-366-4843

Email: David.Larson@dot.gov mailto:TBD@dot.gov mailto:David.Larson@dot.gov

F.4.1 MONTHLY REPORTS

The contractor shall furnish the report electronically to the COR by the 15th of each month following the month being reported. At a minimum, the progress report shall include a narrative description of the following items:

• Accomplishments made during the reporting period

• Funds status by major cost element, month's obligations, cumulative obligations estimated cost to complete, and percent of cost expended versus percent of completion

• Plans for accomplishments in next reporting period

• Preliminary or interim results, conclusions, trends, or other items of information that the

Contractor believes are of interest to NHTSA problems or delays that the Contractor has experienced and possible solutions for remedying these problems or delays, and

• Specific action that the Contractor would like NHTSA to undertake to alleviate a problem, and

• Due dates for remaining deliverables.

F.5 COMPLIANCE WITH REHABILITATION ACT

All electronic and information technology procured, developed, or delivered under this contract shall meet applicable accessibility standards, as specified in 36 CFR Part 1194. 36 CFR Part 1194 implements Section 508 of the Rehabilitation Act of 1973, as amended, and is viewable at http://www.section508.gov.

All contract deliverables covered by Section 508 shall be accessible to people with disabilities.

Reports and other deliverables provided in electronic media, including web-based intranet and internet format shall conform to applicable accessibility standards, including at a minimum, the following provisions:

1194.21, Software Applications and Operating Systems

1194.22, Web-Based Intranet and Internet Information and Applications

1194.24, Video and Multimedia Products

1194.31, Functional Performance Criteria

1194.41, Information, Documentation, and Support

This standard is available for viewing at the Access Board web site at:

https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7

C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-

84800576932015:loc-

190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=

3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other

(End of Section F) http://www.section508.gov/ https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other https://learn.essentialaccessibility.com/508-accessibility-checklist?utm_term=508%20rules&utm_source=bing&utm_medium=ppc&utm_campaign=508+%7C+PH&hsa_net=adwords&hsa_grp=1356798508960136&hsa_mt=e&hsa_tgt=kwd-84800576932015:loc-190&hsa_kw=508%20rules&hsa_src=o&hsa_acc=4319570901&hsa_cam=13920189549&hsa_ver=3&hsa_ad=&msclkid=c9fde1f261de1b82454a806c7c2448a3&utm_content=508%20%7C%20Other

SECTION G – CONTRACT ADMINISTRATION DATA

G.1 PAYMENT/COST REIMBURSEMENT

The Contractor may request interim payments for costs incurred during the performance of the

Contract. A statement of costs incurred by the Contractor in the performance of tasks under this

Contract and claimed to constitute allowable costs shall support each interim payment request.

The Contractor is encouraged to submit Monthly Requests for Reimbursement. Requests for reimbursement must correspond to the Contractor’s submission of a progress report for the period of performance being invoiced.

Any request for reimbursement that does not correspond to a progress report detailing Contract activity for the period of time being invoiced is cause for rejection by the COR. If a request for reimbursement is rejected by the COR, the Contractor must resubmit the invoice after it has submitted the corresponding progress report to the COR.

The Contractor shall include a copy of each Contract staff member’s time sheet with each invoice submitted to assist in determining the accuracy of the time submitted for payment.

G.2 INDIRECT COST RATES

Pending the establishment of final indirect cost rates which shall be negotiated based on audit of actual costs as provided in FAR Subpart 42.7, Indirect Cost Rates, the Contractor shall be reimbursed for allowable indirect costs hereunder at the rates established below.

a. Fringe Benefit

The fringe benefit rate(s) applicable to this Contract is/are as follows:

RATE TYPE RATE BASE EFFECTIVE PERIOD

TBD

b. Overhead

The overhead rate(s) applicable to this Contract is/are as follows:

c. General and Administrative (G&A)

The G&A rates applicable to this Contract are as follows:

NOTE:

a. applied to:

b. applied to:

c. applied to:

To prevent substantial over or under payment, and to apply either retroactively or prospectively, provisional rates may, at the request of either party, be revised by mutual agreement on an annual basis.

This Indirect Cost provision does not operate to waive the LIMITATION OF FUNDS Clause

(incorporated by reference in Section I). The Contractor's audited final indirect costs are allowable only insofar as they do not cause the Contractor to exceed the total estimated costs for performance of the Contract listed in Section B.

G.3 BILLING RATES

The direct labor rates and the provisional indirect rates negotiated under this Contract for billing purposes shall remain in effect until revised rates have been approved in writing by the Contracting

Officer. The Contractor shall request new provisional billing rates in writing. Such requests shall delineate the current and proposed rates to be used, along with the effective rate of escalation.

G.4 TRAVEL AND PER DIEM RATES

Travel costs will be reimbursed in accordance with FAR Part 31.

G.5 NHTSA CONTRACTING OFFICER REPRESENTATIVE (COR)

The performance of the work required under the Contract shall be subject to the technical review of the COR.

The following individual has been designated as the COR:

[To Be Provided At time of Contract Award]

a. The Contracting Officer will designate a technical representative to assist in monitoring the work under the resultant Contract. The COR serves as the technical liaison with the Contractor. The

COR is not authorized to change the scope…