NWWM20002300014 SOW 07142023.pdf

Statement of Work (SOW) Social and behavioral research on National Weather Service (NWS) Tsunami Messaging and

Alerting System

NWWM20002300014

For reference: Heat SOW; Haz Simp SOW

I. Background

The National Weather Service (NWS) Tsunami Program supports the National Oceanic and Atmospheric Administration’s( NOAA’s) Tsunami Warning Centers (National Tsunami Warning Center—NTWC—in Palmer AK and the Pacific Tsunami Warning Center—PTWC— in Honolulu HI) in their efforts to deliver effective tsunami alerts and other messaging products to the public. These products are primarily divided between Tsunami Watches (potential tsunami generation, but impacts unknown), Tsunami Warnings (tsunami inundation in excess of 1m expected) or Tsunami Advisories (widespread inundation *not* expected but dangerous water current activity anticipated, requiring rapid response in localized areas to avoid loss of life and property).

Tsunamis and their impacts can vary widely throughout the event lifecycle both in time and space. Those impacts can range from minimal impact, to primarily a maritime hazard, to significant and fast moving coastal inundation. Many factors can contribute to the level of impacts observed. It is critical to the NWS mission that Tsunami alert products quickly and effectively communicate the hazard as well as the dynamic nature of a tsunami event. All levels of end users of tsunami products must be able to understand the risk and make effective and quick decisions.

This effort seeks to connect the Tsunami alert messages to the NWS Hazard Simplification (Haz Simp) project. The Haz Simp project has assessed the NWS Watch, Warning, Advisory alerting system in an effort to improve the effectiveness of messaging across all program areas. Years of social science research and engagement led to the decision to eliminate the term Advisory in favor of plain language headlines. However, specific engagement with key tsunami partners and stakeholders emphasized the well established nature of the current tsunami alerting system, including the use of “Advisory.” Partners and stakeholders raised concerns around Advisory confusion and challenges in translating “Advisory” into other languages, with little agreement on a suitable alternative or path forward. The NWS would like to perform a rigorous social science study, along with partner engagement to inform next steps for the Tsunami alert messages that also aligns with the Haz Simp paradigm.

To investigate potential tsunami messaging enhancements and inform the application of the Haz Simp paradigm within the Tsunami program, the NWS must first obtain a baseline for how current tsunami alerts are being used and understood. Additionally, there needs to be a better understanding of how well each of the tsunami alerts compliment one another during a basin https://docs.google.com/document/d/1sUtukkDwg58pTX9C2EtKE2GB3Gm-fN4dTn4qRjawPDI/edit https://docs.google.com/document/d/1punJb-UVL6ZfIAMWWeQlu_h4FeoT4kIpK0s81Co1zTc/edit#heading=h.gjdgxs wide event (e.g. Are the terms and messaging working together during complex upgrade and downgrade scenarios?).

As such, this SOW will focus on understanding the impact and efficacy of our current tsunami alerting system and recommend a path forward for change. The final results will provide a recommendation on headlines and messaging that functions well throughout the entire event to include differentiating between maritime and land tsunami threats across nearby and distant geographies. The final recommendations should also take into account a diverse audience with varying information needs. The ultimate goal is to develop improved products and information that will increase the likelihood of the public and partners taking appropriate action to protect their life and property when faced with a tsunami event.

II. Scope / Description of Work

The purpose of this study is to evaluate the effectiveness and clarity of the current NWS Tsunami headline terms and the body of the alert messages. In addition, the study will test new potential terminology and messaging with the public, core partners, and stakeholders in order to recommend changes to the alerting system while clearly describing the hazard, risks to maritime or land interests. Headlines and messages tested in this study must be compatible with established dissemination and communications methods. Specifically, the study should be designed to examine how well the product suite operates as a whole (i.e. each product works in concert with the others to effectively show the dynamic nature of the threat).

The contractor shall accomplish this by employing relevant social science methodologies such as but not limited to targeted surveys, focus groups, and/or structured interviews. The appropriate methodologies will be proposed by the contractor and discussed and agreed upon with the NWS team during the kick-off and subsequent progress meetings.

The contractor shall design and execute a study that recommends potential changes to the current NWS Tsunami alerting system by answering the following research questions:

1. How well understood and actionable are the messages in the current tsunami alerting system including headline terms, the body of the alert message, and the suite as a whole?

2. How established is the current Tsunami alert system, in particular is the alert system institutionalized in processes and policies with our partners and stakeholders?

3. What are the downstream impacts on our partners and stakeholders if changes are made to the current tsunami alert system?

4. What aspects of the current system are working well and does this vary depending on the audience?

5. What aspects of the current system are NOT working well and does this vary depending on the audience?

6. What are possible improvements that could better convey the dynamic nature of the threat?

7. How can the NWS better reach a broader, more diverse audience to improve service equity?

The contractor shall complete a report that describes the methods, results, and implications of the above study. The report shall include recommendations on headlines and language to messages that effectively and equitably convey the nature of the tsunami hazard throughout the entire event.

III. Tasks

1. Kick-off meeting Facilitate and participate in a kick-off meeting with the project team to communicate goals and objectives of the project, roles and responsibilities of the project team members, the methodologies to be employed to engage stakeholders, the level of participation needed by the project team, and the level and mechanism of communication among the project partners. It is anticipated that this kick-off meeting will be via conference call.

2. Coordination Calls

Monthly (or at a regular interval as determined by the project team) team coordination calls conducted by the contract lead and include appropriate NWS staff to ensure continual communication throughout the course of this project. A brief agenda should be provided prior to each call. Brief notes and action items should be provided within a week after each call.

3. Work Plan Develop a detailed work plan and project timeline based on input from the project team(s) during the kick-off meeting(s). This task should include a schedule for communicating with the NOAA team or sub-teams at regular intervals throughout the project cycle.

4. Design study to understand public and partner Tsunami alert needs

Work with NWS to develop an appropriate scope and methodological approach to better understand public and partner needs regarding NWS Tsunami alerts and recommend potential changes. The contractor shall first design the initial phase of the study to evaluate the current NWS Tsunami alerting system with appropriate members of the public, core partners, and stakeholders. Based on these results, the contractor shall design the next phase of the study to propose and test changes to the NWS Tsunami alerting system and offer concrete recommendations after analysis. Study design in both phases will ensure equitable reach to a diverse population.

The contractor shall propose a methodology that aims to answer these questions. Mixed methods, such as utilizing interviews, focus groups, surveys, or web data, etc., are encouraged. For each respective method, the contractor will design an appropriate methodological instrument (i.e. focus group script, draft survey, etc.). The proposals should explain the sampling approach and how it will rigorously capture the needed data.

The contractor shall interact with NWS at the beginning with an initial kick-off meeting, as well as to develop or review, as appropriate, effective methodological instruments.

Depending on the methodology recommended by the contractor, OMB PRA paperwork may be required. OMB PRA tasks and associated deliverables shall be incorporated in the proposal as needed.

5. Conduct study to understand public and partner Tsunami alert needs

The contractor shall implement the agreed-upon methodological approach and collect and analyze data. The contractor shall support the development of all necessary documents and information for submission to receive any necessary Office of Management and Budget (OMB)/Institutional Review Board (IRB) approval in sufficient time to stay within the time bounds of the contract.

6. Presentation and Report:

The contractor shall prepare a comprehensive draft and final documentation that describes:

● all sources of data and other information used in the analysis, including meeting notes and/or transcripts of relevant communications with study participants;

● the methods used for assessment and other, associated analyses;

● the results and conclusions of the analyses, including recommended applications of knowledge and best practices for communicating and messaging;

● tabular summaries and descriptive statistics for primary data that were collected

All data collected shall be provided in an electronic spreadsheet or database, in a format approved by the government. In coordination with NOAA, the contractor shall organize and facilitate a meeting to review the final report. Participants in this call shall include NOAA staff members and the contractor’s full project team.

IV. Deliverables All deliverables in electronic format in Word unless otherwise noted

Item Quantity Due Date Deliver to Task Kick-off meeting 1 14 days following task award Task Lead 1

Coordination Calls Numerous Begin following kick-off meeting

Task Lead 2

Final work plan 1 21 days after comments received on the draft plan

Task Lead 3

Draft methodological approach

1 4 months post award

Task Lead 4

Final methodological approach

1 5 months post award

Task Lead 4

Submit package to

OMB/ICR

1 6 months post award

Task Lead 4

Complete Data Collection

1 14 months post award

Task Lead 5

Draft final report and data set

1 17 months post award

Task Lead 6

Presentation of results

1 18 months post award

Task Lead 6

Final report 1 18 months post award

Task Lead 6

V. Qualifications Requirements The contractor shall possess the following qualifications, equipment, prior experience, and skills: project management; graduate degree in social science; extensive experience in both qualitative and quantitative social science research; experience working with federal agencies;

experience working with physical scientists towards effective communication of their research and information; knowledge of the meteorological enterprise.

VI. Government Furnished Materials The government will provide:

● NWS Weather-Ready Nation Strategic Plan 2019-2022

● DOC Strategic Plan

● NOAA Service Equity Assessments Final Report

● Executive Order On Advancing Racial Equity and Support for Underserved Communities

Through the Federal Government

● Appendix

VII. Payment Schedule Payment will be tied to acceptance of deliverables. Once a deliverable is accepted by the Government Point of Contact, an invoice can be submitted. Finance will process payment within 30-days after receipt of invoice.

VIII. Period of Performance The period of performance shall be 18 months from the contract award date to properly conduct, analyze, and present the social science results and recommendations to NWS.

IX. Place of Performance https://www.weather.gov/media/wrn/NWS_Weather-Ready-Nation_Strategic_Plan_2019-2022.pdf https://www.commerce.gov/sites/default/files/us_department_of_commerce_2018-2022_strategic_plan.pdf https://drive.google.com/file/d/15fHHUFTBNtjKmaOJhbETcdjuQTA3mmjY/view?ts=616984e6 https://www.whitehouse.gov/briefing-room/presidential-actions/2021/01/20/executive-order-advancing-racial-equity-and-support-for-underserved-communities-through-the-federal-government/ https://www.whitehouse.gov/briefing-room/presidential-actions/2021/01/20/executive-order-advancing-racial-equity-and-support-for-underserved-communities-through-the-federal-government/ https://docs.google.com/document/d/1PBxv6eavPKguT8at7JhnlrnY6AeshFP2duNSBLnnCNE/edit?usp=sharing

The contractor shall perform the work at their office, at the National Weather Service headquarters, and in locations appropriate to the proposed methodology. Information will be exchanged between NOAA/NWS staff via email, telephone calls, and Federal Express.

X. Travel The contractor shall make independent travel arrangements and pay for any travel costs associated with the contract in accordance with federal travel regulations. Travel will be permitted as appropriate with the proposed methodology.

XI. Proposals Proposals shall contain separate technical and price information. Technical proposals should be limited to a maximum of 15 pages; resumes of personnel may be included as attachments to the technical proposal and will not be included in the 15-page technical proposal limit. In the technical proposal, include a list of the labor categories and the number of estimated hours for each by task number.

Technical proposals should be submitted as separate documents/files from the price proposal.

Proposals shall include information on past performance for similar work recently performed or currently underway. See section XII for detail on proposal evaluation criteria.

XII. Evaluation Criteria Award will be made on the basis of the best value to the government. The following evaluation factors will be used: technical proposal, personnel, past performance, and price. Combined technical proposal, personnel, and past performance (in descending order of importance) is more important than price. This task order is a firm-fixed price award.

1. Technical Approach A. Description of the technical approach, methodology, technique, or plan to accomplish the task.

B. A brief technical proposal for each main task requirement shall be included in the description of work to be provided.

2. Key Personnel A. Description of the qualifications and experience of the key personnel who will be involved in the task, identifying specifically which part of the task each will be involved in B. Resumes of key personnel, if not already submitted with previous task orders

3. Past Performance A. The Contractor shall identify three (3) contracts/delivery orders/task orders, which it has recently performed within the last three years, or currently performing, that are similar in nature to this task order. If the Contractor has not performed three such contracts/delivery orders/task orders, it shall identify as many similar contracts as it has performed or is performing.

B. The Contractor shall provide the following information with respect to each of these contracts:

1. Contract number, contract type, and dollar value;

2. Date of contract award and period of performance;

3. Name, address, and telephone number of all applicable contract points of contact.

4. Brief description of contract work, scope, and responsibilities

4. Price Proposals A. Offerors must submit a written price proposal by the date and time indicated in the request for quotations B. The price proposal shall be broken down by task (Section III) and shall clearly explain and delineate costs, i.e. personnel, labor hours, other direct costs, and other costs as appropriate per task.

XIII. IT Security Requirements The Certification and Accreditation (C&A) or Assessment and Authentication (A&A) requirements of Clause 48 CFR 1352.239-72 do not apply, and a Security Accreditation Package is not required.

The contractor shall have completed CSC’s IT Security Questionnaire within one year prior to this task order being awarded. CSC shall have evaluated the contractor’s response to the questions and found the contractor to be an acceptable IT Security risk.

The Authorizing Official is satisfied that the deliverables received as a result of this acquisition will be accepted with the understanding that the cyber security controls employed by the contractor are acceptable and that all deliverables are of low or nominal risk. The risks of this acquisition and deliverables will be accepted.

XIV. Government Points of Contact

Contracting Officer Representative

TBD

Task Lead Mary Mullusky Forecast Services Division Chief 1325 East West Highway Silver Spring, MD 301-427-9372 mary.mullusky@noaa.gov

Technical Task Leads Mike Angove NWS TSunami Services Program Lead 1325 East West Highway Silver Spring, MD 703-717-1871 (Cell) michael.angove@noaa.gov

Ian Sears NWS TSunami Services Program Coordinator 1325 East West Highway Silver Spring, MD 301-427-9022 ian.sears@noaa.gov mailto:michael.angove@noaa.gov