NESDIS-CDP Community Day_09262024_Final.pdf

National Environmental Satellite, Data, and Information Service

NESDIS Commercial Data Program Community Day

Overview and Outcome of NESDIS’ Commercial Data Pilot Activities

Sept. 26, 2024

Office of Systems Architecture and Engineering Ed Grigsby, Director Products Mapping and Piloting Branch Natalie Laudier, Branch Chief

2National Environmental Satellite, Data, and Information Service

Welcome

Participants are welcome to ask questions. Please enter your questions via the Q&A Box at the bottom of the screen. We will be answering questions at the end of the presentation.

Thank you!

3National Environmental Satellite, Data, and Information Service

Trends Shaping Our Next-Gen Architecture New business models: Joint Venture, other transactional authority, commercial data buys

Commercial capability: Rapid pace of innovation, cheaper launch capability, more EO satellites

Ground/data system and services to match space capability: Cloud, Enterprise Ground

Partnerships with private industry, other agencies & strategic partners: Obtaining global data

Engaging our users: User needs are evolving as quickly as the climate changes (e.g., demand for more ocean science)

4National Environmental Satellite, Data, and Information Service

5National Environmental Satellite, Data, and Information Service

Satellites in Space

6National Environmental Satellite, Data, and Information Service

NESDIS Systems Architecture and Engineering (SAE) https://www.nesdis.noaa.gov/about/our-offices/systems-architecture-and-engineering

Purpose: Accelerate development of our nation’s environmental information systems, data products, and services to meet evolving user needs

• Inform NOAA observing system investments through satellite architecture planning and systems engineering

• Integrate NESDIS functions – from observations to product and data dissemination

• Manage product and services governance

• Leverage Earth observing data/technology through Commercial Data and Joint Venture programs

• Manage ongoing user engagement activities https://www.nesdis.noaa.gov/about/our-offices/systems-architecture-and-engineering

7National Environmental Satellite, Data, and Information Service

NESDIS

Commercial Data Program (CDP)

8National Environmental Satellite, Data, and Information Service

NESDIS Commercial Data Program Overview Purpose: Acquire and assess value-added commercial space-based environmental observation data to support NOAA’s mission.

The NESDIS Commercial Data Program (CDP) contains two lines of effort:

Commercial Weather Data Pilots:

Demonstrates the quality and impact of commercial data on weather, climate and space environment applications

Commercial Data Purchases:

Supports operational weather forecast applications

NESDIS Commercial Data Program Information:

https://www.space.commerce.gov/business-with-noaa/commercial-weather-data-pilot-cwdp/

9National Environmental Satellite, Data, and Information Service

NOAA/NESDIS Commercial Data Program Background

● In 2016, NOAA began the NESDIS Commercial Data Program with a Radio Occultation (RO) Data Pilot

● In 2018, NESDIS CDP conducted a 2nd RO Data Pilot

● In 2020, awarded the 1st Commercial Data Buy (RODB-1)

● Today, NOAA uses commercially available Radio

Occultation (RO) data to respond to the demand for environmental information and satisfy observational requirements.

● Derive Neutral Atmosphere products from Global Navigation Satellite System RO (GNSS-RO)

● Exploring non RO-based commercial space-based environmental monitoring data sources and Ionospheric

10National Environmental Satellite, Data, and Information Service

NESDIS CDP Drivers and Guidance Drivers: Congress, Executive Order, DOC Office of Space Commerce NOAA Commercial Space Policy

NESDIS Commercial Space Activities Assessment Process

Weather Research and Forecasting Innovation Act of 2017

PROSWIFT Act of 2020

Guidance: NESDIS Objectives & Program Management

● NESDIS Level Requirements (NESDIS-REQ-1001.1)

● NESDIS Product Baseline (NESDIS-REQ-1002.2)

● NESDIS Five-Year Product Plan (NESDIS-REQ-1003.2)

● Space Weather Next Program Objectives (NESDIS-REQ-4500.3)

● Near-Earth Orbit Network (NEON) Program Observational

Objectives

● NWS Prioritization of Space-Based Observational Objectives

● New NOAA Commercial Data Buy Guidance https://www.nesdis.noaa.gov/s3/2021-10/commercial_space_policy.pdf https://www.nesdis.noaa.gov/s3/2021-10/NESDIS_Commercial_Space_Activities_Assessment_Process_Final_1.6.17.pdf https://www.congress.gov/bill/115th-congress/house-bill/353/text https://www.congress.gov/116/plaws/publ181/PLAW-116publ181.pdf https://www.nesdis.noaa.gov/sites/g/files/anmtlf151/files/2021-08/NESDIS-Level-Requirements_V2.0%20DUSO%20Signed_e-signed_12-28-20.pdf https://nesdis-prod.s3.amazonaws.com/2022-12/NESDIS-REQ-1002-2.pdf?_ga=2.213046548.1615511566.1697557385-664900372.1686686900 https://nesdis-prod.s3.amazonaws.com/2023-10/NESDIS-PLN-1003-2_NESDIS_FIVE-YEAR_PRODUCT_PLAN.pdf?_ga=2.24260090.1369659548.1698081857-267947145.1603728987 https://nesdis-prod.s3.amazonaws.com/2023-10/NESDIS-REQ-4500-3_SPACE_WEATHER_NEXT_PROGRAM_OBJECTIVES.pdf?_ga=2.24260090.1369659548.1698081857-267947145.1603728987 https://nosc.noaa.gov/commercial_data_buys_guidance.php

11National Environmental Satellite, Data, and Information Service

NESDIS CDP’s Growing Contribution to NOAA Observations

Since its inception, CDP has grown with increases in:

• Number of applications piloted with commercial data that meet NESDIS Level Requirements (NLR)

• Funding levels

• Commercial vendor interest

(Responses to RFI’s)

NESDIS CDP Funding: CDP Enacted Appropriation ($M)

* NOTE: FY25 reflects President’s Budget

Applications include:

RO = radio occultation, TEC = space weather total electron content, Scint.= space weather scintillation, OSW = GNSS-reflectometry ocean surface winds, Soil Moist.= GNSS-reflectometry soil moisture, Inland WB. = GNSS-reflectometry inland water body properties, Ice = GNSS-reflectometry ice properties Mwave = microwave atmospheric sounding

12National Environmental Satellite, Data, and Information Service

NESDIS CDP Operational RO Data Buys (RODB)

● NESDIS CDP successfully purchases and integrates commercial GNSS-RO data, which is a highly valuable input for operational weather modeling.

● Used in Operational NWP Neutral Atmosphere and Space Weather models

Radio Occultation Data Buy (RODB)-2 IDIQ Delivery Orders:

Delivery Order Vendor RO Profiles per day Period of Performance Length Data Sharing License

DO-1T PlanetiQ Spire

500 6 Apr 2023 – 4 May 2023 1 month Unrestricted

DO-2 PlanetiQ 3100 18 Jul 2023 – 18 Jan 2024 6 months Unrestricted

DO-3 Spire 3000 18 Jan 2024 – 18 Sep 2024 8 months Unrestricted

DO-4 PlanetiQ Spire

800 18 Sep 2024 – 18 Sep 2025 12 months Unrestricted

13National Environmental Satellite, Data, and Information Service

NOAA Data Sharing License Options

Operational Data Purchases Option 1 Unlimited distribution rights

Data Pilots Option 2

Distribution to U.S. Government agencies, National Meteorological Centers (NMC), WMO Met Centers, CGMS members, nonprofit organizations, Academic entities for non-commercial use with no further distribution

Option 2a Option 2 plus unlimited distribution after 24 hours

NESDIS CDP prefers less restricted data sharing options

14National Environmental Satellite, Data, and Information Service

What is a Commercial Weather Data Pilot (CWDP)?

Purpose: To evaluate the quality and impact of commercial space-based environmental data on weather, climate, and space environment applications

● To demonstrate potential utility and value to NOAA’s mission

● Acquire and evaluate the data for potential integration into operations

Phase 1: Preparation - Set-up secure ingest, dissemination, and data processing Phase 2: Data Delivery - Continuous commercial data delivery Phase 3: Evaluation - Provide engineering and technical support Post-Pilot: Government Evaluation period - Gov’t team conducts assessment and evaluation of supplied datasets. Delivers final report.

15National Environmental Satellite, Data, and Information Service

2023-2024 NESDIS Commercial Weather Data Pilots

● Space Weather Pilot (ended in 2024):

NESDIS CDP conducted a successful pilot study of exploiting commercial GNSS-RO data for space weather parameters.

The final report is now available

● GNSS Ocean Surface Winds (OSW) GNSS Reflectometry Pilot (ongoing):

NESDIS CDP is executing a pilot study to use commercial reflectometry data to derive ocean surface wind speeds and additional environmental measurements.

https://www.nesdis.noaa.gov/s3/2024-09/NESDIS-RPT-8001.1-Commercial-Data-Program-Space-Weather-Data-Pilot-Report-Executive-Summary.pdf

16National Environmental Satellite, Data, and Information Service

Pilot Assessment and Evaluation Criteria

NESDIS CDP assembles a Government team of subject-matter experts to analyze the Pilot data and conduct a thorough assessment and evaluation.

• Determine potential for a future commercial data purchase by investigating the following:

Value:

■ Accuracy

■ Quality

■ Timeliness

■ Reliability

Use:

■ Impact to operations

■ Mission need

■ Ability to assimilate into NOAA applications

■ Security

Cost:

■ Value added

■ On-orbit availability

■ Sustainability

17National Environmental Satellite, Data, and Information Service

Commercial Weather Data Pilot Process

• Pulse the community: Issue RFIs to identify potential data types of interest

• Evaluate responses against NOAA goals, requirements, resources and schedules

Market Research

• Develop requirements, engaging user community and experts

• Release draft “Statement of Work”

• Issue solicitation (“Request for Proposals”)

• Evaluate proposals

• Award contracts as appropriate

Pilot Planning

• Plan for data ingest, processing, dissemination and archive

• Conduct data delivery

• Assess and evaluate data quality and impact, report results to community at large

• Recommend data type(s) for operational purchase when appropriate

Pilot Execution

18National Environmental Satellite, Data, and Information Service

FY 2024 G-RFI Pilot Process and Timeline

19National Environmental Satellite, Data, and Information Service

NESDIS CDP General Request For Information (G-RFI)

● Objective: The General RFI helps NESDIS CDP understand how industry may help NOAA meet it’s observation requirements and what new technologies are available.

● Process: NESDIS CDP team pulses commercial sector ~ annually for capabilities that could address NOAA’s space-based environmental monitoring requirements, focusing on new and emerging technologies that could improve NOAA’s mission.

● FY 2024 RFI: NOAA issued a Commercial Satellite Data General RFI in Dec 2023 (sam.gov)

○ Solicited on-orbit (existing or planned) capabilities for the FY 2024-2032 timeframe that could meet NESDIS requirements.

https://sam.gov/opp/239c16db3e474815b86e48b452e53398/view

20National Environmental Satellite, Data, and Information Service

Progression from this G-RFI to Pilot Decision

● NESDIS CDP formed a Capability Assessment Team (CAT) to evaluate the RFI responses

● The CAT prioritized the RFI responses that offered space-based environmental monitoring

(SBEM) capabilities and a data-as-a-service (DaaS) model

Assessment Team considered four main criteria:

○ Does it meet a mission need(s)?

○ Availability (on-orbit viability, technology maturity)

○ NOAA mission impact and priorities

○ Path to utilization

24 RFI responses received – The CAT identified 16 applicable for future SBEM & DaaS capabilities

21National Environmental Satellite, Data, and Information Service

FY 2024 G-RFI Results for Near-Term Piloting

● Prioritized Neutral Atmosphere capabilities (non Space Weather) for this assessment

● Considered NOAA guidance to focus on higher-priority mission needs

The 2024 Capabilities Assessment Team produced a set of recommended technologies from qualified vendors that are available for near-term piloting (FY25):

● Microwave Sounder

● Microwave Radar

● Polarimetric Radio Occultation

● HyperSpectral IR (for Greenhouse Gas Monitoring)

● HyperSpectral Microwave

22National Environmental Satellite, Data, and Information Service

NESDIS decision for FY 2025 Commercial Weather Data Piloting:

○ Proceed with a Pilot for Microwave Sounding capabilities because:

■ Highest impacts to Numerical Weather Prediction models

■ Provides opportunities to add novel vertical temperature sounding capabilities (118 GHz)

■ Expands efforts developed from the NASA TROPICS mission

■ Opportunity to fill constellation gaps across the US-EU Government architecture

■ On September 17, 2024, NOAA awarded two Commercial Weather Data Pilot contracts for Microwave Sounding to Tomorrow.io and Orbital Micro Systems

○ Investigate Hyperspectral Microwave Sounding capabilities with the goal of commencing a Pilot once on-orbit capabilities are available

■ Leveraging efforts from SAE’s own Joint Venture program & CDP coordinating and tracking

○ Investigate utility of GNSS-Polarimetric RO (PRO) technologies

■ Detects presence of precipitation and estimates rates and types of precipitation

FY 2024 G-RFI Way Forward

23National Environmental Satellite, Data, and Information Service

FY 2024 G-RFI and Public-Private Partnerships

The 2024 G-RFI included an evaluation of public-private partnerships:

○ For the FY 2024 G-RFI, NESDIS CDP and the Office of Satellite Products and Operations (OSPO) also reviewed non-traditional vendor submissions:

■ Reviewed survey responses for ideas on innovative public-private partnerships

■ Reviewed respondent capabilities for:

○ Partnering capabilities (what is being offered, path-forward approach)

○ Overall viability and potential impacts to current approaches

○ Tech readiness level, costs, risks, and schedule

○ Alignment with NESDIS NEON and GEO-XO program objectives

○ Evaluations are being used to inform NESDIS on possible future hybrid architectures

24National Environmental Satellite, Data, and Information Service

FY 2024 G-RFI and Public-Private Partnerships

G-RFI Public-Private Partnership Evaluation Conclusions:

○ Highlights:

■ The G-RFI provided valuable market research for NOAA Concept and Technology Development projects

■ Several valid public-private partnership approaches were provided

■ Data licensing concerns were noted by vendors

■ Many vendors were requesting Government “anchor” contracts

○ Recommendations included:

■ Demonstration of a vendor solution in support of cloud processing

■ Partnership with a vendor for implementing a new capability supplementing

NESDIS observations

■ Consider innovative & rapid development approaches

25National Environmental Satellite, Data, and Information Service

2024-2025 NESDIS CDP Planning

26National Environmental Satellite, Data, and Information Service

Questions?

NESDIS CDP Organizational Email: nesdiscdp@noaa.gov Natalie Laudier, NESDIS CDP PM: natalie.laudier@noaa.gov

Suzanna Espinoza, AGO (Contracting): suzanna.espinoza@noaa.gov

NESDIS Commercial Data Program Information:

https://www.space.commerce.gov/business-with-noaa/commercial-weather-data-pilot-cwdp/ mailto:nesdiscdp@noaa.gov mailto:natalie.laudier@noaa.gov mailto:suzanna.espinoza@noaa.gov

27National Environmental Satellite, Data, and Information Service

Questions & Answers Enter your questions in the on-screen Q&A Box

Commercial Data Program (CDP)

NESDIS CDP Organizational Email: nesdiscdp@noaa.gov Natalie Laudier, NESDIS CDP PM: natalie.laudier@noaa.gov Suzanna Espinoza, AGO (Contracting): suzanna.espinoza@noaa.gov Questions & Answers Enter your questions in the on-screen Q&A Box