SOW_CGLightning.docx

DOCX document 265 KB Posted

Attached to
Commercial Cloud-to-Ground (CG) Lightning Data Feed
Solicitation number
EAD_CG_DATA_FY27_SSN
Issued by

About this file

This is a Statement of Work (SOW) for the continuous acquisition of commercial cloud-to-ground (CG) lightning data by the National Oceanic and Atmospheric Administration (NOAA) under the National Weather Service (NWS). The contractor must deliver real-time CG lightning data in NOAA-approved format for two geographic zones: CONUS (48 contiguous states, Puerto Rico, and 500 km offshore) as the base requirement, and OCONUS (areas between 25 degrees South to North Pole latitude and 30 degrees East to 115 degrees East longitude, with extended southern coverage eastward from 150 degrees West to 30 degrees West down to 52 degrees South for Geostationary Lightning Mapper validation). Data must be streamed continuously and provided in one-minute packets encrypted using AES-128 encryption, transmitted via Secure Shell TCP/IP to NOAA's National Weather Service Telecommunications Gateway for distribution through NOAAPORT, direct data streaming to receiver sites, and web-based internet access applications.

The contractor must meet stringent technical performance requirements including location accuracy of 1 km for 99% of CONUS coverage and 2-5 km for 99% of OCONUS coverage, detection efficiency of 95% or higher for CONUS (70% or higher for OCONUS), timing accuracy to 0.001 seconds or better, false detection probability not exceeding 1% for CONUS and 5% for OCONUS, and data delivery within one minute for 99% of CONUS events. The contractor must maintain 24/7/365 operations with system outages limited to 72 cumulative hours per 12-month period (no more than 24 hours per 30-day period), provide quarterly detection efficiency reports by state or region, and deliver 3-6 months advance notice before archival data disposal. The SOW specifies five levels of data products (Level I through V) with varying redistribution rights, establishes user categories including NOAA line offices, federal agencies under written agreements, state/local governments, and authorized non-federal cooperating organizations, and prohibits distribution to unauthorized users, commercial entities, and non-U.S. governments without bilateral agreements. The contractor must supply archived data up to five consecutive years in electronic form, provide status information on network outages within two minutes, and meet government testing and verification requirements for data encryption, format compliance, and performance claims.

View the file

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

ACQUISITION SENSITIVE

STATEMENT OF WORK

CLOUD-TO-GROUND LIGHTNING DATA FOR NOAA AND NWS

ACQUISITION SENSITIVE

CLOUD-TO-GROUND LIGHTNING DATA FOR NOAA AND NWS

CLOUD-TO-GROUND LIGHTNING DATA FOR NOAA AND NWS

1. INTRODUCTION

The National Oceanic and Atmospheric Administration (NOAA) uses lightning data in its present operations and to explore new ways of using lightning data in concert with complementary data from other sources, i.e., the vast network of Lightning Mapping Arrays, Radar and Satellite data, as well as data from GOES-R and later Geostationary Lightning Mapper (GLM). This Statement of Work (SOW) covers NOAA’s requirements for its cloud-to-ground lightning data.

1.1 BACKGROUND

Several Federal Government agencies have purchased lightning data from a contractor since 1991. NOAA, under the Department of Commerce (DOC), administered previous contracts for itself and on behalf of other agencies. Since 2010, NOAA has purchased lightning data under contract centered solely on NOAA’s requirements. NOAA has recognized the lightning data it acquired as the contractor’s proprietary information and has worked with the contractor to prevent unauthorized distribution of the data.

1.2. SCOPE

This SOW describes NOAA’s base requirement and optional requirements for the continued acquisition of cloud-to-ground lightning data and the methodology for its delivery to NOAA line offices. Included are the requirements for the data itself, archival of the data and redistribution of the data (to include products with data). Also included are the restrictions that NOAA will accept regarding the redistribution of this specific lightning data.

1.3. TYPES OF LIGHTNING

This SOW addresses one critical type of lightning: cloud-to-ground lightning (CG). This lightning type is defined below, in accordance with the Federal Lightning Capability Requirements (report number FCM-R27-2008 referenced on https://www.icams-portal.gov/resources/ofcm/reports2.htm). The definition of CG lightning will apply throughout this SOW.

CG lightning is lightning originating in a cloud and striking the ground or some natural or manmade feature on the ground. CG lightning in this SOW refers to either a flash or stroke. A CG flash is comprised of a return stroke and up to 15 subsequent strokes. NOAA requires data for both strokes and the flashes that contain them.

1.4. LEVELS OF LIGHTNING PRODUCTS

This SOW addresses five levels of lightning data/products: Levels I, II, III, IV, and V. Table 1-1 defines these lightning data levels whose definitions will apply throughout this SOW.

TABLE 1-1

LEVEL
DESCRIPTION
I
Streaming data as received from the prospective contractor using the approved format for use by NOAA. NOAA reserves the right to archive these data at one or more national centers (such as the National Centers for Environmental Information (NCEI), Storm Prediction Center (SPC), Aviation Weather Center (AWC) and the NWS Meteorological Development Laboratory (MDL)). Also, the contractor will provide archived, quality-controlled data to NOAA on request at no added cost (within preordained geographic bounds and historical time periods, per Sections 6 and 7.6.2).

Examples:

1. Streaming data received directly into a NOAA facility from the prospective contractor using the approved format.

2. NOAA procures a previous year’s CG lightning data from the contractor.

II
Contractor-generated products containing CG lightning data. The product can be an application on NOAA equipment or an actual separate piece of hardware.

Examples:

1. Time-lapse loop of detected lightning displayed on an Advanced Weather Interactive Processing System (AWIPS) platform

2. Lightning data overlaid on a radar image on a contractor-provided platform.

3. Lightning data displayed on a contractor-provided platform (e.g. software only solution, software & hardware only solution), capable of quickly displaying real-time streaming lightning data over small geographic areas or large geographic areas from the Pacific to Atlantic oceans.

III
NOAA-required repackaging of contractor-provided streaming data into 1-min packets of information. The data is unchanged in content, but is formatted differently than the Level I data to meet NOAA requirements (basically each file requires a WMO header). The data packets should identify individual strokes and flashes. No additional data other than that required is included in the product, meaning the entire Level I data stream need not be included in the Level III product. The dissemination of this product does not constitute redistribution of the contractor’s data because the original data cannot be readily extracted from the NOAA product. Note, for the purposes of this SOW, the prospective contractor must be capable of providing the current NOAAPORT one-minute product through at least one of NOAA’s point-of entry for use by NOAA’s users in the required format specified, herein. Data provided under this level is archived at the National Center for Environmental Information (NCEI).

Example:

One-minute CG data is provided to NOAA’s Telecommunications Operations Center in encrypted format (government code) and archived at a pre-defined NOAA facility.

IV
NOAA-generated and value-added products integrating CG lightning data (Level I or III) along with other types of data in order to generate a new service product. The new product may identify detected CG lightning or areas of CG lightning. Where there is to be dissemination of this product the product may only show gridded CG

lightning with temporal and spatial resolution no finer than 0.1 degree (latitude and longitude) and 30 minutes, which does not constitute redistribution of the contractor’s data because the original data cannot be readily extracted from the NOAA product.

Examples:

1. Level I or III lightning data overlaid on a satellite image

2. A graphic product outlining areas of detected lightning along with wild land fire potentials denoted.

V
NOAA-generated products using CG lightning data as an input, but not displaying the actual contractor-transmitted lightning data.

Examples:

1. Map of detected thunderstorms without related lightning data

2. Map of forecast “lightning” (formerly thunderstorm) probability that uses lightning data as an input into the forecast

3. Government-generated products overlaid on radar and satellite images as zones of CG lightning without depicting the actual base information.

For further details about redistribution rights, see section 7.6 and its sub-sections.

1.5. CG LIGHTNING DATA USERS

This section addresses data users covered by this SOW. Current users and possible additional future users are also discussed. Section 1.5.1 addresses NOAA users, Section 1.5.2 describes associated Government users, and Section 1.5.3 addresses users associated under agreement with NOAA, but are outside the Federal Government.

1.5.1. NOAA USERS

NOAA lightning data users include any line office within NOAA including, but not limited to, the National Weather Service (NWS), National Environmental Satellite, Data and Information Service (NESDIS), and the Office of Oceanic and Atmospheric Research (OAR). NWS will ensure that all NOAA line offices that use the CG lightning data comply with the terms of use.

NOAA ingests all lightning data into the NWS AWIPS and National AWIPS (N-AWIPS) systems to support its operational mission of issuing accurate and timely meteorological, oceanographic, and hydrological warnings, watches, forecasts and other related products. There are some centers within NCEP that are able to stream data to contractor-provided applications and NCEP applications, and many WFOs are able to view CG lightning data via GRAnalyst (outside of AWIPS). NOAA also incorporates CONUS CG lightning data into its multi-radar/multisensor (MRMS) system and plans to incorporate more advanced lightning data in the future. NOAA also uses CG lightning data for research purposes to improve meteorological and hydrological forecasts and warnings, and archives these official products under the Service Record Retention System. Lightning data acquired under this SOW will be integrated with other data types to produce new products and applications (Level III, IV, and V products, above).

The Aviation Weather Center is particularly interested in both CONUS and OCONUS CG lightning data. As part of their international commitments, AWC forecasts thunderstorms globally from T+06 to T+36, in 3 hour increments. The forecasts are in automated grid format for all time steps, and in a hand drawn chart format for T+24. The CG lightning data helps forecasters identify areas of thunderstorms, especially low topped and/or embedded thunderstorms, and it is AWC’s primary means of verification. The verification is also used to improve forecasting skill.

Lightning data are foundational observations at the Storm Prediction Center, both CONUS and OCONUS. Lightning data are fundamental to the real-time identification of thunderstorm occurrence, location, coverage, intensity and trends. The data are used in the development and improvement of SPC’s probabilistic thunderstorm and severe thunderstorm prediction guidance (calibrated SREF-based and Perfect Prog methods). The data are necessary to accurately diagnose and predict dry thunderstorm occurrence, a major contributing factor of fire starts. Further, the data play a key role for convective winter weather.

Fire Weather Operations - Incident Meteorologists and the forecasters that support them depend on CG lightning data to give customers from land management and state/local agencies advanced warning on areas of clouds and smoke where convection will likely occur; this is needed to help locate areas of potential fire ignition. This is especially true in the mountainous western U.S. where weather radar cannot adequately portray convection due to terrain blockage.

The Western Region of the NWS requires OCONUS CG lightning to help monitor the intensity of frontal systems as they approach the Pacific coastline. The bounds of the CONUS data do not meet need to track systems as they transverse across the ocean and leave very little time for DSS coordination/messaging.

The Pacific and Alaskan Regions of NWS require OCONUS CG lightning to ascertain the true convective nature of systems in the western and central Pacific Ocean; this includes the monitoring of atmospheric rivers that often lead to heavy precipitation and flooding for Hawaii, Alaska and the western US. Numerical weather prediction models struggle with initializing and maintaining tropical storm structure and placement (lightning helps with verifying strength of storms), transitioning tropical systems into extratropical entities (lightning can help track this transition and how models handle certain situations), and initializing the general basic background of the tropics (this is where lightning really helps).

As stated above, NOAA reserves the right to archive lightning data and request historical archives from contractor at no added cost. See Sections 6 and 7.6.2 for further details on the archiving requirement.

1.5.2. OTHER FEDERAL GOVERNMENT USERS

This SOW is not intended to provide non-NOAA Agencies with CG lightning data for their respective missions. However, NOAA reserves the right to provide lightning data to another Federal Agency when that agency is collaborating with NOAA under a written agreement for the purposes of advancing NOAA’s mission. Other non-NOAA Agencies that require lightning data for their own missions will not be able to obtain that data through this SOW. Requests for CG lightning data to meet entire agency requirements shall be coordinated with the contractor prior to any data-sharing activities can be initiated. NOAA will ensure that the Federal agency receiving NOAA provided lightning data is made aware of the terms of use for this data and NWS (which manages the lightning contract for NOAA) will make every effort to ensure that the other agency adheres to any restrictions that NOAA has accepted under this SOW. Agencies may receive either Level I or III lightning data and/or Level II/IV/V products under this SOW according to stipulations noted above, and as described under Section 6, and Section 7.7 and sub-sections.

1.5.3. NON-FEDERAL GOVERNMENT USERS

Non-federal users constitute two groups as follows:

1. State and local government users

2. Non-government users

Sections below describe NOAA’s affiliation with these groups.

1.5.3.1. STATE AND LOCAL GOVERNMENT USERS

Several state and local government users cooperate with NOAA line offices receiving CG lightning data. These state and local government users may receive either Level I or III lightning data and/or Level II/IV/V products under this SOW provided they have a documented agreement with NOAA line offices. The data may be received from NOAA or directly from the contractor.

NOAA will identify at the contractor’s request, state and local government agencies receiving lightning under this SOW. State and local government users will adhere to the same agreement as NOAA with the prospective CG lightning data contractor.

1.5.3.2. NON-GOVERNMENT USERS

Non-government organizations, companies, and institutes cooperating with NOAA might need lightning data to satisfy their agreement/contract obligation. These include cooperating organizations and support contractors. Cooperating organizations are organizations with a cooperative working relationship with one or more NOAA agencies. Support contractors are organizations that have contracts with one or more NOAA line offices to perform a task(s) for NOAA. The tasks may involve operational use of lightning data, application development, or research. NOAA reserves the right to provide lightning data to non-federal users with which it has a direct relationship under written agreement or contract. The provision of lightning data to non-federal users will require the prior approval of the contractor, which will not be unreasonably withheld. Requests for broadband lightning data (CG) to meet other requirements outside the mission scope will be coordinated with the prospective contractor. Any non-federal agency receiving NOAA-provided lightning data will adhere to the same agreement as NOAA has with the prospective contractor under this SOW. Users may receive either Level I or III lightning data and/or Level II/IV/V products under this SOW.

1.5.4. UNAUTHORIZED USERS

There are three types of users not authorized to receive lightning data under this SOW:

1. Organizations not having a relationship with a NOAA user under a written agreement.

2. Organizations, including government agencies, using the data for any commercial purpose.

3. Non-U.S. governments, unless a specific bilateral or multi-lateral agreement has been established. Such agreements will be coordinated with the prospective contractor.

1.6 GEOGRAPHICAL AREAS

Geographical areas will be defined as CONUS (Appendix A), which is the CONUS area with Cloud to Ground (CG) Lightning. Outside the Continental United States (OCONUS) (Appendix A), involves CG lightning measured within indices of Table 3-2, within the following latitude/longitude bounds: 25 degrees South and northward to the North Pole and 30 degrees East westward to 115 degrees East. Eastwards from 150 degrees West to 30 degrees West the southern boundary of the area will extend to 52 degrees South.

2. SERVICES RENDERED

The prospective contractor shall provide lightning data to meet NOAA’s basic requirement at a minimum (Section 2.1). The contractor shall have a network in place to meet the basic requirement, or have legal access to data from another organization’s network to meet the base requirement. The contractor will need to have a network in place to meet any optional services that NOAA requires. However, if an optional service is requested, the contractor must be able to meet the requirement within a period of 3 months from the date it receives the request.

2.1. SCOPE OF WORK REQUIREMENT

The contractor shall deliver CG (Level I or III) lightning data in a NOAA-approved format (i.e., meeting current AWIPS or N-AWIPS requirements) for CONUS CG (Appendix A) to meet the base requirement. CONUS CG is considered the base requirement under this SOW for the prospective contractor to meet to be deemed compliant.

2.2. NEW INCLUSIONS UNDER THE BASE REQUIREMENT

NOAA will have separate baseline requirements under this SOW for CONUS and OCONUS areas (See Section 4.1.1 and Appendix A for a description for OCONUS CG). These requirements are based on the type of lightning data (CG), Level (I or III), and the geographic areas covered. The prospective contractor will provide CG lightning data to be delivered to NOAA for each geographic area specified in their response to this SOW. To fully support NOAA operations for severe weather activity and safety, CG lightning flashes must come with information on strokes. OCONUS CG zone has been extended to following area (30 deg East Longitude westward to 115 deg East Longitude, 25 deg South Latitude to the North Pole) to accommodate requirements from the Aviation Weather Center for air routes going into Europe, to extend beyond the bounds of the future GLM and fully cover areas of remote western Pacific Ocean. In support of the validation of the Geostationary Lightning Mapper (GLM), eastwards from 150 deg West to 30 deg West the southern boundary of the area will extend to 52 degrees South.

There is also a requirement for contractor-supplied archived data (Level I), as outlined in Sections 6 and sub-sections, and 7.6.2.

3. TECHNICAL REQUIREMENTS

The contractor shall supply lightning data meeting the technical requirements described in all subsections below.

3.1. LIGHTNING DETECTION NETWORK

The contractor shall have legal access either through their own network or through some agreement with another lightning provider to supply lightning data that meet the requirements within this SOW. The contractor shall have legal access to lightning data 24 hours a day 7 days a week. Lightning data from CONUS and OCONUS shall be collected via a data streaming method, but shall also be required to provide the data on a 1-minute basis for the base requirement in conformance with the NOAA format and encryption requirements (meeting requirements of AWIPS/N-AWIPS and adhering to government-provided encryption code). The 1-minute data product shall be made available to NOAA users in one minute or less after detection.

The format for each lightning product (CONUS and OCONUS) is delineated in the following paragraphs. In general, the CG lightning data consists of the following content:

· NWS-specific header record

· Lightning data element consisting of:

· Record type (either lightning data report or “keep alive” record)

· Date and Time (UTC with milliseconds accuracy)

· Latitude and Longitude (location)

· Stroke count per flash

· Polarity (negative or positive)

· Peak current amplitude (kA)

· Type of event: CG data only

· Termination string

The lightning data shall be provided via Secure Shell TCP/IP interface, with the data (with the exception of the first record which is to be a WMO header record) being encrypted to ensure limited access to the lightning data. The lightning data shall be handled as sensitive information and protected from access by the general public. The contractor shall encrypt the binary lightning data using the Advanced Encryption Standard (AES) technique (FIPS 197). Information on this algorithm can be found using the following link:

http://csrc.nist.gov/archive/aes/index.html The encryption key size shall be 128 bit (i.e., AES-128). NOAA will provide the encryption key to the contractor upon contract award, with new key assignment reviewed and coordinated with the contractor on a bi-annual basis.

Lightning data format (excluding NWS specific header record) shall conform to the current lightning data format in use, as outlined below:

Byte
Content
0 - 1
Record Type (16 bit Integer), Hexadecimal value of 0x0000 to indicate a keep-alive record, 0x00FF to indicate a lightning data record
2 - 5
UTC Date/Time Hours/Minutes/Seconds (32 bit unsigned integer)
6 -7
UTC Time Milliseconds (16 bit unsigned integer)
8 - 11
Latitude (32 bit floating point)
12 - 15
Longitude (32 bit floating point)
16 - 17
Vendor Specific Data (16 bit Integer)
18 - 19
Stroke Type (16 bit Integer)
20 -21
Stroke Kiloamps (16 bit Signed Integer)
22 - 23
Stroke Multiplicity (16 bit Integer)
24 -25
Stroke Duration (16 bit Integer)
26 -27
Reserved for future use (16 bit Integer)
28 -31
Termination Characters as defined above (4 bytes). The following bytes: 0x0D, 0x0D, 0x0A, 0x00 if not last lightning data element,

or 0x03 if last lightning data element in the record.

Other quality metric and vendor defined fields provided by the contractor, including but not limited to, Continuing Current Identifier, Continuing Current Duration, Semi-major axis, Chi-square, Network index, will be added to the data feed in coordination with NOAA’s downstream data ingestion and processing applications.

The contractor shall provide the network required to meet the base requirement as specified herein. The network may be owned, operated, and maintained by the prospective contractor or owned by other organizations. If the prospective contractor supplies data from another organization’s network, the prospective contractor must have legal rights to redistribute these data.

The prospective contractor shall have a 24-hour/7 day per week point of contact available for operational service, troubleshooting, and questions. The prospective contractor shall provide the appropriate access information to NOAA for this service.

3.2. LIGHTNING DATA REQUIREMENTS

The prospective contractor shall supply lightning data in real-time that meets all requirements outlined in Tables 3-1 through 3-2. Refer to all subsections of 4.1 for a discussion of the geographic areas.

PARAMETER
REQUIREMENT
Location Accuracy
1 km for 99% of the area within the zone; the location of a CG flash/stroke is the location where it strikes the ground, reported to the nearest 0.0001degree latitude and longitude or better.
Timing Accuracy
Contractor shall provide as part of response, reported to the nearest 0.001 seconds or better.
Detection Efficiency
95% or higher over the 48 contiguous states; 70% or higher over adjacent marine and land areas
Probability of False Detection
No more than 1% of all reported lightning flashes/strokes shall be due to non-lightning causes
Probability of False Flash Type Identification
No more than 5% of all known CG flashes/strokes shall be misclassified as other types of lightning
Polarity
Polarity (positive or negative) shall be reported for all flashes and strokes, with accuracy 99% or better
Estimated Peak Current
Peak current in amperes shall be reported for all flashes and strokes, with error 15% or better
Strokes per Flash
Number of strokes per flash shall be reported for all flashes. Strokes within flash that are more than 1 km from other strokes in flash need to be recorded
Data Delivery Time
Total time from the time the flash or stroke occurs to the time that flash or stroke is reported shall be one minute or less for 99% of all flashes/strokes

TABLE 3-1

LIGHTNING DATA TECHNICAL REQUIREMENTS

CONUS

CLOUD TO GROUND LIGHTNING (CG)

PARAMETER
REQUIREMENT
Location Accuracy (LA)
2-5 km for 99% of the area within the zone; the location of a CG stroke is the location where it strikes the ground; LA for AK and HI must be 2-3 km, reported to the nearest 0.0001degree latitude and longitude or better.
Timing Accuracy
Contractor shall provide as part of response, reported to the nearest 0.001 seconds or better.
Detection Efficiency
70% or higher OCONUS; 80% or higher over majority of AK and HI; 40% or higher over oceans and remaining area
Probability of False Detection
No more than 5% of all known CG flashes/strokes shall be misclassified as other types of lightning
Polarity
Polarity (positive or negative) shall be reported for all flashes and strokes, with accuracy 90% or better
Estimated Peak Current
Peak current shall be reported for all strokes with error 25% or better
Data Delivery Time
Total time from the time of the stroke occurs to the time that stroke is reported shall be two minutes or less for 99% of all strokes.

TABLE 3-2

LIGHTNING DATA TECHNICAL REQUIREMENTS

OCONUS

CLOUD TO GROUND LIGHTNING (CG)

3.3. STATUS INFORMATION

With any lightning detection system, sensor or communication failures can result in a degradation of the data or a complete loss of data over specific areas or even over the entire network. The prospective contractor shall furnish system status information to distinguish areas of no lightning activity from areas of degraded performance or missing data. This information shall be transmitted in a notice to each receiver site. The notice shall identify areas where the specified performance requirements cannot be expected. State by state or regional detection efficiency (preferably actual/reported versus modeled) shall be reported on a quarterly basis.

The prospective contractor’s system shall detect all network changes or outages that adversely affect the performance of the system. The expected impact of these changes shall be reported within two minutes from the time of the outage and repeated at least every ten minutes during the time of the outage. These changes may be expected or unexpected. They may result from sensor, communications, or processor failures, or from planned maintenance. Other causes of outages include solar storms and the effect of solar eclipses on satellite communications. Expected outages shall be reported to NOAA at least two weeks in advance except outages due to the effect of a solar eclipse on satellite communications shall be reported one month in advance and expected outages due to solar storms reported one day in advance. Systems degradation information shall include estimates of the resulting changes in detection capability and location/timing accuracy. Any expected outages due to the effect of solar eclipse on satellite communications used to transmit lightning data shall also be reported; the specific outage message shall be repeated at least once a day until the outage is over.

NOAA requires global and regional maps detection efficiency and location/timing accuracy, updated on a weekly basis, to ascertain any impacts to CG lightning data from network changes or sensor outages. This information is very important for severe weather situations, fire weather applications, lightning safety, detecting thunderstorms over OCONUS areas, and research use of data.

The contractor shall propose how they will provide technical information and back it up with real network information, statistical evidence, peer-reviewed studies, and comparison with independent LMA networks/ground truth to show they will meet each of the performance categories identified in Tables 3.1 and 3.2, as well as in Section 4.

See Section 7.4 for more information on outages.

4. GEOGRAPHIC COVERAGE REQUIREMENTS

The prospective contractor shall offer coverage based on geographic areas covering all CONUS and OCONUS geographical areas. Section 4.1 identifies the zone and Appendix A contains a detailed description and map of each zone.

4.1. GEOGRAPHIC ZONES

The following sections describe the terrestrial and marine zones and the geographical area coverage.

4.1.1. TERRESTRIAL ZONES

The prospective contractor shall offer CONUS CG data, the base requirement.

Coverage for CONUS will include coverage up to 500 km offshore and over adjacent land areas including Canada and Mexico.

The terrestrial zones are defined in Appendix A contains maps and detailed descriptions of these areas.

4.1.2. MARINE ZONES

Marine zones are included in the specifications for each geographical area.

4.1.3. OCONUS ZONES

Areas covered OCONUS includes all CG lightning data outside of CONUS area, as defined in Section 1.6.

5. LEVEL II, III, IV AND V DATA/PRODUCTS

Level I lightning data can be used to generate Level III data, and Level II, IV and V products. Descriptions of Government and contractor-generated Level II, III, IV, and V data follows.

5.1. GOVERNMENT-GENERATED LEVEL III, IV AND V LIGHTNING DATA

NOAA may generate Government-developed Level IV and V products based wholly or partially on the prospective contractor’s lightning data (Level I or III). The content of these data/products will be determined by NOAA. These data/products will be used operationally and as a source of data for research purposes as well as provided to NOAA’s customers as stated in Section 1.5 and subsections. This includes the use of strokes for CG flashes.

6. ARCHIVED DATA

Archived lightning data (Level I or III) is considered as any lightning data more than 24-hours old. Archived data provided by the prospective contractor will be delivered in an easily read electronic form. The contractor shall deliver CG (Level I or III) lightning data in a NOAA approved format (i.e., meeting current AWIPS or N-AWIPS requirements) for CONUS and OCONUS CG (Appendix A) to meet the requirement. The contractor will supply quality controlled archived lightning data up to a maximum of five (5) consecutive years of archive information. Multiple, sequential blocks of five (5) years cannot be requested from the contractor as a means to access that contractor’s complete archive.

6.1. LEVEL I AND LEVEL II DATA

The prospective contractor may archive Level I data in the form it is transmitted to NOAA and also in a quality-controlled form, i.e., additional quality control has been applied post facto. Both the original and quality-controlled data shall be available to NOAA. Regardless, if the prospective contractor elects to archive Level I data in the transmitted form or not, NOAA reserves the right to archive these data at the NCEI and other national centers such as NWS MDL. NOAA will not archive Level II products, unless the results were issued as part of an official record.

6.2. LEVEL III, IV AND V DATA AND PRODUCTS

NOAA reserves the right to archive Level III data, and Level IV, and V products.

6.3. CONTRACTOR’S ARCHIVE

The prospective contractor shall state the length of time lightning data is retained in its archive. The prospective contractor shall also state sensor changes, changes to the network (e.g. increased sensors in the Pacific Northwest by adding five sensors in Washington State and three in Oregon) and detection efficiency of lightning data in its archive. This information shall be included by the prospective contractor in Tab I of the proposal. If the prospective contractor plans to dispose of any data from its archive, the prospective contractor shall offer the data to NOAA before disposing it. NOAA should be notified at least 3-6 months before contractor archive disposal is to begin.

The prospective contractor shall make archived data available in an electronic form or the ability to download via the Internet for each geographic area on a monthly basis. NOAA line offices will not distribute these data beyond the agency procuring them except that these data may be distributed to other organizations with cooperative arrangements.

To ensure robust, and relevant scientific analysis, experience has demonstrated that a decadal maximum is the most effective span for leveraging archive lightning data. Beyond this rolling, ten-year limit, data older than a decade becomes increasingly more difficult to compare to modern data.

· CONUS cloud-to-ground flash data, and CONUS cloud-to-ground stroke data are available on a rolling, decadal window.

· OCONUS reprocessed data (no CONUS data-merge) are available from January 1, 2012.

6.4. NOAA ARCHIVE

NOAA may store data in line office repositories, at the user and receiver sites, or in the permanent national archive at NCEI. NWS Meteorological Development Lab and the National Centers for Environmental Prediction may also archive the data. The redistribution of archived data is outlined in Section 7.7.2.

7. DATA/PRODUCT DELIVERY REQUIREMENTS

7.1 DATA DELIVERY

The prospective contractor shall deliver streaming lightning data to NOAA as a continuous data stream and the NOAA 1-minute product with an Internet protocol (IP) connection to NOAA’s National Weather Service Telecommunications Gateway (NWSTG).

7.1.1 KEEP ALIVE MESSAGE

During periods when no lightning activity is observed the prospective contractor shall transmit a “keep alive” message indicating that no lightning is occurring throughout the zone. This message is necessary to inform the users that the lack of reported lightning is not due to a failure in the lightning detection network or communications.

7.1.2. HEARTBEAT

The prospective contractor shall add “heartbeat” packets to the data stream whenever 60 seconds have elapsed without receipt of a data packet.

7.2. DELIVERY METHODS

Several ways to receive lightning data are described in Sections 7.2.1. through 7.2.3. NOAA line offices can select the method that best meets their needs; for ease of access and use with other data sets, AWIPS will always be preferred over other processors of lightning data. An option for the contractor is to consider the data format needs of GRAnalyst which many forecasters use to examine lightning data outside of AWIPS.

7.2.1. NOAAPORT

NOAA will receive Level I/III lightning data from the prospective contractor via the NWSTG.

From there CONUS and OCONUS data will be provided and disseminated in real-time via the NOAAPORT/Satellite Broadcast Network (SBN). Level I data may also be disseminated through NOAAPORT/SBN. It will also end up with various offices of the National Centers for Environmental Prediction (NCEP) via a separate feed after distribution to NWSTG. The NOAAPORT/SBN broadcast is intended to meet NOAA’s operational needs, but other users authorized under this SOW can also receive lightning products and data through NOAAPORT.

Lightning data transmitted through NOAAPORT will be encrypted so that unauthorized users may not use them. NOAA will provide the encryption scheme as part of the contract award.

7.2.2. DATA STREAMING

The prospective contractor shall deliver lightning data to the NOAA sites requiring this type of delivery in a continuous data stream. In some cases, this data will be received at receiver sites and could be redistributed to NOAA user sites as specified in section 1.5 and sub-sections. In other cases, the data will be received directly from the prospective contractor at the user site. See the subsections under 7.3 for definitions of receiver and user sites.

Lightning data distributed in a data stream will be transmitted through a secure link to prevent unauthorized use.

7.2.3. INTERNET ACCESS

The prospective contractor shall also provide very reliable and timely products, namely an internet accessible product and a web-based application product, e.g., software, capable of displaying near real-time lightning data as well as querying historical data from the contractor for monitoring purposes over variable sized geographic domains including OCONUS, CONUS and sub-OCONUS/CONUS sized movable domains. This product will be developed to meet NOAA’s needs for a product that can be used by forecasters, incident meteorologists, and cooperating organizations that need limited access to lightning data.

7.3. RECEIVER SITES AND USERS SITES

Sections 7.3.1 through 7.3.2 describe receiver and user sites and the relationship between the two.

7.3.1. RECEIVER SITES

A receiver site is a primary location receiving lightning data either as streaming data directly from the prospective contractor or the 1-minute data product. In general, a receiver site is the first entry point into an agency. Government generated Level III, IV, and V data may be produced at receiver sites for dissemination to user sites.

7.3.2. USER SITES

User sites are locations, which may not necessarily be co-located with receiver sites, using lightning data. User sites are the operational units using the lightning data, not individual work stations. Example: A co-located NWS Weather Forecast Office and River Forecast Center is a user site, but each individual forecaster’s work position would not be counted separately. The use may be for operational purposes, research or testing.

7.4. AVAILABILITY AND RELIABILITY

The contractor’s lightning detection network shall operate and transmit data to NOAA line offices 24-hours a day, seven days a week. Any failure, regardless of the length of time, of either the detection network or of the contractor’s communication system resulting in a loss of availability is defined as a system outage. Any detected loss of transmitted packets will be reported immediately to NWS Operations Center and system messages will be sent to AWIPS recipients as well as to NWS NCEP centers. Contractor shall have process in place to retransmit missing packets immediately.

Systems outages at any receiving site shall not occur for more than 72 cumulative hours over a 12 month period. Of this time no more than 24 hours shall occur during any 30-day period. Outages greater than 1-hour shall require notification to the NWSTG.

The prospective contractor shall grant credits to NOAA against the monthly recurring charges whenever:

1. The system outages exceed a total of 72 hours over any 12-month period, or

2. The system outages exceed 24 hours over the previous 30-day period.

Periods of system outage shall be figured to the nearest hour increment. Credits shall be calculated on a prorated basis using a 30 day month and applied to the monthly billing period. The following equation will be used to calculate credits:

The prospective contractor shall designate a 24 hour-a-day, seven days-a-week point of contact for system problems. The prospective contractor shall initiate corrective action within 1 hour of receiving a report of a problem.

The Prospective contractor shall provide stable network operation, communications, and data display for the entire life of the contract. If the prospective contractor independently makes any modification to its system affecting the lightning data received by NOAA, the prospective contractor shall provide, cost-free to the Government, any hardware or software necessary to insure continuous receipt of data by the government.

The prospective contractor shall monitor the operation of its system 24-hours a day, seven days a week and notify NOAA Contracting Officer and the Contracting Officer’s Representative (COR) of any system outages or significant changes. The prospective contractor will also set up a process for NOAA customers to be immediately notified of outages thru special system file or call to NWS Operations Center; NWS centers and forecast offices can then see notification on AWIPS/N-AWIPS systems and adjust operations accordingly. System outages include maintenance (scheduled or unscheduled) or any change implementation requiring the detection network or communications to be out of service. Planned outages shall be announced at least two weeks in advance. Unplanned outages shall be announced as soon as possible after the prospective contractor becomes aware of the outage. This information is necessary to inform Government users of apparent changes in lightning activity due to changes in the performance of the prospective contractor’s lightning detection network or communications.

7.5. GOVERNMENT TESTING

NOAA reserves the right to verify the characteristics of the prospective contractor’s claims, performance metrics, and delivery methods as needed prior to, and after contract award. There are further testing requirements that will be communicated between NOAA and the contractor. The prospective contractor shall provide as much supporting evidence as possible concerning claims, performance characteristics and verification for all required specifications within this SOW. Third party verification will be required.

7.6. ACCEPTANCE OF CONTRACTOR LIGHTNING DATA

The primary risk in delivery of lightning data to NOAA is associated with the data encryption/decryption, and data format. To reduce risk in this area, when there are any data field or format changes, the contractor shall provide NOAA with sample lightning data in the form of a Red Hat LINUX-compatible TAR format CD containing encoded lightning data in compliance with the contract data format requirements. The sample lightning data shall include 10 records each containing FLASH (U.S. data), and Real-Time (International data) Cloud-to-Ground lightning. The contractor shall provide a set of lightning data which is un-encrypted and which represents the encrypted data. NOAA will verify the effectiveness of the encrypting technique by comparing this data to the content of the encrypted data following decryption. NOAA acceptance of the data shall be dependent on: 1) verification that the data content meets the requirement of the contractor data format specification, and 2) verification that the encryption technique complies with the requirements of the NIST Advanced Encryption Standard (AES) technique (FIPS 197). During this analysis, NOAA will verify that the header record is constructed in accordance with the contract specification and that it is not encrypted.

7.7. REDISTRIBUTION RIGHTS

The data provided under this contract may be used in any manner by NOAA, including incorporation within any other information product or system of NOAA, and redistribution, in whole or part, without attribution as incorporated into other NOAA derived products as long as such products do not have sufficient information to readily retrieve the original content of the lightning data provided by the prospective contractor. All products should include name of contractor for attribution. Further information on data rights and archiving is contained in Sections 6 and 7.6.2.

The following sections describe the rights of NOAA to redistribute lightning data.

7.7.1. REDISTRIBUTION OF REAL-TIME DATA

Level I Through V Data/Products - NOAA may redistribute Level I, II, III, and IV Data/Products to any NOAA line offices and to any organization defined under Section 1.5 & subsections. Data may only be distributed to organizations under the auspices of the WMO or to foreign governments with which NOAA has explicit agreements about the exchange of lightning data in foreign countries, with which international arrangements have been established with a partnering NOAA line office, and with a formal agreement from the contractor. Non real time data/products may be included in scientific papers or journal articles with proper acknowledgement to the prospective contractor where applicable. Internet redistribution is allowed to participating agencies through secure Internet connections that deny access to unauthorized organizations or individuals.

Level V Data - NOAA may freely distribute the Level V Data to any user.

7.7.2. REDISTRIBUTION OF ARCHIVED DATA

The redistribution of archived data is bounded by the same contract user requirements described in Section 1.5 and sub-sections.

Level I Data - Level I data will be archived at NOAA national centers (see Section 6.1), and it may be disseminated to the other NOAA line offices and to any other organization that requests the products through a NOAA line office. Requests from other organization not specified as being authorized users per this contract, shall be approved only with prior, written agreement from the contractor.

NOAA may disseminate archived Level I data to line offices included in the contract. Dissemination to cooperating organizations shall require the prior, written approval of the contractor

Internet redistribution is allowed to NOAA line offices secure Internet connections that deny access to unauthorized organizations or individuals.

Level II Products - NCEI and other NOAA offices will not archive Level II products unless they were issued in an official capacity.

NOAA line offices may disseminate archived Level II data to lightning data users as stated in Section 1.5 and sub-sections.

Internet redistribution is allowed to NOAA line offices and lightning data users as stated in Section 1.5 and sub-sections through secure Internet connections that deny access to unauthorized organizations or individuals.

Level III Data and IV Products – NOAA line offices may redistribute archived Level III data and Level IV products to NOAA participating agencies as described in Table 1-1, and Section 1.5 and sub-sections. The redistribution of Level III data to other organizations shall require the prior, written approval of the contractor.

Participating line offices may disseminate archived Level III and IV data/products to the participating NOAA line offices included in the contract and to their cooperating organizations as outlined under Section 1.5 and sub-sections. Dissemination to cooperating organizations shall require the prior, written approval of the contractor.

Internet redistribution is allowed to participating agencies through secure internet connections that deny access to unauthorized organizations or individuals.

Level V Data - NCEI and NOAA line offices may freely distribute the archived Level V Data to any user.

8. OPTIONAL SERVICES.

8.1 CONTRACTOR DEVELOPED APPLICATIONS.

The prospective contractor may make available to NOAA Level II CG lightning products. These products shall be offered as options under this SOW and the prospective contractor must describe in as much detail as needed in their response to this SOW on each and every product being offered. Contractor-supplied Level II products shall be used only by the participating NOAA line offices and will not be redistributed beyond them unless approved by the prospective contractor.

8.2 UPDATED CG LIGHTNING DETECTION EFFICIENCY AND LOCATION ACCURACY MAPS.

The contractor may offer real-time or near-real time global and regional maps of detection efficiency and location/timing accuracy to ascertain any impacts to CG lightning data from network changes or sensor outages. This information is very important during severe weather situations, and for fire weather applications, lightning safety, detecting thunderstorms over OCONUS areas, and research use of data.

APPENDIX A - GEOGRAPHIC COVERAGE MAPS

The contractor will provide lightning data for 2 geographic areas.

CONUS: Forty-Eight Contiguous States and Puerto Rico Coverage extends 500 km offshore/over adjacent land areas

· United States (48 Contiguous States) approximately bounded by 60N 130W, 10N 130W, 10N 50W, 60N 50W

· Puerto Rico

· District of Columbia

· U.S. Virgin Islands

OCONUS

Coverage outside the Continental United States (OCONUS) will include data on a defined grid area (specifically between 25 degrees South to North Pole (latitude) and 30 degrees East westward to 115 degrees East (longitude)) less the CONUS coverage identified above. Additionally, in support of the validation of the Geostationary Lightning Mapper (GLM), eastwards from 150 degrees West to 30 degrees West the southern boundary of the area will extend to 52 degrees South. This will meet requirements for NWS Pacific and Alaska Regions of NWS and the Aviation Weather Center, as well as to provide consistent coverage over areas of world without GLM or that have older sferic detection networks, that are less accurate and reliable (such as over Europe):

Alaska Hawaii Mexico Pacific

AtlanticEastern Asia
Europe

11 Acquisition Sensitive image1.png

File details come from the government source that posted it. Updated .