Attachment J.6 - NCEI Regional Weather Records Centers Data Management Plan.pdf
PDF 525 KB Posted
- Attached to
- National Centers for Environmental Information (NCEI) Western Regional Weather Records Center (WRWRC)
- Solicitation number
- 1332KP26R0028
About this file
This is a Data Management Plan (DMP) for the NOAA National Centers for Environmental Information (NCEI) Regional Climate Data Product Area, version 2.3, effective August 1, 2021.
The document outlines the management of value-added climate data and products created by six contracted Regional Climate Centers (RCCs) serving regions across the United States: High Plains Regional Climate Center (Lincoln, NE), Midwestern Regional Climate Center (West Lafayette, IN), Northeast Regional Climate Center (Ithaca, NY), Southeast Regional Climate Center (Chapel Hill, NC), Southern Regional Climate Center (College Station, TX), and Western Regional Climate Center (Reno, NV). The Regional Climate Service program is congressionally mandated. The RCCs produce and deliver climate data, products, information, and services for decision makers at local, state, regional, and national levels. Key products managed under this plan include the Applied Climate Web Services (ACIS), Automated Weather Dataset, Climate and Forecast Perspectives, Climate Data Collection (WxCoder), Climate Data Quality Control (Datzilla), Climate Tools for Agriculture, Extremes (Threadex), Freeze/Thaw indices, Regional Climate Summaries and Webinars, Regional Mesonet Products, Regional Winter Weather, Sporting Events Climatologies, Station-Based Climate Data and Summaries, Tropical Weather and Impacts, and Vegetation Impact Products. Data types are primarily digital numeric data classified as Level 1 (Long Term Preservation and Basic Access), Level 3 (Scientific Improvements), or Level 4 (Derived Products). Temporal coverage ranges from the late 1800s to present, with spatial coverage at national, regional, or location-specific levels depending on the product.
Data collection methods include in situ networks such as the NWS Cooperative Observer Network, NWS Automated Surface Observing Network, NCEI Forts data, and various state and regional weather stations. NCEI-generated products are archived at NCEI and represented by ISO 19115 compliant metadata records in the NOAA OneStop catalog, accessible through multiple interoperable services including OPeNDAP, THREDDS, ERDDAP, and FTP. RCC-generated products are currently stored at the individual RCCs rather than formally archived by NCEI. All data products are publicly available without restriction in compliance with NAO 212-15. Quality control procedures include statistical methods, peer-reviewed publication, and standards recommended by the National Academy of Sciences. NCEI-generated products undergo FISMA-compliant processing with backup and disaster recovery systems in place. The point of contact for this plan is Tamara Houston, Physical Scientist at NCEI, with overall responsibility held by Jeff Privette, Division Chief of the Climatic Science and Services Division.
View the file
Other files
Show all 15
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
Data Management Plan for the Regional Weather Records Centers Product Area v2.3 (20210801)
NCEI Regional Climate Data Product Area Data Management Plan
Overview
The NOAA National Centers for Environmental Information (NCEI) mission is to serve as steward of the Nation’s environmental information. NCEI constitutes the official NOAA data archive and is a designated NARA Agency Records Center1. NCEI maintains, processes, distributes, and provides long-term stewardship for most of NOAA's environmental and geospatial data, and provides a broad range of user services. NCEI is operated by NESDIS but performs data preservation and stewardship on behalf of the entire agency. NCEI supports U.S. and international environmental, societal, and economic well-being through stewardship of the Nation’s treasure of weather, climate, coastal, oceanic, and geophysical information.
In addition to stewarding and preserving data generated and collected by other parts of NOAA, NCEI also creates value-added datasets and products from the archived data. In 2018, NCEI began organizing these value-added products into Product Areas. With consultation from the NESDIS Data Management Working Group, NCEI determined to document one Data Management Plan per Product Area.
Currently, 29 Product Areas have been defined by NCEI’s Oceanographic and Geophysical Science and Services Division (OGSSD) and Climate Science and Services Division (CSSD). This document is the Data Management Plan for the NCEI Regional Climate Data Product Area.
1. General Description of Data to be Managed
1.1. Name of the Data, data collection Project, or data-producing Program:
All value-added data and products created and managed by the NCEI/CSSD Regional Climate Product Area. For this NCEI product area, the value-added products are created by and served from the Regional Climate Centers (RCCs).
1.2. Summary description of the data:
The Regional Climate Product Area provides climate products to six regions encompassing the United States through NCEI’s Regional Climate Service (RCS) program. Six contracted regional climate centers (RCCs) produce and deliver climate data, products, information, and services for decision makers and other users at the local, state, regional, and national levels. The product suite is responsive to specific and validated user needs that support the economic and commercial activity in the respective regions. The RCS program is mandated by Congress.
1 www.archives.gov/files/foia/directives/nara1310.pdf https://www.ncei.noaa.gov/regional/regional-climate-centers https://www.ncei.noaa.gov/regional/regional-climate-centers http://www.archives.gov/files/foia/directives/nara1310.pdf
Data Management Plan for the NCEI Regional Climate Product Area v2.3 (20210801)
The six RCC’s and their locations are:
● High Plains Regional Climate Center (HPRCC) - Lincoln, NE
● Midwestern Regional Climate Center (MRCC) - West Lafayette, IN
● Northeast Regional Climate Center (NRCC) - Ithaca, NY
● Southeast Regional Climate Center (SERCC) - Chapel Hill, NC
● Southern Regional Climate Center (SRCC) - College Station, TX
● Western Regional Climate Center (WRCC) - Reno, NV
This NCEI product area currently includes the following products, created and served by the RCCs:
Table 1: Summary characteristics of the data sets managed under this DMP.
Data from NCEI Regional Climate Product Area
Long Name (Short Name) /
Description
One Time or
Ongoing (1.3)
Temporal Coverage
(1.4)
Spatial Coverage
(1.5)
Data Type (1.6), Tier of Stewardship, and Processing Level (4.2)
Data Collection Method (1.7)
NOAA Observing System or Source (1.8)
Applied Climate Web Services
(aka ACIS, NRCC) The Applied Climate Information System (ACIS) is a system architecture developed, maintained, and operated by the NOAA Regional Climate Centers (RCCs). It manages the complex flow of climate information from climate data collectors to end users of climate data information. ACIS includes an integrated metadata system for data and observation discovery; national, regional, and local datasets; is used as a data source for RCC
Ongoing
Primarily late 1940s -
Present.
Some data back to 1871.
National
Digital numeric data, Level 4 -
Derived Products
In situ networks - GHCN-D, DSI-3210, DSI-3200, DSI-3206, TD-3299, TD-
3298, TD-3205, CLI/CF6, DSM, SHEF
http://www.rcc-acis.org/ websites and delivers climate data-products to supply information to partners and other end-users.
Automated Weather Dataset
(HPRCC) The Automated Weather Data Network (AWDN) represents a longstanding partnership among states in and around the High Plains Region with the purpose of gathering observational data and providing this information to stakeholders in agriculture and related fields. The AWDN provides valuable observation data, serving clients around the world. Daily, hourly, and sub-hourly data provided by the AWDN fill in major gaps between other networks, such as the Cooperative Observer Program (COOP) and the Automated Surface Observing System
(ASOS).
Ongoing
May 1981 - Present
Colorado, Iowa, Kansas, Minnesota, Missouri, Montana, Nebraska, North Dakota, Wyoming
Digital numeric data, Level 1 -
Long Term Preservation and Basic Access
In situ networks - state and regional weather stations
Climate and Forecast Perspectives
(SERCC) Climate Perspectives ranks a period of observations at a station against the normals and historical observations for the same period. Forecast Perspectives places recent conditions and short-term forecasted conditions in both a historical and geographical perspective.
Ongoing
Depends on station period of record
Climate Perspectives:
Nationwide per each RCC Region;
Forecast
Perspectives:
Southeast
Region only
Digital numeric data, Level 4 -
Derived Products
In situ networks - GHCN-D, Normals, NWS NDFD
Climate and Health
(SERCC) - A suite of resources focused on climate change and human health impacts across the Southeast Region and the US.
Topics include: increased temperatures and heat stress, water scarcity, air quality, infectious disease, and general information for public health professionals.
One Time Primarily Southeast
Web links to resources, Level 4 - Derived Products
Informational resources
Climate Data Collection
(aka WxCoder, WRCC) WxCoder is a web-based data entry system that allows climate observers in the NOAA’s National Weather Service Cooperative Network program to enter daily observations for near real-time reporting and for official entry into NCEI. The WxCoder system is national in scope and available to everyone in the Cooperative Network. It functions in parallel with IV-ROCS, the telephone entry system for Cooperative observers. With WxCoder, the volunteer observer can enter weather observations, view and edit old observations, graph daily climate trends, and officially submit observations into the NOAA archive at NCEI. All web-based COOP observations are submitted through WxCoder. This is the operational system for documenting observations that form the long-term climate record of the US.
Ongoing
Primarily late 1940s - Present.
Some data back to 1871.
National
Digital numeric data, Level 4 -
Derived Products
NWS COOP Observer Network https://hprcc.unl.edu/awdn/index.php https://sercc.com/climate-perspectives/ https://convergence.unc.edu/ https://wxcoder.org/
Climate Data Quality Control
(aka Datzilla, SRCC) Datzilla is a web-based system used to report and track errors in NOAA datasets and data-products. NOAA users can enter tickets in the system when they discover errors in the data provided by NCEI. As Needed
Dependant on dataset in question
National
Digital numeric data, Level 3 -
Scientific Improvements
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry data, USDA Remote Automated
Weather Station data
Climate Tools for Agriculture
(HPRCC, MRCC, NRCC) HPRCC, MRCC, NRCC
- Analyses for Industry
Each RCC provides a variety of climate tools for the agricultural sector in their region including tools for irrigation, fieldwork days, growing degree days, frost risk, and disease and pest control.
Product Driven - Weekly, Daily, etc
Depends on the product
Regional, National
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry data, USDA Remote Automated
Weather Station data
GHCN-Daily, Integrated Surface Hourly, State Mesonets
Extremes
(aka Threadex, NRCC) WxCoder is a web-based data entry system that allows climate observers in the NOAA’s National Weather Service Cooperative Network program to enter daily observations for near real-time reporting and for official entry into NCEI. The WxCoder system is national in scope and available to everyone in the Cooperative Network. It functions in parallel with IV-ROCS, the telephone entry system for Cooperative observers. With WxCoder, the volunteer observer can enter weather observations, view and edit old observations, graph daily climate trends, and officially submit observations into the NOAA archive at NCEI. All web-based COOP observations are submitted through WxCoder. This is the operational system for documenting observations that form the long-term climate record of the US.
Ongoing Annual update in April
Late 1800s to present
ConUS, AK, HI, Pacific Islands, Puerto Rico
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry
GHCN-Daily, NCEI DSI3210, DSI3200, DSI3206, DSI3205
Freeze/Thaw
(NRCC) In seasonal frost areas, as freezing occurs the road becomes stiffer and stronger. Many state Departments of Transportation take advantage of the period of higher strength in mid-winter by applying winter weight premiums (WWPs), increasing the allowable weight that trucks can haul. During late winter and early
Ongoing November
2016 - Present
Northeast Region (Maine, New Hampshire), North Dakota
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow https://datzilla.srcc.tamu.edu/ https://hprcc.unl.edu/agroclimate/ https://mrcc.purdue.edu/ag-climate-dashboard http://www.nrcc.cornell.edu/ http://threadex.rcc-acis.org/ http://www.nrcc.cornell.edu/industry/roads/ spring when the top road layers begin thawing and can’t drain excess water, the road is highly susceptible to damage. To reduce roadway damage, many highway agencies apply spring load restrictions (SLR) during the critical time interval when the pavement is most vulnerable to damage.
Network, NCEI Climate Reference Network, USDA Snowpack Telemetry
GHCN-Daily, NWS Forecasts
Regional Climate Summaries and Webinars (All RCCs) - A suite of regional outreach materials consisting of monthly webinars for the Eastern and Central regions and handouts highlighting regional impacts and outlooks (i.e. 10 regional and sub-regional quarterly reports, regional special reports on drought and ENSO).
Summaries
Webinars: HPRCC, MRCC, NRCC, SERCC
Ongoing - Monthly and Quarterly
2012 - Present
Regional
Pdfs and webinars, Level
4 - Derived Products
NCEI and RCC products are incorporated into each report and webinar
Regional Mesonet Products
(MRCC) The Regional Mesonets And Partners Project (RMP) is a collaboration of multiple states and mesonet groups in and around the Midwest Region. It offers the opportunity to see the regional value of mesonet data when various networks are brought together.
Ongoing
Depends on the network.
Archived maps back to June 2014.
Illinois, Indiana, Iowa, Kentucky, Michigan, Missouri, Ohio, North Dakota, Kansas, Colorado
Digital numeric data, Level 1 -
Long Term Preservation and Basic Access
In situ networks - State and regional weather stations such as North
Dakota Automated Weather Network
Regional Winter Weather
(MRCC) Generally provided through the Accumulated Winter Season Severity Index
- AWSSI. The character of a winter can be defined by many of its features, including temperature averages and extremes, snowfall totals, snow depth, and the duration between onset and cessation of winter-weather conditions. The accumulated winter season severity index incorporates these elements into one site-specific value that defines the severity of a particular winter, especially when examined in the context of climatological values for that site.
Ongoing 1950 -
Present National
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry
GHCN-Daily
Sporting Events Climatologies
(SERCC) A series of climatologies for major sporting events such as the Super Bowl, PGA Tournaments, the Kentucky Derby, NASCAR Races, and major festivals.
Ongoing Depends on event
National
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry
GHCN-Daily, Normals, NWS National Digital Forecast Database https://www.drought.gov/reports https://hprcc.unl.edu/webinars.php https://mrcc.purdue.edu/webinars https://www.nrcc.cornell.edu/ https://www.drought.gov/webinars?page=1&search=Southeast%20Climate%20Monthly%20Webinar https://mrcc.purdue.edu/RMP/ https://mrcc.purdue.edu/research/awssi https://sercc.com/sporting-climatology/
Station-Based Climate Data and Summaries
(All RCCs) HPRCC, MRCC, NRCC, SERCC, SRCC, WRCC
Each RCC has developed a wide range of station-based summaries that include station normals, records and thresholds for temperature and precipitation. These summaries can be found on the RCC website, as a part of their CLIMOD databases, or as a part of ACIS.
Ongoing
Dependant on station period of record.
Primarily late 1940s -
Present.
Some data back to 1870s.
Regional, National
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry
GHCN-Daily
Tropical Weather and Impacts (SRCC) - A suite of tropical resources such as tropical outlooks and discussions, storm tracks, satellite imagery, and hurricane preparedness information-
Ongoing 2005 -
Present Regional
Digital numeric data, Level 4 -
Derived Products
NOAA NHC
Vegetation Impact Products
(MRCC)The Vegetation Impact Program (VIP) is a monitoring, assessment, and networking program. Major impacts on vegetation are often driven by weather and climate conditions. For example, damaging frost events, drought, and even flooding can impact vegetation in areas of agriculture, horticulture, nurseries, or home gardening. Pests and disease are also driven by environmental conditions. The VIP integrates online climate monitoring information, weather and climate outlooks, and stakeholder input to provide a suite of resources that can help minimize negative vegetation impacts, mitigate climate variability effects, and develop adaptation plans to better prepare for extreme and ever-changing environmental conditions.
Ongoing
Station Climatologi es, Current
Growing Season
National
Digital numeric data, Level 4 -
Derived Products
In situ networks - NWS Cooperative Observer Network, NWS Automated
Surface Observing Network, NCEI Forts data, Global Climate Observing System, High Plains Regional Climate
Center real-time surface data, monthly METAR, Community
Collaborative Rain, Hail, and Snow Network, NCEI Climate Reference
Network, USDA Snowpack Telemetry
GHCN-Daily, Integrated Surface Hourly, Drought Indices, User Inputs
1.3. Is this a one-time data collection, or an ongoing series of measurements?
See Table 1
1.4. Actual or planned temporal coverage of the data:
See Table 1
1.5. Actual or planned geographic coverage of the data:
See Table 1
1.6. Type(s) of data: (e.g., digital numeric data, imagery, photographs, video, audio, database, http://climod.unl.edu/ https://mrcc.purdue.edu/newclimate/home http://climod2.nrcc.cornell.edu/ https://sercc.com/ https://www.srcc.tamu.edu/climate_data_viewer/ https://wrcc.dri.edu/Climate/summaries.php https://www.srcc.tamu.edu/tropical_desk https://mrcc.purdue.edu/VIP tabular data, etc.)
See Table 1
1.7. Data collection method(s): (e.g., satellite, airplane, unmanned aerial system, radar, weather station, moored buoy, research vessel, autonomous underwater vehicle, animal tagging, manual surveys, enforcement activities, numerical model, etc.)
See Table 1
1.8. If data are from a NOAA Observing System of Record2, indicate name of system(s):
See Table 1
1.8.1. If data are from another observing system, please specify:
In some cases this is UNKNOWN because these data are collected from non-federal networks.
2. Point of Contact for this Data Management Plan (author or maintainer)
2.1. Name: Tamara Houston
2.2. Title: Physical Scientist
2.3. Affiliation or facility: NOAA National Centers for Environmental Information (NCEI)
2.4. E-mail address: tamara.houston@noaa.gov
2.5. Phone number: (828) 271-4266
3. Responsible Party for Data Management Program Managers, or their designee, shall be responsible for ensuring the proper management of the data produced by their Program. Please indicate the responsible party below.
3.1. Name: Jeff Privette
3.2. Position Title: Division Chief, Climatic Science and Services Division
4. Resources Programs must identify resources within their own budget for managing the data they produce.
4.1. Have resources for management of these data been identified?
See Table 1
4.2. Approximate percentage of the budget for these data devoted to data management (specify percentage or "unknown"):
See Table 1
5. Data Lineage and Quality NOAA has issued Information Quality Guidelines3 for ensuring and maximizing the quality, objectivity, utility, and integrity of information which it disseminates.
5.1. Processing workflow of the data from collection or acquisition to making it publicly accessible:
2 https://docs.google.com/spreadsheets/d/1uC_FxXYP9LYvY6ofhXRPplxiP9sZI3bhCpkKtwDsk3o/edit#gid=1462893252 3 https://www.noaa.gov/node/6009 https://mail.google.com/mail/?view=cm&fs=1&tf=1&to=tamara.houston@noaa.gov&su=&body= https://docs.google.com/spreadsheets/d/1uC_FxXYP9LYvY6ofhXRPplxiP9sZI3bhCpkKtwDsk3o/edit#gid=1462893252 https://www.noaa.gov/node/6009
The input data used to create the value-added products in this Product Area come from various providers, including NOAA and non-NOAA observing systems. Scientific quality assessment and control algorithms are applied to remove systematic and nonsystematic errors. Science-based algorithms are applied to the original data to create higher level products that serve as the core elements of the Product Area. The derived products are quality-assessed. Currently these products are managed outside of the NCEI Archive by the RCCs.
5.2. Quality control procedures employed (describe or provide URL of description):
NCEI data and products follow standard quality procedures which include one or more of the following methods: Employ various statistical methods to check data precision and accuracy;
Publish results in peer-reviewed articles in domain-relevant journals; Adopt quality standards recommended by the National Academy of Sciences and other expert organizations to ensure consistent, reliable, and scientifically defensible products. The RCCs also work directly with NCEI when data errors are found and perform quality control checks on the products they produce.
6. Data Documentation The EDMC Data Documentation Procedural Directive4 requires that NOAA data be well documented, specifies the use of ISO 19115 and related standards for documentation of new data, and provides links to resources and tools for metadata creation and validation.
6.1. Does metadata comply with EDMC Data Documentation directive5?
Yes, NCEI-generated data products are represented by an ISO 19115 compliant collection-level metadata record in the NOAA OneStop catalog. RCC-generated products are not.
6.1.1. If metadata are non-existent or non-compliant, please explain:
Applicable metadata for RCC-generated products is located at the RCC along with the product.
6.2. Name of organization or facility providing metadata hosting:
Metadata are hosted by NCEI and available through numerous mechanisms detailed below, including Web Accessible Folders (WAFS), a Geoportal Server and REST API, and the NOAA OneStop user interface and API. Metadata hosted by the RCCs are available by contacting the applicable RCC.
6.2.1. If service is needed for metadata hosting, please indicate: No metadata hosting service is required.
6.3. URL of metadata folder or data catalog, if known:
All NCEI metadata records are discoverable through the NOAA OneStop web interface at https://data.noaa.gov/onestop as well as the NCEI Geoportal Server web interface at https://www.ncei.noaa.gov/metadata/geoportal (will go live soon). In addition, NCEI metadata records can be browsed via the Web Accessible Folder (WAF) at https://data.nodc.noaa.gov/nodc/archive/metadata/approved/ (location to be updated to https://data.noaa.gov/wafs/NOAA/NESDIS/NCEI in near future). NCEI’s metadata can also be searched via the following interoperable machine services:
4 https://nosc.noaa.gov/EDMC/PD.DD.php 5 https://nosc.noaa.gov/EDMC/documents/DataDocumentationPD-v2.0.0.signed.pdf https://data.noaa.gov/onestop https://www.ncei.noaa.gov/metadata/geoportal https://data.nodc.noaa.gov/nodc/archive/metadata/approved/ https://data.noaa.gov/wafs/NOAA/NESDIS/NCEI https://nosc.noaa.gov/EDMC/PD.DD.php https://nosc.noaa.gov/EDMC/documents/DataDocumentationPD-v2.0.0.signed.pdf
Service Name Base URL Help
OneStop Search
API
https://data.noaa.gov/onestop-search/search/collection https://data.noaa.gov/onestop-search/search/granule
Web Interface:
https://data.noaa.gov/one stop/#/help
API:
https://cedardevs.github.io /onestop/api/search-api
Catalog Service for the Web
(CSW)
https://www.ncei.noaa.gov/metadata/geo portal/csw?service=CSW&version=3.0.0&re quest=GetRecords https://www.ncei.noaa.gov/m etadata/geoportal/help (These services will be publicly available soon.)
OpenSearch https://www.ncei.noaa.gov/metadata/geo portal/opensearch
JavaScript Object Notation (JSON) https://www.ncei.noaa.gov/metadata/geo portal/opensearch?&f=json
Keyhole Markup Language (KML) https://www.ncei.noaa.gov/metadata/geo portal/opensearch?&f=kml
Comma Separated Value (CSV) format https://www.ncei.noaa.gov/metadata/geo portal/opensearch?&f=csv
Really Simple Syndication (RSS) https://www.ncei.noaa.gov/metadata/geo portal/opensearch?&f=rss
Metadata hosted by the Regional Climate Centers are available by contacting the applicable RCC
6.4. Process for producing and maintaining metadata (describe or provide URL of description):
NCEI has a robust process for developing metadata. Data stewards develop standards, best practices and implementation strategies in alignment with the EDMC Procedural Directives.
Technology stewards develop tools to assist in metadata development and verification. The Science stewards are trained in these best practices and tools. Both Science and Data stewards develop and maintain metadata. At the RCCs, various methods are taken to produce and maintain metadata for the value-added products created at each RCC.
7. Data Access NAO 212-156 states that access to environmental data may only be restricted when distribution is explicitly limited by law, regulation, policy (such as those applicable to personally identifiable information or protected critical infrastructure information or proprietary trade information) or by
6 https://nosc.noaa.gov/EDMC/documents/NAO_212-15_Signed_4pg.pdf https://data.noaa.gov/onestop-search/search/collection https://data.noaa.gov/onestop-search/search/collection https://data.noaa.gov/onestop-search/search/granule https://data.noaa.gov/onestop-search/search/granule https://data.noaa.gov/onestop/#/help https://data.noaa.gov/onestop/#/help https://cedardevs.github.io/onestop/api/search-api https://cedardevs.github.io/onestop/api/search-api https://www.ncei.noaa.gov/metadata/geoportal/csw?service=CSW&version=3.0.0&request=GetRecords https://www.ncei.noaa.gov/metadata/geoportal/csw?service=CSW&version=3.0.0&request=GetRecords https://www.ncei.noaa.gov/metadata/geoportal/csw?service=CSW&version=3.0.0&request=GetRecords https://www.ncei.noaa.gov/metadata/geoportal/help https://www.ncei.noaa.gov/metadata/geoportal/help https://www.ncei.noaa.gov/metadata/geoportal/opensearch https://www.ncei.noaa.gov/metadata/geoportal/opensearch https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=json https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=json https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=kml https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=kml https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=csv https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=csv https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=rss https://www.ncei.noaa.gov/metadata/geoportal/opensearch?&f=rss https://nosc.noaa.gov/EDMC/documents/NAO_212-15_Signed_4pg.pdf security requirements. The EDMC Data Access Procedural Directive7 contains specific guidance, recommends the use of open-standard, interoperable, non-proprietary web services, provides information about resources and tools to enable data access, and includes a Waiver to be submitted to justify any approach other than full, unrestricted public access.
7.1. Do these data comply with the Data Access directive?
Yes. All data products in the Regional Climate Product Area are publicly available without restriction.
7.1.1. If the data are not to be made available to the public at all, or with limitations, has a Waiver (Appendix A of Data Access directive) been filed?
Not Applicable
7.1.2. If there are limitations to public data access, describe how data are protected from unauthorized access or disclosure:
Not Applicable
7.2. Name of organization of facility providing data access: NCEI (for the input data sources) and the RCCs (for the value-added products and services).
7.2.1. If data hosting service is needed, please indicate: No data hosting service is needed.
7.2.2. URL of data access service, if known:
All NCEI data access services are available from https://www.ncei.noaa.gov. Also, see links in section 1.2 above for product-specific URLs.
7.3. Data access methods or services offered:
NCEI offers HTTPS, THREDDS, LAS, ArcGIS Server, OPeNDAP Hyrax Server, ERDDAP, FTP download, project-specific interfaces, and Customer Support services for the input datasets used by the RCCs to create their value-added products and services. Not all datasets are available through all services. The value-added products and services created by the RCCs for this product area are available through a variety of methods which can be determined by contacting the RCCs.
7.4. Approximate delay between data collection/production and dissemination:
Input data are collected by other scientists within NCEI on daily and monthly bases. Monitoring products are derived at weekly and monthly time-stamps, with generally a 2-day delay to allow for appropriate collection, quality control and dataset generation by our Dataset and Products Sections.
7.4.1. If delay is longer than latency of automated processing, indicate under what authority data access is delayed:
All NCEI-generated value-added products are made available upon completion of automated and/or manual processing and review workflow steps. No additional delays are introduced. The same is generally true for the value-added products created by the RCCs.
8. Data Preservation and Protection
7 https://nosc.noaa.gov/EDMC/documents/EDMC-DataAccess-PD.v1.0.pdf https://www.ncei.noaa.gov/ https://www.ncei.noaa.gov/ https://nosc.noaa.gov/EDMC/documents/EDMC-DataAccess-PD.v1.0.pdf
The NOAA Procedure for Scientific Records Appraisal and Archive Approval8 describes how to identify, appraise and decide what scientific records are to be preserved in a NOAA archive.
8.1. Actual or planned long-term data archive location:
All NCEI-generated value-added products are archived at NCEI. The value-added products in this product area created by the RCCs are currently stored for the longer term at the RCCs not formally archived by NCEI.
8.1.1. If World Data Center or Other, specify:
NCEI is an ICSU World Data System for Oceanography, Geophysics, Meteorology, and Paleoclimatology.
8.1.2 If To Be Determined, Unable to Archive or No Archiving Intended, explain:
Not applicable.
8.2. Data storage facility prior to being sent to an archive facility (if any):
All NCEI-generated value-added products are developed and stored at NCEI. The value-added products created by the RCCs for this product area are developed and stored at the RCCs.
8.3. Approximate delay between data collection and submission to an archive facility:
The input data sources used by the RCCs are typically submitted to the NCEI archival process by the original data collectors and are made available immediately upon completion of automated and/or manual processing and review workflow steps. No additional delays are introduced.
Currently, the value-added products created by the RCCs are not submitted to NCEI for archiving.
8.4. How will the data be protected from accidental or malicious modification or deletion prior to receipt by the archive? Discuss data back-up, disaster recovery/contingency planning, and off-site data storage relevant to the data collection:
All NCEI-generated value-added products are produced and processed on FISMA-compliant systems with current system security measures and monitoring in place. Data processing systems are backed-up in order to support disaster recovery. The same is true for the input data sources archived at NCEI and used by the RCCs in their creation of the value-added products.
The value-added products themselves are created, served, and protected by the RCCs directly following a variety of methods and approaches.
9. Additional Line Office or Staff Office Questions NESDIS does not require any additional line office-specific questions at this time.
8 https://nosc.noaa.gov/EDMC/documents/NOAA_Procedure_document_final_12-16-1.pdf https://nosc.noaa.gov/EDMC/documents/NOAA_Procedure_document_final_12-16-1.pdf
File details come from the government source that posted it. Updated .