Amendment 0001 - Attachment J.8 - Data Management Operations and Services SOP Number 10-1-009.pdf

NOAA’s NATIONAL CENTERS FOR

ENVIRONMENTAL INFORMATION

Data Management, Operations, and Services Standard Operating Procedure

SOP Number 10-1-009 Version 1.0

Product, Dataset, or System Operational Readiness Review (ORR)

Document Owner: NCEI ORR Panel

Issued: August 01, 2024 Review Date: August 01, 2025

1. Purpose.

NCEI’s Operational Readiness Review process is in place to ensure the center is ready to operate new hardware or a software system in the operational environment and/or produce and release new datasets or products to the center's customer base on an operational basis.

This single ORR process, via a checklist, is intended to ensure the requirements of all NCEI Divisions have been addressed, and that each Division is prepared to support the new Product, Dataset, or System (PDS).

2. Scope.

The ORR is the last major phase of a project, and its successful completion requires a series of actions from the beginning to the end of a project. Entities subject to the ORR process can include any Product, Dataset, or System, including changes to associated algorithms developed by an NCEI division. An ORR is required for any new PDS released into the NCEI operational (production) environment. It is also required for any significant changes to an existing PDS, such as moving from the On-Prem environment to a Cloud environment.

3. General.

Implementing and using the ORR process is an integral part of NCEI’s PDS to ensure our environmental information remains authoritative, our systems function properly, and provide integrity to our stakeholders.

OPR: ORR Panel SOP 10-1-009 August 01, 2024

4. Procedure.

The purpose of an NCEI Operational Readiness Review is to ensure that NCEI is ready to operate a new hardware or software system in the NCEI operational environment and/or produce and release new datasets or products to NCEI’s customer base on an operational basis. The ORR checklist can be found in the ORR-Checklist-Final Google sheet.

4.1. Roles and Responsibilities

4.1.1. Point of Contact / Project Lead - The Project Lead is the technical subject matter expert responsible for the PDS and is also responsible for satisfying the requirements and getting said approval as stated in the ORR checklist before the ORR presentation.

4.1.2. Project Manager - The Project Manager is the Federal Supervisor of the Lead, who is championing the ORR's success.

4.1.3. ORR Chair - An independent facilitator to ensure the ORR process is upheld and maintains a standard of conduct for the process.

4.1.4. ORR Secretariat - Serves as ORR Panel coordinator for the POC or Project Lead to schedule an ORR, as well as being responsible for the agenda, issuing reminders, providing materials to the members, updating the ORR repository, and providing the final audit/verification of the ORR results.

4.1.5. ORR Panelist - Each divisional representative has voting authority on the adjudication of an ORR.

4.2. ORR Milestones

4.2.1. Project Approval

● A project has been approved for development at the divisional level. The product lead should write a project charter to include objectives, timelines, staffing, data sources, archival and access plans, and IT requirements including software and deployment plans. This charter will provide a starting point for the ORR checklist items

4.2.2. Pre-ORR brief

● An early opportunity for the project lead to ask questions and gather feedback on specific aspects of the ORR checklist that will be required from the ORR Panel

4.2.3. Executing the ORR Checklist items

● The project lead goes through the various requirements on the checklist and seeks validation and approval for the requested items

4.2.4. Beta ORR (if needed and by exception) / Final ORR Brief https://docs.google.com/spreadsheets/d/17ZFFZzYqp3Ywe1ZwPOWq6qX_JzhoFSppktGUwn1k8a0/edit?usp=sharing

● A meeting to review the checklist items to verify all parties are ready and approve the PDS item can be moved into the beta phase or final operations. Note: Beta is not the “final” and a final ORR review will need to be completed, though, in most cases, not a full-blown presentation to the ORR Panel.

4.3. ORR Process

4.3.1. The Product Lead will need to open the ORR Checklist to make their working copy (File, Make a copy), and save this in their product working folder.

4.3.2. Using the newly saved ORR checklist, edit Row 1, whether this is a ‘Pre’ or ‘Final’ ORR for ‘xyz’ product name

4.3.3. The Product Lead is responsible for seeking a ‘Disposition’ Status for each item in the checklist. Refer to Column F and Column G for the respective name or point of contact.

● For the Pre-ORR checklist: By using the Project Charter, and other project-related documents, an early determination of which items are already completed or not can be determined in columns C, D, or E. It’s appropriate if not all the fields are completed and any open items can be clarified and resolved at the pre-brief to the ORR Panel.

● For the Beta/Final checklist: All items should have a ‘Disposition’ status of either a ‘Pass’, ‘Fail’, or ‘N/A’’, columns C, D, or E.

● Note: Use column I, the ‘Comments/Artifacts’’ field to post all relevant information related to the checklist requirement.

4.3.4. The Product Lead is responsible for reaching out to and scheduling a presentation time, via the ORR Panel secretariat, for the Pre-ORR checklist and then for the Final ORR review to the ORR Panel once a final release target date is established.

4.3.5. The Product Lead is highly encouraged to use the NCEI-ORR Checklist Guidance document which provides context and information for each item on the checklist including the NCEI-ORR FAQ to complete the ORR checklist.

4.3.6. The Product Lead will need to coordinate with the ORR Panel secretariat on all Product ORR documentation for archival, posting to the repository, and final disposition by the ORR Panel/Chair.

4.3.7. The ORR secretariat or other designee will provide the final audit and verification status of the ORR results.

5. References.

A. ORR Policy Directive:

○ NCEI PD 10-1-01 - ORR Policy Directive, dated June 17, 2024 https://docs.google.com/spreadsheets/d/17ZFFZzYqp3Ywe1ZwPOWq6qX_JzhoFSppktGUwn1k8a0/edit?usp=sharing https://drive.google.com/file/d/1ffV6MjYSxOcCbMsL7I3Q3oZgaQQgT91k/view?usp=drive_link https://drive.google.com/file/d/1ffV6MjYSxOcCbMsL7I3Q3oZgaQQgT91k/view?usp=drive_link https://drive.google.com/file/d/1izdCqa-qUHqKMWGyHEhQJM0RojKy5r2V/view?usp=drive_link https://drive.google.com/file/d/1hv46308foGUnE8KDURX-JPlhcjYKAVwT/view

B. FAQ / Guideline Documents

○ NCEI-ORR Checklist Guidance, dated August 01, 2024

○ NCEI-ORR FAQ, dated August 01, 2024

6. Attachments.

1. ORR-Checklist-Final Ver 1.0, dated July 31, 2024

7. Acronyms.

DO Director’s Office NCEI National Centers for Environmental Information PDS Product, Dataset, or System OPR Office of Primary Responsibility ORR Operational Readiness Review POC Point of Contact

8. Supersedes.

Initial SOP, no other versions exist.

9. Approvals.

William E. Angel ORR Panel Chair https://drive.google.com/file/d/1ffV6MjYSxOcCbMsL7I3Q3oZgaQQgT91k/view?usp=drive_link https://drive.google.com/file/d/1izdCqa-qUHqKMWGyHEhQJM0RojKy5r2V/view?usp=drive_link https://docs.google.com/spreadsheets/d/17ZFFZzYqp3Ywe1ZwPOWq6qX_JzhoFSppktGUwn1k8a0/edit?usp=sharing