3_NNM16577788R__Part_III_Section_J.pdf

DRAFT RFP NNM16577788R

J-1

PART III – LIST OF DOCUMENTS, EXHIBITS, AND OTHER

ATTACHMENTS

SECTION J

LIST OF ATTACHMENTS

Attachment Number Description

J-l Performance Work Statement (PWS)

J-2 Data Procurement Document (DPD)

J-3 Work Breakdown Structure (WBS)

J-4 Description of Labor Categories

J-5 Department of Labor Wage Determination

J-6 Schedule of Contract Rates

(To be provided with proposal)

J-7 Reserved

J-8 SMA Tools, Databases, and Applications

J-9 Task Order Flow Process

J-10 Task Order Summary

J-11 Installation Accountable Government Property (IAGP)

List

J-12 Reserved

J-13 Organizational Conflict of Interest (OCI) Plan

(To be provided with proposal)

J-14 Safety and Health (SHE) Plan

(To be provided post award per attachment J-2)

J-15 Management Plan

(To be provided with proposal)

J-16 Award Fee Performance Evaluation Plan

J-17 Reserved

J-18 Reserved

J-19 Reserved

J-20 Applicable and Referenced Documents

J-21 Acronym List

J-22 Glossary

J-1-1

ATTACHMENT J-1

PERFORMANCE WORK STATEMENT

MSFC SAFETY AND MISSION ASSURANCE SERVICES

Table of Contents

1.0 SCOPE…………………………………………………………………………J-1-2

2.0 CONTRACT INTEGRATION REQUIREMENTS…………………………...J-1-3

2.1 PROGRAM MANAGEMENT………………………………………………...J-1-3

2.2 CROSS-CUTTING SUPPORT (IDIQ)………………………………………..J-1-6

3.0 PROGRAM AND PROJECT DISCIPLINE SUPPORT……………………..J-1-10

3.1 SYSTEM SAFETY ENGINEERING………………………………………...J-1-11

3.2 RELIABILITY AND MAINTAINABILITY ENGINEERING……………...J-1-14

3.3 SOFTWARE ASSURANCE……………………………………………….....J-1-19

3.4 QUALITY ENGINEERING…………………………………………………..J-1-20

3.5 QUALITY ASSURANCE………………………………………………….....J-1-22

3.6 INDEPENDENT ASSESSMENT TASKS……………………………………J-1-23

4.0 INSTITUTIONAL DISCIPLINE SUPPORT…………………………………J-1-24

4.1 INDUSTRIAL SAFETY PROGRAM………………………………………...J-1-24

4.2 PRESSURE SYSTEMS……………………………………………………….J-1-31

5.0 PHASE-IN AND PHASE-OUT ACTIVITIES………………………………..J-1-32

J-1-2

1.0 SCOPE

The Marshall Space Flight Center (MSFC) and the MSFC Safety and Mission

Assurance (SMA) Directorate are strongly committed to Safety, Teamwork, Integrity and Mission Success. This requires the establishment of a highly skilled, diverse, and motivated workforce committed to safety, teamwork, integrity, and mission success. Working in a creative and productive environment in support of cutting-edge systems and technology development, MSFC employs unique and innovative management techniques to improve safety of the public, the astronauts and pilots, the NASA workforce and high-value equipment and property. The

Government is committed to preventing human injury and ensuring the safety of all operations and products leading to mission success. The Contractor fully supports these endeavors and demonstrates the same commitment to safety, teamwork, integrity, and mission success.

This Contract will be used to augment the NASA workforce through Indefinite

Delivery Indefinite Quantity (IDIQ) Task Orders (TOs), and provide services associated with the planning, implementation, and assessment of Program and

Project Discipline Support, and Institutional Discipline Support, for the

Government, as described in this Performance Work Statement (PWS), and subsequent TOs developed in accordance with J-9, Task Order Flow Process.

The contract involves: 1) surveillance and analysis of assigned in-house and contracted design, development, manufacturing, and testing activities, for both hardware and software, utilizing NASA MSFC Safety, Reliability, Maintainability, and Quality Assurance (SRM&QA) policies, requirements, and controls, 2) ensuring that management assessment information is provided in a timely manner to the Government to support the decision-making process regarding open problems, hazards, and risks pertaining to accomplishing MSFC's mission and 3) operation of SMA Management Information Processes. (Reference

Attachment J-8, SMA Tools, Databases, and Applications.)

The tasks described in this PWS are to be performed principally in the MSFC locale and a few positions may be located at production, launch, or test facilities in MSFC Resident Management Offices, Michoud Assembly Facility (MAF), the

Booster Fabrication Facility (BFF) located at Kennedy Space Center (KSC), and

Stennis Space Center (SSC). Support to this PWS may include work associated with other NASA centers, Government agencies, or commercial entities. Tasks may also be required to support work defined in NASA Space Act Agreements

(SAAs) or equivalent mechanisms. Occasional travel to Contractor facilities, NASA Headquarters, and other NASA installations may be required. Support to this contract will be defined by specific TOs and will include requirements specific to MSFC as well as other Center specific locations.

Any unique frequently used nomenclature used throughout this Contract may be referenced in Attachment J-21, Acronym List. Applicable and referenced

J-1-3 documents are summarized in Attachment J-20, Applicable and Referenced

Documents

2.0 CONTRACT INTEGRATION REQUIREMENTS

2.1 PROGRAM MANAGEMENT

The Contractor shall provide administrative and technical program management for effective direction and control of this contract. Program Management charges shall be accrued as a specific item on each individual Task Order Plan (TOP) and

TO. The Contractor's plan and approach for providing such management shall be documented and prepared in accordance with Data Requirements Document

(DRD) 1566MA-001, Management Plan. The Contractor’s Management Plan is incorporated in this contract as Attachment J-15. Throughout this PWS, and through the duration of the Contract, the Contractor shall identify to the

Government any proposed innovations or streamlined approaches that will ensure operational cost effectiveness and enhance the probability of mission success throughout the duration of this contract.

The Contractor shall provide and use management information systems that provide a means for monitoring and measuring performance and which encompass planning, scheduling, progress reporting, and completion of tasks or subtasks.

The work, as set forth in this PWS, is unclassified. The Contractor shall possess or be able to acquire a Facility Security Clearance. Security clearances, for those persons required to have such, will be obtained in accordance with NPR 1600.1, MSFC Security Program Procedural Requirements, NPR 1600.4, Identity and

Credential Management, and DOD Manual 5220.22, Industrial Security Manual for Safeguarding Classified Information. Contractor personnel working at MSFC shall comply with these MSFC security regulations and the requirements of

Homeland Security Presidential Directive (HSPD) No. 12.

The Contractor will have access to information and material that NASA has determined to be of a sensitive but unclassified (SBU) nature that does not contain national security information (and therefore cannot be classified). The Contractor shall protect SBU against inappropriate access and disclosure by handling such information in accordance with the procedures set forth in NID 1600.55, Sensitive

But Unclassified (SBU) Controlled Information, NFS 1852.237-72, Access to

Sensitive Information, and NFS 1852.237.73, Release of Sensitive Information.

The Contractor shall provide environmental compliance reports prepared in accordance with DRD 1566EE-001, Environmental Compliance Reports.

The Contractor shall provide an on-site employee location listing for MSFC and

MAF, SSC and the BFF at KSC prepared in accordance with DRD 1566CD-001, On-Site Employee Location Listing. Access to Redstone Arsenal and MSFC shall

J-1-4 be in accordance with NPR 1600.1, NASA Security Program Procedural

Requirements, and NPR 1600.4, Identity and Credential Management.

The Contractor shall provide technical information concerning any invention, discovery, improvement, or innovation made by the Contractor in the performance of work under this contract with Technology Reports that shall be prepared in accordance with DRD 1566CD-002, Technology Reports.

2.1.1 BUSINESS MANAGEMENT

The Contractor shall provide an Organizational Conflict of Interest (OCI) Plan in accordance with DRD 1566MA-006, OCI Plan. The Contractor’s OCI Plan is incorporated in this contract as Attachment J-13, Organizational Conflict of

Interest (OCI) Plan.

Monthly Financial Management Reports shall be provided in accordance with

DRD 1566MA-008, Monthly Financial Management Reports. See J-3, Work

Breakdown Structure (WBS) for financial reporting structures against the WBS.

Bi-weekly notes shall be submitted for events or accomplishments of reporting significance in accordance with DRD 1566MA-009, Bi-Weekly Notes.

The Contractor shall support the Government’s business management functions thru reporting and analysis of the Contractor’s financial data. The Contractor shall provide Management Status Review (MSR) input in accordance with DRD

1566MA-005, MSR Inputs.

The Contractor shall provide the delivery of information on specific items, and supporting documentation related to resource and cost information, as re-procurement activity reports prepared in accordance with DRD 1566MA-010, Re-procurement Data Package.

2.1.2 TASK ORDER DEVELOPMENT AND TASK ORDER MAINTENANCE

The Government will provide an automated task order management system

(ATOMS) tool to plan, organize, direct, and control contract activities. The

Contractor shall utilize the ATOMS tool for responding to Task Order Requests, in accordance with J-9, Task Order Flow Process. The Contractor shall provide an interface from the Contractor’s corporate accounting system to the ATOMS tool, in accordance with the data exchange formats of QD01-ATOMS-001, Data

Exchange Formats Specification for the ATOMS Tool.

2.1.3 PROPERTY MANAGEMENT

The Contractor shall comply with

MPR 4000.2 Property Management

MPR 8812.1 Requests for Facility Services at MSFC

FAR Part 45 Government Property

J-1-5

NFS Part 1845 Government Property

The Contractor shall implement an inventory control system for all controlled property and equipment. The Contractor shall prepare and maintain a report identifying and listing all equipment, tools and other hardware or software provided by the Government for use by the Contractor in the performance of contracted effort, and for which the Contractor has been given physical custody.

The Government Property Management Plan report shall be prepared and maintained in accordance with DRD 1566LS-001, Government Property

Management Plan.

2.1.4 SAFETY, HEALTH AND ENVIRONMENTAL COMPLIANCE

MSFC’s Safety, Health, and Environmental (SHE) program adheres to five Core

Program Requirements (CPRs) which are:

CPR 1 - Management Leadership and Employee Involvement

CPR 2 - Worksite Analysis

CPR 3 - Hazard Prevention and Control

CPR 4 - SHE Training

CPR 5 - Environmental Management System

The Contractor shall establish and implement an industrial safety, occupational health, and environmental program that provides a workplace free from recognized hazardous conditions and is incident and injury free by (1) preventing employee fatalities, (2) reducing the number of incidents and severity of employee injuries and illnesses, and (3) protecting the environment through the ongoing planning, implementation, integration and management control of these programs. The Contractor shall comply with all Federal, State, NASA, and

Center specific SHE-related requirements and regulations to this contract listed in

MPR 8715.1, Marshall Safety, Health and Environmental (SHE) Program, while working on-site at MSFC. The Contractor shall comply with all unique site specific requirements when working at MAF, SSC, BFF at KSC, and contractor facilities. The Contractor shall provide a final SHE plan in accordance with DRD

1566SA-002, SHE Plan. The Contractor’s SHE Plan is incorporated in this contract as Attachment J-14. Mishaps shall be reported to the Government in accordance with DRD 1566SA-003, Mishaps and Safety Statistics Reports.

2.1.5 CONTRACTOR PERSONNEL TRAINING AND CERTIFICATION

The Contractor shall define and identify which positions on this contract require specific training as required in MPR 3410.1, Training, and certification for the position as required in MWI 3410.1, Personnel Certification Program, MWI

3410.5, Personnel Certification Program for Skills, NPR 8715.3, NASA General

Safety Program Requirements, and applicable codes for certifications from the

American Society of Non-Destructive Test (ASNT) and from the American

J-1-6

Welding Society for welding, inspection, and Nondestructive Evaluation (NDE) of structural and pressure pipe welding. The Contractor shall prepare, implement and maintain a Personnel Training and Certification Plan for each training and certification requirement identified in accordance with DRD 1566SA-001, Personnel Training and Certification Plan. The Contractor shall develop innovative methods for retaining required expertise.

2.2 CROSS-CUTTING SUPPORT (IDIQ)

The task ordered technically managed activities defined that cross over multiple

SMA disciplines are as follows:

2.2.1 TECHNICAL MANAGEMENT

The Contractor shall coordinate the SMA activities with the Government to assure the proper execution of the SMA program and project requirements.

The Contractor shall serve as an expert advisor for project team meetings, technical interchange meetings, problem investigation and resolution efforts, and other routine project meetings.

The Contractor shall participate in (to include making presentations) MSFC program, Contractor, supplier, or other Government milestone reviews to evaluate the incorporation of, and compliance with, Program and Project Discipline Support, and Institutional Discipline Support in decisions affecting design, safety, production, testing and operation. The Contractor shall prepare and evaluate documentation and data for technical interchange meetings, design milestone reviews - to include but not limited to Preliminary Requirements Review (PRR), Preliminary Design Review (PDR), Critical Design Review (CDR), Design

Certification Review (DCR) - safety reviews, and readiness reviews to assure compliance with applicable requirements.

2.2.2 MSFC PERSONNEL CERTIFICATION ADMINISTRATION

The Contractor shall implement and maintain a program for developing and maintaining the expertise of MSFC employees in SMA disciplines including, but not limited to, System Safety Engineering, Reliability and Maintainability

Engineering, Software Assurance, Quality Engineering, Quality Assurance, Independent Assessments, the Industrial Safety Program, and Pressure Systems.

The Contractor shall develop, implement, schedule, and conduct specialized professional development training in compliance with MPR 3410.1, Personnel

Certification Program, when directed by the Contracting Officer.

The Contractor shall support the administration of the MSFC Personnel

Certification Program in compliance with MWI 3410.1, Personnel Certification

Program and MWI 3410.5, Personnel Certification Program for Skills.

J-1-7

The Contractor shall maintain a database system to record personnel qualifications and certifications for MSFC and on-site Contractor personnel.

Currently this database system is the CERTRAK database (reference Attachment

J-8, SMA Tools, Databases and Applications). The Contractor shall collect, screen personnel qualifications and certification packages and coordinate the review of these packages with the applicable MSFC Certifying Officer, and enter the qualification and certification information into CERTRAK or other MSFC

SMA designated databases in accordance with MWI 3410.1, Personnel

Certification Program, and MWI 3410.5, Personnel Certification Program for

Skills.

2.2.3 NASA ENGINEERING AND SAFETY CENTER (NESC), NASA SAFETY

CENTER (NSC), AND TECHNICAL AUTHORITY SUPPORT

The Contractor shall provide the necessary administrative and technical support to the Government to assure disciplined performance of work and timely application of resources necessary for completion of all work assigned within NASA

Engineering & Safety Center (NESC), NASA Safety Center (NSC), and

Technical Authority tasks.

2.2.4 INFORMATION EXCHANGE & REQUIREMENTS REVISION SUPPORT

The Contractor shall provide the following:

a. Review of and preparation of comments for drafts of new requirements documents or proposed revisions to existing requirements documents.

b. Support and coordination of the Government initiatives to implement new or revised requirements throughout MSFC organizations.

c. Support and coordination of working groups and communications forums.

d. Support and coordination of information exchange with MSFC SMA, MAF, NASA Headquarters, other NASA Centers, and MSFC Contractors.

2.2.5 DOCUMENTATION AND REPORT SUPPORT

The Contractor shall provide support in the development of documentation.

a. The Contractor shall provide support in the development of plans, procedures, briefing material, schedules and metrics and other documents required in the accomplishment of the Government activities in accordance with the

Contractor’s Management Plan.

J-1-8

b. The Contractor shall provide support to the Government with evaluations and assessments of documentation to accomplish the SMA mission in support of

MSFC programs and projects and shall provide reports to Government in accordance with DRD 1566MA-002, Evaluation and Assessment Reports.

c. The Contractor shall support the preparation and maintenance of the

Government documents including Organizational Issuances (OIs).

2.2.6 SUPPORT TO MSFC QUALITY MANAGEMENT SYSTEM

The Contractor shall support the Government Documents Control Board (DCB) activity for review, evaluation, and disposition of controlled documents, including the review of Organizational Issuances (OI) and related external documents under review by the DCBs.

The Contractor shall support the continued ISO 9000 and AS9100 registration at

MSFC including, but not limited to, training of Government designated employees on the topics of ISO 9000 and AS9100, procedure preparation, and internal audit support. The Contractor shall assist in external and internal Audits, Surveillances and Corrective Action follow-up.

The Contractor shall receive, distribute, and track responses for the MSFC Acute

Launch Emergency Reliability Tip (ALERT) program. (See also Section 3.2.11 of this PWS.)

The Contractor shall input data and generate reports for the MSFC Recurrence

Control Action Request (RCAR) database (See also Section 3.5.4 of this PWS).

2.2.7 SMA MANAGEMENT INFORMATION SERVICES

The Contractor shall utilize applications and databases and tools provided in

Attachment J-8, SMA Tools, Databases, and Applications to support SMA mission success. The Contractor shall provide data entry for these databases, shall manage resulting SMA data, and shall provide a virtual focal point for the presentation of refined, integrated SMA data. The Contractor shall administer the

SMA delegated agency data, including annual forecasts, midyear updates, and monthly data reduction. The Contractor shall utilize these applications and databases required to support programs and projects, collect and input data, ensure data is maintained, up-to-date and accurate, and produce reports as identified in TOs. The Contractor shall continuously assess database inventory and function to develop more efficient ways to utilize data and to make recommendations for consideration by the Government. Security and maintenance of these applications will be performed by the MSFC Office of the

Chief Information Officer (OCIO).

J-1-9

The Contractor shall provide support to maintain SMA documentation and electronic data using established MSFC processes and electronic applications ensuring that data and information are current, accurate and accessible. SMA documentation and data is currently maintained on ExplorNet or SharePoint sites but this support will be required regardless of the platform used.

The Contractor shall assess SMA's information needs for the present and future.

The Contractor shall investigate alternatives for identified SMA needs, evaluate and recommend SMA requirements for new system enhancements or capabilities.

The Contractor shall present SMA management with precise descriptions and recommendations on system alternatives and improvements.

The Contractor shall perform structured system design activities for in-house development work and for work performed by outside Contractors, and make management recommendations to the Government. The Government will provide overview and retain final decision-making authority over all design and development activities.

The Contractor shall ensure that all system requirements are met. If not provided by the Government, the Contractor shall generate complete documentation for each system. This documentation shall include, but not be limited to, requirements definition, design definition, code documentation, user’s guides for operations personnel as well as end users, implementation plans and operations plans. The Contractor shall assure that all internal reviews and on-site coordination activities are completed and that user support functions are provided for SMA Management Information including training and real-time help for supported programs and processes.

The Contractor shall provide administrative and technical support for the MSFC

SMA Council to include, but not limited to, developing and posting Council agenda, schedule, meeting minutes and associated Council and Marshall Team

Meeting information on the SHE Explornet or SharePoint sites.

2.2.8 SMA READINESS REVIEW CENTER

The Contractor shall support, coordinate, and operate the MSFC SMA Readiness

Review Center to include but not limited to dry runs and reviews established for programs and projects, scheduling, data collection, preparation and distribution of

MSFC SMA presentation materials, and data exchange with Johnson Space

Center (JSC), KSC, SSC, MAF and NASA HQ.

2.2.9 MSFC VENDOR AND SUPPLIER AUDIT SUPPORT SERVICES

The Contractor shall provide auditors to prepare checklists and plans to be used to support Government audits of MSFC vendors and suppliers as identified in TOs.

The Contractor shall provide support to the Government, auditors, and auditees by

J-1-10 assisting in scheduling audits, tracking and follow-up of findings, and preparation and distribution of final reports as identified in TOs. The Contractor shall maintain the Audit Tracking Information System (ATIS) for the implementation of audits and the retention of quality records associated with audits.

3.0 PROGRAM AND PROJECT DISCIPLINE SUPPORT (IDIQ)

The Contractor shall provide technical services, in accordance with TOs, to any

SMA supported program and project. When TOs are to be executed either at or for the benefit of a location other than MSFC or MSFC managed facilities, the

Government will define in the TO the site-specific requirements and standards that are uniquely applicable under that TO.

The Contractor shall provide planning, coordination, and surveillance of overall activities to assure disciplined performance of work and timely application of the resources necessary for completion of all tasks described in this entire PWS in accordance with the QMS requirements and the SMA’s Organizational Issuances.

a. The Contractor shall participate in technical issues meetings to discuss and resolve SMA issues.

b. The Contractor shall provide support to the applicable program and project safety review processes and panels for the purpose of ensuring rigor in the safety analyses. Support shall include, but not be limited to, documentation distribution and review, board establishment and communication, executive secretary function, meeting action item tracking, records retention, and independent “Checklist Reviews” of Safety Compliance Data Packages.

c. The Contractor shall provide systems expertise for program and project

Boards to include, but not limited to, Configuration Control Boards (CCBs), Problem Review Boards, Document Control Boards, Program and Project

Control Boards, Material Review Boards (MRB). The Contractor shall advise the MRB members and recommend corrective actions to improve product quality. The Contractor shall also participate in the construction of trending charts and analyses on MSFC contracted and in-house efforts, and shall provide recommendations to the Government on adverse MSFC contractor and in-house trends.

d. The Contractor shall provide assessments of flight readiness in support of the

SMA input to readiness reviews for programs and projects, upon request.

This support includes, but is not limited to, technical issues resolution and status of SMA flight critical documentation (such as Certificates of

Qualification, Hazard Analyses and Failure Modes and Effects Analyses

(FMEAs)).

J-1-11

e. The Contractor shall track action items and issues resulting from team meetings, milestone reviews and flight readiness activities, and recommend disposition to the Government.

f. The Contractor shall provide real-time safety and reliability assessments during launch countdowns and mission operations. Huntsville Operations

Support Center support shall be provided upon request. Program or project personnel shall coordinate these activities.

g. The Contractor shall provide schedule support through the development and tracking of SMA deliverables as they relate to program and project milestones.

h. The Contractor shall support program and project milestone reviews (i.e.

System Requirements Review (SRR), Preliminary Design Review (PDR), Critical Design Review (CDR), and Design Certification Review (DCR)) to identify, evaluate and perform the review of all applicable documentation and shall develop and submit review item discrepancies and comments as warranted. The Contractor shall support technical meetings with customers to discuss and resolve issues.

i. The Contractor shall provide expertise to support the preparation, evaluation, and assessment of in-house and contractual program and project risk management plans and techniques, to facilitate the identification, tracking, and mitigation of risks and issues that may negatively impact a project or program.

1. The Contractor shall provide recommendations and advice to Government engineers and managers relative to risk mitigation actions to minimize or eliminate risks.

2. The Contractor’s risk management experts shall successfully complete the

NASA HQ supplied training and become certified as Continuous Risk

Management Course instructors. Once certified, the instructors shall present Continuous Risk Management courses and workshops to

Government designated employees.

3.1 SYSTEM SAFETY ENGINEERING

The Contractor shall execute the system safety engineering activities using the approaches, methods, and tools identified in the Government-approved planning documentation per DRD 1566MA-003, SRM&QA Documents.

3.1.1 SYSTEM SAFETY TOOLS

The Contractor shall develop and utilize SMA specific tools (as specified in

Attachment J-8, SMA Tools, Databases, and Applications) needed to assure that

J-1-12 all system safety requirements (to include, but not limited to, Agency, Center, Program and Project requirements) are identified for Government programs and projects. These should include, but not be limited to fault tree analysis, logic trees, risk definition and mitigation analyses, hazard analysis and trending and data search.

3.1.2 REQUIREMENTS AND VERIFICATION

As directed by TOs, the Contractor shall assess program or project documentation

(e.g., Contractor PWS, Data Requirements Documents, System Requirements

Document, Contract End Item, Requirements Verification Compliance procedures) to assure that all safety requirements are addressed in compliance with Government requirements. The Contractor shall provide system safety support for all mission phases (design, development, verification, operations, post flight analysis, and sustaining engineering.)

a. The Contractor shall assess and support development of program or project verification plans and verification requirements (e.g., Verification Plans, Requirements Verification Compliance (RVC) documents) to assure all safety verification requirements are properly included.

b. The Contractor shall assess test and operating procedures to assure compliance with safety controls and safety verification requirements.

c. The Contractor shall assess or generate safety verification compliance data to assure it clearly demonstrates compliance with the safety verification requirements and parent safety requirement.

3.1.3 HAZARD ANALYSES

The Contactor shall perform or assess and document hazard analyses for both in-house and contracted design and development projects, to assure that: (a) all hazards are identified and the associated risks properly characterized; (b) hazard controls satisfy safety requirements and mitigate safety risks; (c) safety verification requirements are clearly identified, including the clear definition of verification pass/fail criteria; and (d) the safety verification status is maintained in a closed loop accounting system.

3.1.4 SAFETY PLANS

The Contractor shall prepare and assess Safety Plans (for both assigned in-house and contracted) design, development, and operational projects to assure compliance with applicable Agency, Center and Program safety requirements.

The Contractor shall assess and contribute to the development of Project Plans to assure that safety is properly considered.

J-1-13

3.1.5 TRADE STUDIES

The Contractor shall perform and assess trade studies relative to design, development, operation, or mission events for assigned in-house and contracted projects, to assure compliance with safety requirements and to assure safety risks are identified, characterized, and mitigated.

3.1.6 CHANGE (DEVIATION/WAIVER/SPECIFICATION CHANGE NOTICES

(SCN’S)) EVALUATION

The Contractor shall assess proposed changes, deviations, and waivers to program and project documentation to assure compliance with safety requirements. This assessment includes evaluation of the impacts to safety and hazard analyses and the effects on program or project risk.

3.1.7 TRENDS

The Contractor shall identify any adverse safety trends for assigned system safety engineering programs and projects and promptly notify MSFC SMA.

3.1.8 SAFETY ASSESSMENTS

The Contractor shall perform safety assessments of any issues for assigned system safety engineering programs and projects which involve one or more of the following:

a. Operation or performance outside the expected performance range of parameters or which has not previously been experienced.

b. Discrepancies or non-conformances which affect:

1. Configuration

2. Certification

3. Mission Success

4. Safety Critical Functions

5. Verification

c. Adverse problems or trends

d. Discrepancies or non-conformances which the operator determines require design element analysis or assistance for resolution.

e. Unexplained anomalies or events.

f. Limited life hardware.

g. Restricted hardware or software use.

h. Hazard controls.

i. Flight or ground operation procedures that are controlled by the Government.

j. Software or hardware configurations changes that are controlled by the

Government.

J-1-14

k. Waivers/exceptions for use of hardware that does not meet performance specifications, exceeds certification limits, or surpasses time, age, and cycle life limits

l. Critical hardware manufacture or repair processes.

m. Development of critical software and discrepancies in delivered critical software.

3.1.9 METRICS

The Contractor shall develop and maintain metrics regarding the safety performance of assigned Government system safety engineering programs and projects.

3.2 RELIABILITY AND MAINTAINABILITY ENGINEERING

The Contractor shall execute the reliability and maintainability activities using the approaches, methods, and tools identified in the Government-approved Program or Project specific Reliability and Maintainability Program Plan and in accordance with SRM&QA Documents (DRD 1566MA-003).

3.2.1 RELIABILITY AND MAINTAINABILITY TOOLS

The Contractor shall develop and utilize reliability and maintainability design and development methods and tools (as specified in Attachment J-8, SMA Tools, Databases, Applications) needed to assure that all reliability and maintainability requirements are identified for Government programs and projects. The

Government will approve the methods proposed by the Contractor. These methods include, but are not limited to, FMEAs, and Critical Item Lists (CILs) information analysis, reliability block diagrams, hardware indenture level and next higher assembly diagrams, reliability trending and assessments, maintainability trending and assessments, and any other systems needed to analyze reliability and maintainability information. The analytical results of these tools shall be provided to the Government with recommendations.

3.2.2 REQUIREMENTS AND VERIFICATION

The Contractor shall evaluate program and project documents related to reliability and maintainability to assure consistency and adequacy with overall program and project requirements.

3.2.3 OPERATIONS AND MAINTENANCE REQUIREMENTS

The Contractor shall evaluate Operations and Maintenance Requirements

Specifications (OMRS) and implementing Operations and Maintenance

Instructions (OMIs) to assure that reliability and maintainability requirements are addressed and implemented.

J-1-15

3.2.4 RELIABILITY ASSESSMENTS

The Contractor shall prepare reliability assessments, by developing a System

Reliability, Availability and Maintainability Model utilizing reliability data bases, for each mission, vehicle, and other equipment in support of preflight assessment reviews and flight readiness milestone reviews.

3.2.5 ANALYSES EVALUATION

The Contractor shall evaluate hardware and software reliability and maintainability analyses, to verify the validity of the analyses and assure that the analyses have been performed in accordance with DRD 1566MA-003, SRM&QA

Documents.

3.2.6 RELIABILITY AND MAINTAINABILITY PLANS

The Contractor shall prepare, evaluate and assure reliability and maintainability plans for MSFC assigned in-house and contracted design, development and operations projects that are compliant with NASA Headquarters, Center and programmatic requirements, in order to achieve the following objectives (1) understand the Government requirements, (2) design for reliability and maintainability, (3) produce reliable and maintainable systems, (4) monitor and assess field reliability and maintainability, and (5) are consistent with

Government direction. The Contractor shall support the development and assessment of FMEAs and CILs and their ground rules for assigned in-house and contracted design and development projects. The Contractor shall provide reliability and maintainability support of all mission phases (design, development, verification, operations, post flight analysis and sustaining engineering).

a. The Contractor shall evaluate changes, out-of-family conditions, material reviews, and deviations for impact to FMEAs and CILs.

b. The Contractor shall develop and evaluate FMEAs and CILs for compliance with requirements in accordance with DRD 1566MA-003, SRM&QA

3.2.7 LIMITED LIFE

The Contractor shall evaluate in-house and contracted methods for identification and control of limited life items (LLIs). The Contractor shall verify, through assessments, that sufficient remaining life of equipment is available for accomplishing the mission requirements and objectives. The Contractor shall verify that life limits of common hardware are consistent. The Contractor shall evaluate and assess life extension plans for applicable LLIs and provide analysis of results.

J-1-16

3.2.8 PROBABILISTIC RISK ASSESSMENT (PRA)

The Contractor shall prepare PRA plans for all mission phases (design, development, verification, operations, post flight analysis and sustaining engineering) of Government managed programs and projects requiring PRA compliance with NASA Headquarters, Center and Programmatic requirements.

a. The Contractor shall support requirements development, implementation and maintenance of informal data tools, including data populations, develop or provide tools (as specified in Attachment J-8, SMA Tools, Databases, Applications) and techniques to perform probabilistic risk analysis.

b. The Contractor shall perform probabilistic risk analysis according to documented plans, assessments and mitigation for Government managed programs and projects. The Contractor shall be able to perform PRAs on

Government programs and projects to include data collection related to

Government programs and projects (e.g. International Space Station, Engines, Boosters, Stages, Avionics, Payloads, and Software), risk model selection and risk analyses of these, utilization of the selected risk model(s) to be integrated into the overall development and flight hardware system model, simulation of risk scenarios, using available software packages and an overall report on the data, methods and models, and results.

3.2.9 MODELING SIMULATION

The Contractor shall develop and employ quantitative and qualitative models and simulations to support all mission phases of MSFC managed development, to include but not limited to flight hardware and software as well as sustaining engineering of this hardware and software. The Contractor shall perform analyses to ascertain and verify the technical validity of models and simulations for both in-house and contracted design and development projects.

The Contractor shall develop and deliver, in accordance with TOs, System

Reliability, Availability & Maintainability (RAM) Models for Government managed hardware and software, in order to assess if the design (including commercial off the shelf, non-developmental items, and Government furnished equipment) is capable of meeting reliability requirements in the operational environment. If the assessment is that the Government’s requirements are infeasible, the Contractor shall communicate this to the Government.

The Contractor shall (1) generate and update the reliability and maintainability allocations from the system level down to lower indenture levels, (2) aggregate system-level reliability based on reliability estimates from lower indenture levels,

(3) identify single points of failure, and (4) identify reliability and maintainability critical items and areas where additional design or testing activities are required in order to achieve the reliability and maintainability requirements. The System

J-1-17

RAM Models shall be updated whenever new failure modes are identified, failure definitions are updated, operational and environmental load estimates are revised, or design and manufacturing changes occur throughout the life-cycle. Detailed component stress and damage models shall be incorporated.

The Contractor shall assess the reliability and maintainability of the system periodically throughout the life cycle using the System RAM Model, the life-cycle operational and environmental load estimates, and the failure definition and scoring criteria. Reliability and maintainability assessments shall be made based on data from analysis, modeling and simulation, test, and operations, and shall be tracked as a function of time and compared against reliability and maintainability allocations and requirements. The Contractor shall monitor and evaluate the reliability and maintainability impact of changes to the design or manufacture of the System RAM Model. The implementation of corrective actions shall be verified and their effectiveness tracked. Formal reliability growth methodology shall be used where applicable (e.g., when failure modes are discovered and addressed with a test-analyze-and-fix process that is applied to complex assemblies) in order to plan, track, and project reliability improvement.

The Contractor shall perform planned and ad hoc numerical reliability and maintainability analyses using analytical methods and models. The analytical methods may include, but not be limited to, classical probability density functions, reliability and maintainability models, Monte Carlo simulation models, and probabilistic risk analysis.

3.2.10 REVIEWS

The Contractor shall participate in technical interchanges with the Government in order to compare the status and outcomes of reliability and maintainability activities, especially the identification, analysis, classification, and mitigation of failure modes. The Contractor shall participate in reliability and maintainability reviews to develop an understanding of the environment in which the system will operate and to assure progress toward achieving the reliability and maintainability requirements.

The reliability and maintainability effort shall be integrated with the systems engineering, design engineering, and test programs as well as configuration management and integrated logistics support functions. Reliability and maintainability shall be integrated with the additional related engineering disciplines to include but not limited to technical specialties of quality assurance

(hardware and software), human engineering, system safety, software development, and parts, materials, and processes control to preclude duplication of effort and produce integrated cost-effective results.

3.2.11 ALERT (ACUTE LAUNCH EMERGENCY READINESS TIPS) PROGRAM

MAINTENANCE

J-1-18

The MSFC ALERT Data System contains objective failure information as a result of ALERTs, SAFE-ALERTs, Problem Advisories and Agency Action Notices which notify users of nonconforming parts, components, chemicals, processes, materials, safety and hazardous situations. This data also includes failure analysis and problem information submitted from laboratory analysis. This process is defined in MWI 1280.5, MSFC ALERT Processing.

a. The Contractor shall receive ALERTs and shall enter them into the ALERT database.

b. The Contractor shall also distribute ALERTs to Government designated actionees for review and disposition, track the status of the reviews by programs and project, enter the results of the reviews in the ALERT database, and transmit the results of the reviews to the organizations identified in MWI

1280.5, MSFC ALERT Processing.

c. The Contractor shall distribute ALERT data available real-time to users and track the status of ALERTs, assure that actionees provide timely closures and evaluate ALERTs closure rationale.

d. The Contractor shall generate or assist in the generation of ALERTs.

3.2.12 PROBLEM ASSESSMENT CENTER (PAC)

The Contractor shall provide support to the establishment of a MSFC Problem

Assessment Center according to program and project requirements. Specifically, for the Space Launch System Program, the Contractor shall provide support to the

MSFC Problem Assessment System according to SLS-RQMT-014, SLS Program

Safety and Mission Assurance Requirements.

The Contractor shall provide support to integrate all MSFC PAC program and projects in accordance with program and project requirements and shall provide annual audits.

The Contractor shall maintain and implement an Operations Plan for the MSFC

PAC in accordance with DRD 1566MA-004, Problem Assessment Center (PAC)

Operation Plan. The plan shall describe, in detail, the PAC activities necessary to fulfill the problem reporting requirements (from initiation of project problem reporting through project termination) for any MSFC managed projects for which problem reporting is required. The plan shall also identify the periodic reports the

PAC will issue to fulfill Government needs.

3.2.13 TRADE STUDIES

J-1-19

The Contractor shall provide reliability and maintainability assessments in support of design trade studies, and shall evaluate other contractor prepared trade studies to assure reliability and maintainability has been addressed.

3.2.14 CHANGE DEVIATIONs, WAIVERs, SPECIFICATION CHANGE NOTICES

(SCNs) EVALUATION

The Contractor shall evaluate engineering and programmatic changes, to include but not limited to, Engineering Change Requests (ECRs), Engineering Change

Proposals (ECPs), Deviations, Waivers, Program Change Proposals (PCPs) and

SCN's for reliability and maintainability impact.

3.3 SOFTWARE ASSURANCE

Performance of all tasks assigned for PWS Section 3.3, Software Assurance, shall be in accordance with QD-QE-014, Software Assurance Program Organizational

Issuance, and DRD 1566MA-003, SRM&QA Documents.

The Contractor shall use a software assurance team comprised of expertise in the disciplines of software quality, software reliability, software safety, and software verification and validation. Process assurance tasks for complex electronics, as defined in NASA-HDBK-8739.23, Complex Electronics Handbook for Assurance

Professionals and MSFC-STD-3663, MSFC Standard for Configurable Logic

Device Developments, will include, but not be limited to the following:

a. The Contractor shall plan, organize, perform, monitor, communicate and manage software assurance activities for software developed for all phases of the product lifecycle including product concept, and oversight, requirements definition, design, implementation, problem reporting, corrective action, verification and validation, testing, operations, maintenance, and retirement.

b. The Contractor shall evaluate software products and processes to ensure standards and processes are implemented correctly and adhered to.

c. The Contractor shall perform software assurance classification assessments including safety criticality designations for Government developed or acquired software.

d. The Contractor shall assure that software verification and validation activities occur according to established plans, policies, procedures and standards.

e. The Contractor shall ensure that functional configuration audits and physical configuration audits are performed and all software acceptance documentation is complete.

f. The Contractor shall witness and monitor software formal qualification testing.

J-1-20

g. The Contractor shall document problems, discrepancies, test anomalies and risks in the project problem reporting system or MSFC SMA Problem

Reporting System, Serena Business Manager, referenced in Attachment J-8, SMA Tools, Databases, and Applications.

h. The Contractor shall perform software safety analyses including, but not limited to, software hazard analyses and software fault tree analyses to determine software failure causes and controls to mitigate hazards.

i. The Contractor shall identify safety critical software requirements based upon controls identified in hazard analyses.

j. The Contractor shall perform software reliability analyses including determining defect density, trend analyses, and failure modes and effects analyses for incorporation into integrated reliability analyses.

k. The Contractor shall assist the Government with the identification and discussion of significant issues and risks to be presented at the program and project boards and forums.

l. The Contractor shall develop software assurance plans in accordance with

QD-QE-007, Software Assurance Planning Organizational Issuance and in accordance with program and project data requirements documents (DRDs).

3.4 QUALITY ENGINEERING

The Contractor shall execute all of the quality engineering activities set forth herein using the approaches, methods, and tools identified in the Government approved planning documentation according to DRD 1566MA-003, SRM&QA

3.4.1 WORKMANSHIP

The Contractor shall evaluate workmanship against the technical standard, specifications, procedures, and control documentation for in-house and contracted processes and purchases used throughout all phases of the hardware and software development cycle.

3.4.2 TOOLS

The Contractor shall develop and utilize tools (as specified in Attachment J-8, SMA Tools, Databases, Applications) needed to assure that all applicable quality assurance requirements are identified for Government programs and projects.

These tools should include, but not be limited to, quality information analysis

(including workmanship standards, specifications, procedures and documentation

J-1-21 quality control), quality data trending and assessments, and as-built configuration databases.

3.4.3 REQUIREMENTS AND COMPLIANCE

The Contractor shall prepare, evaluate and, provide assessments of in-house and contracted quality documentation (e.g., Hardware and Software Quality

Assurance (QA) Plans) including implementation instructions and procedures for

Government QA policies and directives.

a. The Contractor shall provide quality engineering support for all mission phases (design, development, verification, operations, post-flight analysis, and sustaining engineering).

b. The Contractor shall evaluate test results versus verification requirements including the disposition of test anomalies and discrepancies for adequacy.

The Contractor shall maintain the necessary certification records, files, and hardware certification status.

c. The Contractor shall support post flight or post-test assessment for programs and projects. The Contractor shall prepare assessment reports and presentations. The Contractor shall evaluate observations for determination of items that warrant formal problem reports.

3.4.4 QUALITY ENGINEERING REVIEWS AND ASSESSMENTS

The Contractor shall perform reviews and assessments of in-house and contracted

QA instructions for compliance with NASA policy, QMS, SMA Organizational

Instructions.

a. The Contractor shall provide QE for the preparation, evaluation, and assessment of in-house and contractual documentation relative to processes

(e.g., additive manufacturing, electrical, electronic, materials, and non-destructive evaluation) encountered during the manufacturing, inspection, and test phases of projects.

b. The Contractor shall provide QE with the ability to inspect in-house designs.

The Contractor shall perform drawing and procurement documentation reviews and approval. The Contractor shall recommend the quality requirements for procurements.

c. The Contractor shall prepare and evaluate in-house inspection criteria for safety critical hardware and software characteristics and other requested characteristics in accordance with QD-QA-018, Review of Work Authorizing

J-1-22

d. The Contractor shall evaluate and provide written assessments, for inspection criteria and…