Draft PWS-J1-Performance Work Statement SMAS II.pdf

J-1-1

Note: All referenced attachments and documents will only be available in the draft and final solicitation.

ATTACHMENT J-1

PERFORMANCE WORK STATEMENT

MSFC SAFETY AND MISSION ASSURANCE SERVICES

Table of Contents

1.0 SCOPE ............................................................................................................... J-1-2

2.0 CONTRACT INTEGRATION REQUIREMENTS…………………………...J-1-3

2.1 PROGRAM MANAGEMENT………………………………………………...J-1-3

2.2 CROSS-CUTTING SUPPORT ………………………………………………J-1-6

3.0 PROGRAM AND PROJECT DISCIPLINE SUPPORT……………………...J-1-10

3.1 SYSTEM SAFETY ENGINEERING…………………………………………J-1-11

3.2 RELIABILITY AND MAINTAINABILITY ENGINEERING……………....J-1-14

3.3 SOFTWARE ASSURANCE………………………………………….…….....J-1-20

3.4 QUALITY ENGINEERING……………………………………………………J-1-21

3.5 QUALITY ASSURANCE…………………………………………………..…..J-1-23

3.6 INDEPENDENT ASSESSMENT TASKS………………………….…………J-1-24

4.0 INSTITUTIONAL DISCIPLINE SUPPORT…………………………………J-1-25

4.1 INDUSTRIAL SAFETY PROGRAM…………………………………………J-1-25

4.2 PRESSURE SYSTEMS………………………………………………………. J-1-32

5.0 PHASE-IN AND PHASE-OUT ACTIVITIES………………………………. J-1-33

J-1-2

1.0 SCOPE

The Marshall Space Flight Center (MSFC) and the MSFC Safety and Mission Assurance (SMA) Directorate are strongly committed to safety, teamwork, integrity and mission success. This requires the establishment of a highly skilled, diverse, and motivated workforce committed to safety, teamwork, integrity, and mission success. Working in a creative and productive environment in support of cutting-edge systems and technology development, MSFC employs unique and innovative management techniques to improve safety of the public, the astronauts and pilots, the NASA workforce and high-value equipment and property. The Government is committed to preventing human injury and ensuring the safety of all operations and products leading to mission success. The Contractor fully supports these endeavors and demonstrates the same commitment to safety, teamwork, integrity, and mission success.

This Contract will be used to augment the NASA workforce through Indefinite Delivery Indefinite Quantity (IDIQ) Task Orders (TOs), and provide services associated with the planning, implementation, and assessment of Program and Project Discipline Support, and Institutional Discipline Support, for the Government, as described in this Performance Work Statement (PWS) and subsequent TOs developed in accordance with Attachment J-9, Task Order Flow Process.

The contract involves: 1) surveillance and analysis of assigned in-house and contracted design, development, manufacturing, and testing activities for both hardware and software utilizing NASA MSFC Safety, Reliability, Maintainability, and Quality Assurance (SRM&QA) policies, requirements, and controls; 2) ensuring that management assessment information is provided in a timely manner to the Government to support the decision-making process regarding open problems, hazards, and risks pertaining to accomplishing MSFC's mission; and 3) operation of SMA management information processes. (Reference Attachment J-8, SMA Tools, Databases, and Applications.)

The tasks described in this PWS are to be performed principally in the MSFC locale and a few positions may be located at production, launch, or test facilities in MSFC Resident Management Offices, Michoud Assembly Facility (MAF), the MSFC Booster Fabrication Facility (BFF) located at Kennedy Space Center (KSC), and Stennis Space Center (SSC). Support to this PWS may include work associated with other NASA centers, Government agencies, or commercial entities. Tasks may also be required to support work defined in NASA Space Act Agreements (SAAs) or equivalent mechanisms. Occasional travel to Contractor facilities, NASA Headquarters, and other NASA installations may be required.

Support to this contract will be defined by specific TOs and will include requirements specific to MSFC as well as other Center specific locations.

Any unique frequently used nomenclature used throughout this Contract may be referenced in Attachment J-18, Acronym List. Applicable and referenced

J-1-3 documents are summarized in Attachment J-17, Applicable and Referenced Documents.

2.0 CONTRACT INTEGRATION REQUIREMENTS

2.1 PROGRAM MANAGEMENT

The Contractor shall provide administrative and technical program management for effective direction and control of this contract. The Contractor's plan and approach for providing such management, including estimation of program management Work Year Equivalent (WYE) by year, shall be documented, and prepared in accordance with Data Requirements Document (DRD) 1566MA-001, Management Plan. The Contractor’s Management Plan is incorporated in this contract as Attachment J-15. Throughout this PWS, and through the duration of the Contract, the Contractor shall identify to the Government any proposed innovations or streamlined approaches that will ensure operational cost effectiveness and enhance the probability of mission success throughout the duration of this contract.

The Contractor shall report and document this work and fulfill the requirements of associated Data Requirements Description (DRD) as outlined in Data Procurement Document (DPD) 1566 (Attachment J-2). The Contractor shall determine the data restriction that applies to each data deliverable and mark or transmit the data restriction in accordance with section 2.3.3 of the DPD.

The Contractor shall provide and use management information systems that provide a means for monitoring and measuring performance, and which encompass planning, scheduling, progress reporting, and completion of tasks or subtasks. The Contractor shall support status meetings as determined by the Government.

The Contractor shall possess a Facility Security Clearance. Classified work requirements shall be defined in specific Task Orders and performed in accordance with Attachment J- 15 (Form DD254) Security Clearances, for those persons required to have such, will be obtained in accordance with NPR 1600.1, MSFC Security Program Procedural Requirements, NPR 1600.4, Identity and Credential Management, and Department of Defense (DoD) Manual 5220.22, Industrial Security Manual for Safeguarding Classified Information. Contractor personnel working at MSFC shall comply with these MSFC security regulations and the requirements of Homeland Security Presidential Directive (HSPD) No. 12.

The Contractor shall protect Controlled Unclassified Information (CUI) against inappropriate access and disclosure by handling such information in accordance with the procedures set forth in NPR 2810.7, Controlled Unclassified Information.

J-1-4

The Contractor shall provide environmental compliance reports prepared in accordance with DRD 1566EE-001, Environmental Compliance Reports.

The Contractor shall provide both an onsite and offsite employee location listing for MSFC and MAF, SSC and the MSFC BFF at KSC prepared in accordance with DRD 1566CD-001, Employee Location Listing. Access to Redstone Arsenal and MSFC shall be in accordance with NPR 1600.1, NASA Security Program Procedural Requirements, and NPR 1600.4, Identity and Credential Management.

The Contractor shall provide technical information concerning any invention, discovery, improvement, or innovation made by the Contractor in the performance of work under this contract with Technology Reports that shall be prepared in accordance with DRD 1566CD-002, Technology Reports.

2.1.1 BUSINESS MANAGEMENT

The Contractor shall provide an Organizational Conflict of Interest (OCI) Plan in accordance with DRD 1566MA-006, OCI Plan. The Contractor’s OCI Plan is incorporated in this contract as Attachment J-13, Organizational Conflict of Interest (OCI) Plan.

Monthly Financial Management Reports shall be provided in accordance with DRD 1566MA-007, Monthly Financial Management Reports. See Attachment J-3, Work Breakdown Structure (WBS), for financial reporting structures against the WBS.

Bi-weekly notes shall be submitted for events or accomplishments of reporting significance in accordance with DRD 1566MA-008, Bi-Weekly Notes.

The Contractor shall support the Government’s business management functions through reporting and analysis of the Contractor’s financial data. The Contractor shall provide Management Status Review (MSR) input in accordance with DRD 1566MA-005, MSR Inputs.

The Contractor shall provide the delivery of information on specific items, and supporting documentation related to resource and cost information, as re-procurement activity reports prepared in accordance with DRD 1566MA-009, Re- Procurement Data Package.

2.1.2 TASK ORDER DEVELOPMENT AND TASK ORDER MAINTENANCE

The Government will provide an automated task order management system tool to plan, organize, direct, and control contract activities. The Contractor shall utilize this tool for responding to Task Order Requests, in accordance with Attachment J-9, Task Order Flow Process. The Contractor shall provide an interface from the Contractor’s corporate accounting system to the Government provided task order management system tool.

J-1-5

2.1.3 PROPERTY MANAGEMENT

The Contractor shall comply with MPR 4000.2, Property Management, and FAR 52.245-1, Government Property.

The Contractor shall implement a property management system for all property and equipment. The Contractor shall prepare and maintain a report identifying and listing all equipment, tools and other hardware or software provided by the Government for use by the Contractor in the performance of contracted effort, and for which the Contractor has been given physical custody. The Government Property Management Plan report shall be prepared and maintained in accordance with DRD 1566LS-001, Government Property Management Plan.

2.1.4 SAFETY, HEALTH, AND ENVIRONMENTAL COMPLIANCE

The Contractor shall establish and implement an industrial safety, occupational health, and environmental program that provides a workplace free from recognized hazardous conditions and is free of incidents and injuries by (1) preventing employee fatalities; (2) reducing the number and severity of employee injuries and illnesses; and (3) protecting the environment through the ongoing planning, implementation, integration and management control of these programs in accordance with DRD 1566SA-002, SHE Plan. The Contractor’s SHE Plan shall address each Center SHE Core Program Requirement (CPR), including their sub-elements identified as applicable to the contracted effort and provide the level of detail necessary to acknowledge the Contractor fully understands the Center’s SHE CPRs:

a. CPR 1 - Management Leadership and Employee Involvement.

b. CPR 2 - Worksite Analysis.

c. CPR 3 - Hazard Prevention and Control.

d. CPR 4 - Safety, Health, and Environmental Training.

e. CPR 5 - Environmental Management System.

The Contractor shall also comply with local authority requirements when working away from MSFC.

The Contractor shall report mishaps and safety statistics to the MSFC Industrial Safety Branch in accordance with DRD 1566SA-003, Mishaps and Safety Statistics Support. The Contractor shall submit directly into the NASA Mishap Information System (NMIS) or shall use the forms listed in section 15.4 of DRD 1566SA-003 or electronic equivalent to report mishaps and related information required to produce the safety metrics.

J-1-6

2.1.5 CONTRACTOR PERSONNEL TRAINING AND CERTIFICATION

The Contractor shall define and identify which positions on this contract require specific training as required in MPR 3410.1, Training, and certification for the position as required in MWI 3410.1, Personnel Certification Program, MWI 3410.5, Personnel Certification Program for Skills, NPR 8715.3D, NASA General Safety Program Requirements, ASNT SNT-CD-1A, Recommended Practice for Personal Qualification and Certification in Nondestructive Testing, and applicable codes for certifications from the American Society of Non- Destructive Test (ASNT), and from the American Welding Society for welding, inspection, and Nondestructive Evaluation (NDE) of structural and pressure pipe welding.

The Contractor shall prepare, implement, and maintain a Personnel Training and Certification Plan for each training and certification requirement identified in accordance with DRD 1566SA-001, Personnel Training and Certification Plan.

The Contractor shall develop innovative methods for retaining required expertise.

2.1.6 IT SECURITY

The Contractor shall develop, implement, and maintain IT Security and the IT Security Management Plan as required by NFS 1852.204-76.

2.2 CROSS-CUTTING SUPPORT (IDIQ)

The task-ordered technically managed activities that cross over multiple SMA disciplines are as follows:

2.2.1 TECHNICAL MANAGEMENT

The Contractor shall coordinate the SMA activities with the Government to assure the proper execution of the SMA Program and Project Discipline Support, and Institutional Discipline Support in decisions affecting design, safety, production, testing and operation.

2.2.2 MSFC PERSONNEL CERTIFICATION ADMINISTRATION

The Contractor shall implement and maintain a program for developing and maintaining the expertise of MSFC employees in SMA disciplines including, but not limited to, System Safety Engineering, Reliability and Maintainability Engineering; Software Assurance; Quality Engineering; Quality Assurance;

Independent Assessments; the Industrial Safety Program; and Pressure Systems.

The Contractor shall develop, implement, schedule, and conduct specialized professional development training in compliance with MWI 3410.1, Personnel

J-1-7

Certification Program, when directed by the Contracting Officer.

The Contractor shall support the administration of the MSFC Personnel Certification Program in compliance with MWI 3410.1, Personnel Certification Program, and MWI 3410.5, Personnel Certification Program for Skills.

The Contractor shall maintain a database system to record personnel qualifications and certifications for MSFC and on-site Contractor personnel.

Currently this database system is the CERTRAK database (reference Attachment J-8, SMA Tools, Databases and Applications). The Contractor shall collect, screen personnel qualifications and certification packages and coordinate the review of these packages with the applicable MSFC Certifying Officer and enter the qualification and certification information into CERTRAK or other MSFC SMA designated databases in accordance with MWI 3410.1, Personnel Certification Program, and MWI 3410.5, Personnel Certification Program for Skills.

2.2.3 NASA ENGINEERING AND SAFETY CENTER (NESC), NASA SAFETY

CENTER (NSC), AND TECHNICAL AUTHORITY SUPPORT

The Contractor shall provide the necessary administrative and technical support to the Government to assure disciplined performance of work and timely application of resources necessary for completion of all work assigned within NASA Engineering & Safety Center (NESC), NASA Safety Center (NSC), and Technical Authority tasks.

2.2.4 INFORMATION EXCHANGE & REQUIREMENTS REVISION SUPPORT

The Contractor shall provide the following:

a. Review of and preparation of comments for drafts of new requirements documents or proposed revisions to existing requirements documents.

b. Support and coordination of the Government initiatives to implement new or revised requirements throughout MSFC organizations.

c. Support and coordination of working groups and communications forums.

d. Support and coordination of information exchange with MSFC SMA, MAF, NASA Headquarters, other NASA Centers, and MSFC Contractors.

2.2.5 DOCUMENTATION AND REPORT SUPPORT

The Contractor shall provide support in the development of documentation.

a. The Contractor shall provide support in the development of plans, procedures, briefing material, schedules and metrics and other documents required in the

J-1-8 accomplishment of the Government activities in accordance with the Attachment J-15, Contractor’s Management Plan

b. The Contractor shall provide support to the Government with evaluations and assessments of documentation to accomplish the SMA mission in support of MSFC programs and projects and shall provide reports to Government in accordance with DRD 1566MA-002, Evaluation and Assessment Reports.

c. The Contractor shall support the preparation and maintenance of the

Government documents including Organizational Issuances (OIs).

2.2.6 SUPPORT TO MSFC QUALITY MANAGEMENT SYSTEM

The Contractor shall support the Government Documents Control Board (DCB) activity for review, evaluation, and disposition of controlled documents, including the review of Organizational Issuances (OI) and related external documents under review by the DCBs.

The Contractor shall support the continued ISO 9001 and AS9100 registration at MSFC including, but not limited to, training of Government designated employees on the topics of ISO 9001 and AS9100, procedure preparation, and internal audit support. The Contractor shall assist in external and internal Audits, Surveillances and Corrective Action follow-up.

The Contractor shall receive, distribute, and track responses for the MSFC Acute Launch Emergency Reliability Tip (ALERT) program. (See also Section 3.2.11 of this PWS.)

The Contractor shall input data and generate reports for the MSFC Recurrence Control Action Request (RCAR) database. The Contractor shall screen incoming RCARs and shall record and track problem preventive action status. The Contractor shall coordinate Government review and disposition of RCARs, shall perform trending on related and screened RCARs by failure mode and cause, and shall operate and maintain the MSFC Corrective Action System (CAS) database.

2.2.7 SMA MANAGEMENT INFORMATION SERVICES

The Contractor shall utilize applications and databases and tools provided in Attachment J-8, SMA Tools, Databases, and Applications, to support SMA mission success. The Contractor shall provide data entry for these databases, shall manage resulting SMA data, and shall provide a virtual focal point for the presentation of refined, integrated SMA data. The Contractor shall administer the SMA delegated agency data, including annual forecasts, midyear updates, and monthly data reduction. The Contractor shall utilize these applications and databases required to support programs and projects, collect and input data, J-1-9 ensure data is maintained, up-to-date and accurate, and produce reports as identified in TOs. The Contractor shall continuously assess database inventory and function to develop more efficient ways to utilize data and to make recommendations for consideration by the Government. Development, security, and maintenance of these applications will be performed by the MSFC Office of the Chief Information Officer (OCIO).

The Contractor shall provide support to maintain SMA documentation and electronic data using established MSFC processes and electronic applications ensuring that data and information are current, accurate and accessible. SMA documentation and data is currently maintained on SharePoint sites, but this support will be required regardless of the platform used.

The Contractor shall assess SMA's information needs for the present and future.

The Contractor shall investigate alternatives for identified SMA needs, evaluate and recommend SMA requirements for new system enhancements or capabilities.

The Contractor shall present SMA management with precise descriptions and recommendations on system alternatives and improvements.

The Contractor shall highlight and suggest improvements for product application requirements and enhancements and make management recommendations to the Government. The Government will provide overview and retain final decision-making authority over all design and development activities. The Contractor shall interface with the OCIO during product development and change requests.

The Contractor shall provide administrative and technical support for the MSFC SMA Council to include, but not limited to, developing and posting Council agenda, schedule, meeting minutes, and associated Council and Marshall Team Meeting information on the relevant SharePoint sites.

2.2.8 SMA READINESS REVIEW CENTER

The Contractor shall support, coordinate, and operate the MSFC SMA Readiness Review Center to include, but not limited to, dry runs and reviews established for programs and projects, scheduling, data collection, preparation, and distribution of MSFC SMA presentation materials, and data exchange with other NASA Centers or NASA HQ.

2.2.9 MSFC VENDOR AND SUPPLIER AUDIT SUPPORT SERVICES

The Contractor shall provide auditors to audit and to prepare checklists and plans to be used to support Government audits of MSFC vendors and suppliers as identified in TOs. The Contractor shall provide support to the Government, auditors, and auditees by assisting in scheduling audits, tracking and follow-up of findings, and preparation and distribution of final reports as identified in TOs.

The Contractor shall maintain the Audit Kanban Board (WebServices JIRA) for

J-1-10 the implementation of audits and the retention of quality records associated with audits.

3.0 PROGRAM AND PROJECT DISCIPLINE SUPPORT

The Contractor shall provide technical services, in accordance with TOs, to any SMA supported program and project. When TOs are to be executed either at or for the benefit of a location other than MSFC or MSFC managed facilities, the Government will define in the TO the site-specific requirements and standards that are uniquely applicable under that TO.

The Contractor shall provide planning, coordination, and surveillance of overall activities to assure disciplined performance of work and timely application of the resources necessary for completion of all tasks described in this entire PWS in accordance with the QMS requirements and the SMA’s Organizational Issuances.

a. The Contractor shall participate in technical issues meetings to discuss and resolve SMA issues.

b. The Contractor shall provide support to the applicable program and project safety review processes and panels for the purpose of ensuring rigor in the safety analyses. Support shall include, but not be limited to, documentation distribution and review, board establishment and communication, executive secretary function, meeting action item tracking, records retention, and independent “Checklist Reviews” of Safety Compliance Data Packages.

c. The Contractor shall provide systems expertise for program and project

Boards to include, but not limited to, Configuration Control Boards (CCBs), Problem Review Boards, Document Control Boards (DCB), Program and Project Control Boards (PPCB), Material Review Boards (MRB). The Contractor shall advise the MRB members and recommend corrective actions to improve product quality. The Contractor shall also participate in the construction of trending charts and analyses on MSFC contracted and in-house efforts and shall provide recommendations to the Government on adverse MSFC Contractor and in-house trends.

d. The Contractor shall provide assessments of flight readiness in support of the

SMA input to readiness reviews for programs and projects, upon request.

This support includes, but is not limited to, technical issues resolution and status of SMA flight critical documentation (such as Certificates of Qualification, Hazard Analyses and Failure Modes and Effects Analyses (FMEAs)).

J-1-11

e. The Contractor shall track action items and issues resulting from team meetings, milestone reviews and flight readiness activities, and recommend disposition to the Government.

f. The Contractor shall provide real-time MSFC Safety, Reliability, Maintainability and Quality Assurance (SRM&QA) Documents (SRM&QA) assessments during launch countdowns and mission operations. Huntsville Operations Support Center support shall be provided as specified in TOs.

Program or project personnel will coordinate these activities.

g. The Contractor shall provide schedule support through the development and tracking of SMA deliverables as they relate to program and project milestones.

h. The Contractor shall support program and project milestone reviews (i.e., System Requirements Review (SRR), Preliminary Design Review (PDR), Critical Design Review (CDR), and Design Certification Review (DCR)) to identify, evaluate and perform the review of all applicable documentation and shall develop and submit review item discrepancies and comments as warranted. The Contractor shall support technical meetings with customers to discuss and resolve issues.

i. The Contractor shall provide expertise to support the preparation, evaluation, and assessment of in-house and contractual program and project risk management plans and techniques, to facilitate the identification, tracking, and mitigation of risks and issues that may negatively impact a project or program.

1. The Contractor shall provide recommendations and advice to Government engineers and managers relative to risk mitigation actions to minimize or eliminate risks.

2. The Contractor’s risk management experts shall be trained in accordance with training requirements of MWI 7120.6, Program, Project, and Institutional Risk Management. The Contractor’s Continuous Risk Management Course instructors shall present Continuous Risk Management courses and workshops to Government designated personnel.

3.1 SYSTEM SAFETY ENGINEERING

The Contractor shall execute the system safety engineering activities using the approaches, methods, and tools identified in the Government-approved planning documentation per DRD 1566MA-003, SRM&QA Documents.

3.1.1 SYSTEM SAFETY TOOLS

The Contractor shall utilize SMA specific tools (as specified in Attachment J-8, SMA Tools, Databases, and Applications) needed to assure that all system safety

J-1-12 requirements to include, but not limited to, Agency, Center, Program and Project requirements are identified for Government programs and projects. These should include, but not be limited to fault tree analysis, logic trees, risk definition and mitigation analyses, hazard analysis and trending, and data search.

3.1.2 REQUIREMENTS AND VERIFICATION

As directed by TOs, the Contractor shall assess program or project documentation (e.g., Contractor PWS, Data Requirements Documents, System Requirements Document, Contract End Item, Requirements Verification Compliance procedures) to assure that all safety requirements are addressed in compliance with Government requirements. The Contractor shall provide system safety support for all mission phases (design, development, verification, operations, post flight analysis, and sustaining engineering.)

a. The Contractor shall assess and support development of program or project verification plans and verification requirements (e.g., Verification Plans, Requirements Verification Compliance (RVC) documents) to assure all safety verification requirements are properly included.

b. The Contractor shall assess test and operating procedures to assure compliance with safety controls and safety verification requirements.

c. The Contractor shall assess or generate safety verification compliance data to assure it clearly demonstrates compliance with the safety verification requirements and parent safety requirement.

3.1.3 HAZARD ANALYSES

The Contractor shall perform or assess and document hazard analyses for both in-house and contracted design and development projects, to assure that: (a) all hazards are identified and the associated risks properly characterized; (b) hazard controls satisfy safety requirements and mitigate safety risks; (c) safety verification requirements are clearly identified, including the clear definition of verification pass/fail criteria; and (d) the safety verification status is maintained in a closed loop accounting system.

3.1.4 SAFETY PLANS

The Contractor shall prepare and assess Safety Plans (for both assigned in-house and contracted) design, development, and operational projects to assure compliance with applicable Agency, Center, and Program safety requirements.

The Contractor shall assess and contribute to the development of Project Plans as specified in Attachment J-14, Safety and Health Plans to assure that safety is properly considered.

J-1-13

3.1.5 TRADE STUDIES

The Contractor shall perform and assess trade studies relative to design, development, operation, or mission events for assigned in-house and contracted projects, to assure compliance with safety requirements and to assure safety risks are identified, characterized, and mitigated.

3.1.6 CHANGE (DEVIATION/WAIVER/SPECIFICATION CHANGE NOTICES

(SCN’S)) EVALUATION

The Contractor shall assess proposed changes, deviations, and waivers to program and project documentation to assure compliance with safety requirements. This assessment includes evaluation of the impacts to safety and hazard analyses and the effects on program or project risk.

3.1.7 TRENDS

The Contractor shall identify any adverse safety trends for assigned system safety engineering programs and projects and promptly notify MSFC SMA.

3.1.8 SAFETY ASSESSMENTS

The Contractor shall perform safety assessments of any issues for assigned system safety engineering programs and projects which involve one or more of the following:

a. Operation or performance outside the expected performance range of parameters or which has not previously been experienced.

b. Discrepancies or non-conformances which affect:

1. Configuration

2. Certification

3. Mission Success

4. Safety Critical Functions

5. Verification

c. Adverse problems or trends.

d. Discrepancies or non-conformances which the operator determines require design element analysis or assistance for resolution.

e. Unexplained anomalies or events.

f. Limited life hardware.

g. Restricted hardware or software use.

h. Hazard controls.

i. Flight or ground operation procedures that are controlled by the Government.

J-1-14

j. Software or hardware configurations changes that are controlled by the

k. Waivers/exceptions for use of hardware that does not meet performance specifications, exceeds certification limits, or surpasses time, age, and cycle life limits

l. Critical hardware manufacture or repair processes.

m. Development of safety critical software and discrepancies in delivered critical software.

3.1.9 METRICS

The Contractor shall develop and maintain metrics regarding the safety performance of assigned Government system safety engineering programs and projects.

3.2 RELIABILITY AND MAINTAINABILITY ENGINEERING

The Contractor shall execute the reliability and maintainability activities using the requirements, approaches, methods, and tools identified in the Government-approved Program or Project specific Reliability and Maintainability Program Plan and in accordance with SRM&QA Documents (DRD 1566MA-003).

3.2.1 RELIABILITY AND MAINTAINABILITY TOOLS

The Contractor shall develop and utilize reliability and maintainability design and development methods and tools (as specified in Attachment J-8, SMA Tools, Databases, Applications) needed to assure that all reliability and maintainability requirements are identified for Government programs and projects. The Government will approve the methods proposed by the Contractor. These methods include, but are not limited to, FMEAs, and Critical Item Lists (CILs) information analysis, reliability block diagrams, hardware indenture level and next higher assembly diagrams, reliability trending and assessments, maintainability trending and assessments, and any other systems needed to analyze reliability and maintainability information. The analytical results of these tools shall be provided to the Government with recommendations.

3.2.2 REQUIREMENTS AND VERIFICATION

The Contractor shall evaluate program and project documents related to reliability and maintainability to assure consistency and adequacy with overall program and project requirements.

3.2.3 OPERATIONS AND MAINTENANCE REQUIREMENTS

The Contractor shall evaluate Operations and Maintenance Requirements Specifications (OMRS) and implementing Operations and Maintenance

J-1-15

Instructions (OMIs) to assure that reliability and maintainability requirements are addressed and implemented.

3.2.4 RELIABILITY ASSESSMENTS

The Contractor shall prepare reliability assessments, by developing a System Reliability, Availability and Maintainability Model utilizing reliability data bases, for each mission, vehicle, and other equipment in support of preflight assessment reviews and flight readiness milestone reviews.

3.2.5 ANALYSES EVALUATION

The Contractor shall evaluate hardware and software reliability and maintainability analyses, to verify the validity of the analyses and assure that the analyses have been performed in accordance with DRD 1566MA-003, SRM&QA

3.2.6 RELIABILITY AND MAINTAINABILITY PLANS

The Contractor shall prepare, evaluate and assure reliability and maintainability plans for MSFC assigned in-house and contracted design, development and operations projects that are compliant with NASA Headquarters, Center and programmatic requirements, in order to achieve the following objectives: (1) understand the Government requirements; (2) design for reliability and maintainability; (3) produce reliable and maintainable systems; (4) monitor and assess field reliability and maintainability; and (5) are consistent with Government direction. The Contractor shall support the development and assessment of FMEAs and CILs and their ground rules for assigned in-house and contracted design and development projects. The Contractor shall provide reliability and maintainability support of all mission phases (design, development, verification, operations, post flight analysis and sustaining engineering).

a. The Contractor shall evaluate changes, out-of-family conditions, material reviews, and deviations for impact to FMEAs and CILs.

b. The Contractor shall develop and evaluate FMEAs and CILs for compliance with requirements in accordance with DRD 1566MA-003, SRM&QA

3.2.7 LIMITED LIFE

The Contractor shall evaluate in-house and contracted methods for identification and control of limited life items (LLIs). The Contractor shall verify, through assessments, that sufficient remaining life of equipment is available for accomplishing the mission requirements and objectives. The Contractor shall verify that life limits of common hardware are consistent. The Contractor shall

J-1-16 evaluate and assess life extension plans for applicable LLIs and provide analysis of results.

3.2.8 PROBABILISTIC RISK ASSESSMENT (PRA)

The Contractor shall prepare PRA plans for all mission phases (design, development, verification, operations, post flight analysis and sustaining engineering) of Government managed programs and projects requiring PRA compliance with NASA Headquarters, Center, and Programmatic requirements.

a. The Contractor shall support requirements development, implementation, and maintenance of informal data tools, including data populations, develop or provide tools (as specified in Attachment J-8, SMA Tools, Databases, Applications) and techniques to perform probabilistic risk analysis.

b. The Contractor shall perform probabilistic risk analysis according to documented plans, assessments and mitigation for Government managed programs and projects. The Contractor shall be able to perform PRAs on Government programs and projects to include data collection related to Government programs and projects (e.g. International Space Station, Engines, Boosters, Stages, Avionics, Payloads, and Software), risk model selection and risk analyses of these, utilization of the selected risk model(s) to be integrated into the overall development and flight hardware system model, simulation of risk scenarios, using available software packages and an overall report on the data, methods and models, and results.

3.2.9 MODELING SIMULATION

The Contractor shall develop and employ quantitative and qualitative models and simulations to support all mission phases of MSFC managed development, to include but not limited to flight hardware and software as well as sustaining engineering of this hardware and software. The Contractor shall perform analyses to ascertain and verify the technical validity of models and simulations for both in-house and contracted design and development projects.

The Contractor shall develop and deliver, in accordance with TOs, System Reliability, Availability & Maintainability (RAM) Models for Government managed hardware and software, to assess if the design (including commercial off the shelf, non-developmental items, and Government furnished equipment) is capable of meeting reliability requirements in the operational environment.

If the assessment is that the Government’s requirements are infeasible, the Contractor shall communicate this to the Government.

The Contractor shall (1) generate and update the reliability and maintainability allocations from the system level down to lower indenture levels, (2) aggregate system-level reliability based on reliability estimates from lower indenture levels, J-1-17

(3) identify single points of failure, and (4) identify reliability and maintainability critical items and areas where additional design or testing activities are required to achieve the reliability and maintainability requirements. The System RAM Models shall be updated whenever new failure modes are identified, failure definitions are updated, operational and environmental load estimates are revised, or design and manufacturing changes occur throughout the life cycle. Detailed component stress and damage models shall be incorporated.

The Contractor shall assess the reliability and maintainability of the system periodically throughout the life cycle using the System RAM Model, the life-cycle operational and environmental load estimates, and the failure definition and scoring criteria. Reliability and maintainability assessments shall be made based on data from analysis, modeling and simulation, test, and operations, and shall be tracked as a function of time and compared against reliability and maintainability allocations and requirements. The Contractor shall monitor and evaluate the reliability and maintainability impact of changes to the design or manufacture of the System RAM Model. The implementation of corrective actions shall be verified, and their effectiveness tracked. Formal reliability growth methodology shall be used where applicable (e.g., when failure modes are discovered and addressed with a test-analyze-and-fix process that is applied to complex assemblies) in order to plan, track, and project reliability improvement.

The Contractor shall perform planned and ad hoc numerical reliability and maintainability analyses using analytical methods and models. The analytical methods may include, but not be limited to, classical probability density functions, reliability and maintainability models, Monte Carlo simulation models, and probabilistic risk analysis.

3.2.10 REVIEWS

The Contractor shall participate in technical interchanges with the Government to compare the status and outcomes of reliability and maintainability activities, especially the identification, analysis, classification, and mitigation of failure modes. The Contractor shall participate in reliability and maintainability reviews to develop an understanding of the environment in which the system will operate and to assure progress toward achieving the reliability and maintainability requirements.

The reliability and maintainability effort shall be integrated with the systems engineering, design engineering, and test programs as well as configuration management and integrated logistics support functions. Reliability and maintainability shall be integrated with the additional related engineering disciplines to include but not limited to technical specialties of quality assurance (hardware and software), human engineering, system safety, software development, and parts, materials, and processes control to preclude duplication of effort and produce integrated cost-effective results.

J-1-18

3.2.11 Government/Industry Data Exchange Program (GIDEP) and NASA Advisories, Notices, and Alerts Distribution and Response Tracking System

(NANADARTS)

The MSFC GIDEP and NANADARTS processes contain objective failure information as a result from GIDEP Alerts that are placed in the NANADARTS system. Alerts are Action Notices which notify users of nonconforming parts, components, chemicals, processes, materials, safety, and hazardous situations.

This data also includes failure analysis and problem information submitted from laboratory analysis. This process is defined in MWI 1280.5, MSFC Alert Processing.

a. The Contractor shall receive Alerts from GIDEP that are placed into the

NASA’s NANADARTS database.

b. The Contractor shall also distribute Alerts to Government designated actionees for review and disposition, track the status of the reviews by programs and project, enter the results of the reviews in the GIDEP database, and transmit the results of the reviews to the organizations identified in MWI 1280.5, MSFC Alert Processing.

c. The Contractor shall distribute Alerts data available real-time to users and track the status of Alerts, assure that actionees provide timely closures and evaluate Alerts closure rationale.

d. The Contractor shall generate or assist in the generation of Alerts.

3.2.12 PROBLEM ASSESSMENT CENTER (PAC)

The Contractor shall provide support to the establishment of a MSFC Problem Assessment Center according to program and project requirements. Specifically, for the Space Launch System (SLS) Program, the Contractor shall provide support to the MSFC Problem Assessment System according to SLS-RQMT-014, SLS Program Safety and Mission Assurance Requirements.

The Contractor shall provide support to integrate all MSFC PAC program and projects in accordance with program and project requirements and shall provide annual assessments.

The Contractor shall maintain and implement an Operations Plan for the MSFC PAC in accordance with DRD 1566MA-004, Problem Assessment Center (PAC) Operation Plan. The plan shall describe, in detail, the PAC activities necessary to fulfill the problem reporting requirements (from initiation of project problem reporting through project termination) for any MSFC managed projects for which problem reporting is required. The plan shall also identify the periodic reports the PAC will issue to fulfill Government needs.

J-1-19

3.2.13 TRADE STUDIES

The Contractor shall provide reliability and maintainability assessments in support of design trade studies and shall evaluate other Contractor prepared trade studies to assure reliability and maintainability has been addressed.

3.2.14 CHANGE DEVIATIONs, WAIVERs, SPECIFICATION CHANGE NOTICES

(SCNs) EVALUATION

The Contractor shall evaluate engineering and programmatic changes, to include but not limited to, Engineering Change Requests (ECRs), Engineering Change Proposals (ECPs), Deviations, Waivers, Program Change Proposals (PCPs) and SCN's for reliability and maintainability impact.

3.3 SOFTWARE ASSURANCE

Performance of all tasks assigned for PWS Section 3.3, Software Assurance, shall be in accordance with QD-QE-014, Software Assurance Program Organizational Issuance, and DRD 1566MA-003, SRM&QA Documents.

The Contractor shall use a software assurance team comprised of expertise in the disciplines of software quality, software reliability, software safety, and software verification and validation. Process assurance tasks are applicable to all software assurance activities, to include those for complex electronics, (as defined in NASA-HDBK-8739.23, Complex Electronics Handbook for Assurance Professionals) Assurance tasks include but are not limited to:

a. The Contractor shall plan, organize, perform, monitor, communicate and manage software assurance activities for software developed for all phases of the product lifecycle including product concept, and oversight, requirements definition, design, implementation, problem reporting, corrective action, verification and validation, testing, operations, maintenance, and retirement.

b. The Contractor shall evaluate software products and processes to ensure standards and processes are implemented correctly and adhered to.

c. The Contractor shall perform software assurance classification assessments including safety criticality designations for Government developed or acquired software.

d. The Contractor shall assure that software verification and validation activities occur according to established plans, policies, procedures, and standards.

e. The Contractor shall ensure that functional configuration audits and physical configuration audits are performed, and all software acceptance documentation is complete.

J-1-20

f. The Contractor shall witness and monitor software formal qualification testing.

g. The Contractor shall document problems, discrepancies, test anomalies and risks in the project problem reporting system or MSFC SMA Problem Reporting System, Serena Business Manager, referenced in Attachment J-8, SMA Tools, Databases, and Applications.

h. The Contractor shall perform software safety analyses including, but not limited to, software hazard analyses and software fault tree analyses to determine software failure causes and controls to mitigate hazards.

i. The Contractor shall identify safety critical software requirements based upon controls identified in hazard analyses.

j. The Contractor shall perform software reliability analyses including determining defect density, trend analyses, and failure modes and effects analyses for incorporation into integrated reliability analyses.

k. The Contractor shall assist the Government with the identification and discussion of significant issues and risks to be presented at the program and project boards and forums.

l. The Contractor shall develop software assurance plans in accordance with

QD-QE-007, Software Assurance Planning Organizational Issuance, and in accordance with program and project data requirements documents (DRDs).

m. The Contractor shall perform process assurance for configurable logic devices in accordance with MSFC-STD-3663, MSFC Standard for Configurable Logic Device Development.

3.4 QUALITY ENGINEERING

The Contractor shall execute all the quality engineering activities set forth herein using the approaches, methods, and tools identified in the Government approved planning documentation according to DRD 1566MA-003, SRM&QA

3.4.1 WORKMANSHIP

The Contractor shall evaluate workmanship against the technical standards, specifications, procedures, and control documentation for in-house and contracted processes and purchases used throughout all phases of the hardware and software development cycle. The Contractor will record these evaluations in the Government-designated reporting system.

J-1-21

3.4.2 TOOLS

The Contractor shall develop and utilize tools (as specified in Attachment J-8, SMA Tools, Databases, and Applications) needed to assure that all applicable quality assurance requirements are identified for Government programs and projects.

These tools should include, but not be limited to, quality information analysis (including workmanship standards, specifications, procedures, and documentation quality control), quality data trending and assessments, and as-built configuration databases.

3.4.3 REQUIREMENTS AND COMPLIANCE

The Contractor shall prepare, evaluate and, provide assessments of in-house and contracted quality documentation (e.g., Hardware and Software Quality Assurance (QA) Plans) including implementation instructions and procedures for Government QA policies and directives.

a. The Contractor shall provide quality engineering support for all mission phases (design, development, verification, operations, post-flight analysis, and sustaining engineering).

b. The Contractor shall evaluate test results versus verification requirements including the disposition of test anomalies and discrepancies for adequacy.

The Contractor shall maintain the necessary certification records, files, and hardware certification status.

c. The Contractor shall support post flight or post-test assessment for programs and projects. The Contractor shall prepare assessment reports and presentations. The Contractor shall evaluate observations for determination of items that warrant formal problem reports.

3.4.4 QUALITY ENGINEERING REVIEWS AND ASSESSMENTS

The Contractor shall perform reviews and assessments of in-house and contracted QA instructions for compliance with NASA policy, QMS, SMA Organizational Instructions.

a. The Contractor shall provide QE for the preparation, evaluation, and assessment of in-house and contractual documentation relative to processes (e.g., additive manufacturing, electrical, electronic, materials, and non-destructive evaluation) encountered during the manufacturing, inspection, and test phases of projects.

b. The Contractor shall provide QE with the ability to inspect in-house designs.

The Contractor shall perform drawing and procurement documentation reviews for Government signature and approval. The Contractor shall

J-1-22 recommend the quality requirements for procurements.

c. The Contractor shall prepare and evaluate in-house inspection criteria for safety critical hardware and software characteristics and other requested characteristics in accordance with QD-QA-018, Review of Work Authorizing Documents.

d. The Contractor shall evaluate and provide written assessments, for inspection criteria and the implementation of these inspections from other Government Contractors and Agencies.

e. The Government may delegate to the Contractor the signature authority for drawings, chairing authority for MRB, or membership on other activities as SMA representative, in accordance with QD-QE-001, Project Quality Instruction.

3.4.5 FAILURE INVESTIGATIONS

The Contractor shall support problem and failure investigations to assess issues, determine root cause and recommend corrective action.

3.4.6 TRADE STUDIES

The Contractor shall perform and evaluate trade studies relative to design, fabrication, inspection, testing, and operations.

3.4.7 CHANGE (DEVIATIONS AND WAIVERS) EVALUATION

The Contractor shall provide Engineering Change Proposal (ECP)…