Appendix B_Design Review Flow Deliverables and Expectations_DISTRO A.pdf

AEDC Design Review Flow and Expectations

Step 1

Step 2

Step 3

Design Review Kickoff Meeting Scheduled for

AEDC Reviewers

• Meeting shall be scheduled at least ten working days prior as a placeholder for AEDC reviewers.

• This meeting shall be scheduled in coordination with AEDC Primary Project Point of Contract (POC) or or AEDC designee.

• Link to review documentation shall be in meeting notice.

• The review will start after the kickoff (KO) meeting and documentation for review shall be made available at that point.

• Presentation shall be available two working days prior to KO meeting.

• Review period end dates shall be clearly stated.

• Between the time the KO meeting is scheduled and the KO meeting date, the Awarded Contractor Primary POC or designee and the AEDC Primary POC or designee will discuss and review the contents of the design review package for completeness, readiness, and format, and ensure all deliverables are provided per AEDC requirements.

• If the package is incomplete, the KO meeting shall be scheduled no later than five working days after original meeting date.

• The Design Review package must be organized according to provided AEDC standards in the designated folder prior to KO meeting.

• The Design Review package shall meet all entry criteria with commentary where needed.

• The Design Review documents shall be prepared and posted on a stable, shared drive.

• Awarded Contractor Primary POC or designee and the AEDC Primary POC or designee will discuss and agree on file formats.

Design Review Package being Reviewed

Kickoff Meeting

• Awarded Contractor Primary POC or designee shall present design and data per SEA.

• During Briefing the file structure shall be presented to reviewers for data navigation understanding.

• The KO meeting starts the ten working day review period.

• Weekends and Government holidays are non-working days.

• At this meeting the package, entry criteria, and exit criteria must be presented.

• In this meeting, it shall be clearly stated and demonstrated where to input comments and when the review period ends.

• The review team will be confirmed and will concur with the requested review period.

• Meeting should be recorded and/or detailed meeting minutes are provided to all attendees.

DISTRIBUTION A: Approved for public release, distribution is unlimited.

IRA-26-1433

AEDC Design Review Flow and Expectations

Step 4

Step 5

Step 6

Review Period

• AEDC stakeholders and other designated reviewer will have a review period of ten working days

• All identified stakeholders are to review and provide comments in comment sheet provided by AEDC Primary POC or designee.

• No additional design information will be added once review period starts unless the review period is extend appropriately.

• Review period ends COB on the tenth working day.

Comment Resolution

• Once the review period ends the AEDC Primary POC or designee will review all comments to verify the comments are clear and coherent.

• The Awarded Contractor will address all comments in good faith to the best of their knowledge and contract responsibilities.

• The Awarded Contractor will address all comments in ten working days (i.e.

accepted, incorporated, rejected, deferred, etc.) with explanation for commentor to understand disposition.

• The AEDC Primary POC will redistribute comment sheet to stakeholders/reviewers and assure all comments are reviewed and accepted/rejected with explanation by original commentor.

• Comments that need additional time to resolve or show verification evidence will be transferred to 1565 form. Only one 1565 sheet may be used, if additional lines are needed the design review is considered a failure.

Closeout Meeting

• The Closeout meeting is reserved to discuss unresolved comments for the contractor Primary POC or designee/AEDC Primary POC or designee to develop path forward for resolution with appropriate stakeholders and contractor personnel. If no unresolved comments exist, this meeting can be cancelled.

• This meeting should be scheduled by AEDC Primary Project POC or AEDC designee.

• AF Form 1683 documents approval/failure of the design review with appropriate entrance/exit criteria to proceed to the next design review. The AF Form 1565 documents any deficiencies within the comment sheet and path to closure.

• All deficiencies must be resolved prior to entering the next design review cycle.

• Meeting should be scheduled at least five working days prior as a placeholder for AEDC reviewers.

DISTRIBUTION A: Approved for public release, distribution is unlimited.

Work Products to be Delivered by Contractor Acceptable Format

AF

Concurrence

1 Provide a Comments Log for this review.

Comments Log shall include, at a minimum, the following:

▪ All reviewer provided comments

▪ Resolution or disposition for each comment

▪ Status of reviewer concurrance for each comment

Location: Review Folder Format: Excel Spreadsheet

If a TEMPLATE or EXAMPLE Comment Log is desired, the Government will provide one upon request.

AF PM

1 Provide a brief project summary.

Summary shall clearly identify, at a minimum, the following:

▪ Purpose of the project

▪ Scope of the project

▪ Approvals requested as part of this review

Location: Presentation Format: Narrative

AF PM

1 Provide a list of Entrance Criteria with mapping.

The list shall include the following:

▪ Identification of all approved Entrance Criteria for this review

▪ Acceptable location and format for each item listed

▪ Presentation slide or file intended to satisfy each item listed

Location: Presentation Format: Table

AF PM

2 Provide a copy of the complete Statement of Work identifying how the Contractor intends to satisfy the Statement of Objectives.

The Statement of Work shall include, at a minimum, the following:

▪ What work activities will be performed

▪ How each activity will be performed

▪ Codes and standards applicable to each activity

▪ What requirements or acceptance criteria will be applied to each work activity

▪ What deliverables will be provided for each activity

▪ How each activity will be verified as correct

Statement of Work shall be provided in the Approved state.

Location: Presentation Format: List or Narrative

AF PM

2 Provide a copy of all requirements documents approved for use at the time of this review.

Documents shall include, as available, the following:

▪ Statement of Objectives (SOO)

▪ Additional Requirements Identified in Contract

Requirements documents shall be provided in the original, unaltered state. Any proposed corrections, changes, or other revisions shall be provided separately.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

AF PM

2 Provide mapping of requirements between the approved requirements documents and the proposed Statement of Work.

Requirements mapping shall verify, at a minimum, the following:

▪ All requirements established in the requirements documents have been addressed by the requirements and activities identified in the Statement of Work

▪ All requirements and activities identified in the Statement of Work are justified by the requirements established in the requirements documents unless otherwise approved by the Government

Requirements or activities in the Statement of Work that are not directly justified by requirements in the provided documentation must be clearly identified with a justification as to why the requirement should be included.

Location: Presentation Format: Table

TG

TSS

XP*

4 Provide a Work Breakdown Structure.

WBS shall be to at least Level 3 and include, at a minimum, dedicated Level 2 sections for each of the following:

▪ Project Management Activities

▪ Planning Activities

▪ Design Activities

▪ Procurement Activities

▪ Fabrication Activities

▪ Software Development Activities

▪ Installation Activities

▪ Verification and Validation Activities

▪ Closeout Activities

▪ Risk Mitigation Activities

Location: Presentation Format: Table or List

AF PM

TG

TSS

4 Provide a general project schedule.

Schedule shall include, at a minimum, the following for each Task:

▪ Proposed timing and duration of planning phase

▪ Proposed timing and duration of design phase

▪ Proposed timing for each design review or milestone

▪ Proposed timing and duration of execution phase

▪ Proposed timing and duration of checkout phase

▪ Proposed timing of completion

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF, 11"X17" Format

Location: Review Folder Format: Original File in Native File Format

AF PM

TG

TSS

4 Provide a general project cost estimate.

Cost estimate shall account for, at a minimum, the anticipated total cost for each of the following:

▪ Major procurements

▪ Design labor

▪ Fabrication materials & labor

▪ Installation materials & labor

▪ Verification labor & utilities

▪ Project management

▪ Overall project

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Excel Spreadsheet

AF PM

TG

TSS

AF Representatives: PMDC Air Force Project Manager or Designee [AF PM], PMDC Technical Advisor or Designee [PMD], Squadron/Test Group Technical Advisor or Designee [TG], TSS Asset Owner or Designee [TSS], TSDI Representative or Designee [TSDI], TSDC Representative or Designee [TSDC], TS Representative or Designee [TS], XP Representative or Designee [XP]

Entrance Criteria Any required work product not provided for this review, or any work product not provided in the required state, shall have Government approval for the status of the product prior to commencing the review process.

Documentation of Government approval shall be provided, clearly identifying the associated work product(s).

Review Documentation

Requirements Documentation

Programmatic Documentation

Project 16663 - Pump Room R&M

Nomenclature

Initial – Rough draft of the required documentation that sufficiently demonstrates intended format and content. Documentation should include all known relevant information; however, it is acknowledged that significant amounts of information may still be undetermined. Significant unverified assumptions and placeholders identifying unknown information are acceptable.

Draft – Complete documentation, including all currently known relevant information in an appropriate format, that has not completed a formal peer review or other checking process. Draft documentation may include marked up copies of existing approved documentation as long as all required changes to the document are clearly and completely identified. Documents that are currently undergoing a formal peer review or other checking process are considered to be in the draft state regardless of where they are in that process.

Preliminary – Documentation that has completed a formal peer review or other checking process, but has not received final approval for release. Documentation is complete, accurate, and sufficient to support the proposed solution, but may still require minor corrections, changes to formatting, or changes to details not directly impacting the final solution. These minor issues are permissible, but should be clearly identified.

Approved – Documentation that has completed a formal peer review or other checking process and received final approval for release. Documents shall be submitted as a final product including signatures verifying that the document has been checked and approved, but documentation is not required to be submitted as a complete package ready for execution.

Final – Documentation that has been approved for release and is ready for execution. Documents shall be submitted as a single complete package ready for exection, including signatures verifying that all documents have been checked and approved. Execution package shall include all drawings, analysis, procurement documents, planning documents, and verification documents required to execute the identified scope of work.

REQUIREMENTS REVIEW (RR)

Chairperson: Decision Authority or Designee

DISTRIBUTION A: Approved for public release, distribution is unlimited.

5 Provide an initial list of potential risks to project execution.

Risk Assessment shall identify the following:

▪ All known risks that could significantly affect the technical solution, project cost, or project schedule

▪ Likelihood of each listed risk

▪ Cost or schedule impact of each listed risk

Location: Presentation Format: Table or List

AF PM

TG

TSS

XP*

5 Provide a list of Entrance Criteria for the next scheduled review.

The list shall include the following:

▪ All Government-identified Entrance Criteria

▪ Any deviations from the listed Entrance Criteria requested or recommended by the

Contractor

Location: Presentation Format: Table

AF PM

TG

Work Products to be Delivered by Contractor Acceptable Format

AF

Concurrence

1 Provide a Comments Log for this review.

Comments Log shall include, at a minimum, the following:

▪ All reviewer provided comments

▪ Resolution or disposition for each comment

▪ Status of reviewer concurrance for each comment

Location: Review Folder Format: Excel Spreadsheet

If a TEMPLATE or EXAMPLE Comment Log is desired, the Government will provide one upon request.

AF PM

1 Provide an updated status for all unresolved deficiencies and action items.

Update shall include the following:

▪ Copy of the signed AEDC-1565 from the most recent previous review

▪ Updated status for all deficiencies and action items listed

AEDC-1565

Location: Review Folder Format: PDF

Status List Location: Presentation Format: Table

AF PM

TG

TSS

1 Provide a copy of all requirements documents approved for use at the time of this review.

Documents shall include, as available, the following:

▪ Statement of Objectives (SOO)

▪ Additional Requirements Identified in Contract

Requirements documents shall be provided in the approved and unaltered state. Any proposed corrections, changes, or other revisions shall be provided separately.

All approved changes to the requirements documents from the previous review shall be clearly identified.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

AF PM

1 Provide a brief project summary.

Summary shall clearly identify, at a minimum, the following:

▪ Purpose of the project

▪ Scope of the project

▪ Approvals requested as part of this review

▪ Waivers or deviations requested as part of this review

▪ Scope changes or clarifications requested as part of this review

▪ Requirements revisions or clarifications requested as part of this review

Location: Presentation Format: Narrative

AF PM

2 Provide a list of Entrance Criteria with mapping.

The list shall include the following:

▪ Identification of all approved Entrance Criteria for this review

▪ Acceptable location and format for each item listed

▪ Presentation slide or file intended to satisfy each item listed

Location: Presentation Format: Table

AF PM

2 Provide a detailed list of deviations from the approved review requirements.

The list shall include the following:

▪ All Entrance Criteria that are not satisfied by the information presented at this review

▪ Verification of prior Government approval for the deviation

Location: Presentation Format: List

AF PM

TG

TSS

2 Provide a list of all current assumptions used in the design of the system.

The list shall include, at a minimum, the following:

▪ What assumptions were made

▪ How each assumption was used

▪ Why each assumption is considered reasonable

▪ If and how each assumption will be verified

Location: Presentation Format: Table or List

TG

TSS

2 Provide an initial System Interface Diagram.

The diagram shall identify all external systems that interface directly with the system and shall include, at a minimum, the following:

▪ Clear identification of each interfacing system (e.g. process systems, hydraulic systems, data systems, control systems, electrical power)

▪ Direction of media, information, signal, or power flow between systems

Any changes from the previous System Interface Diagram shall be clearly identified.

Location: Presentation Format: Block Diagram

TG

TSS

2 Provide an updated Site Plan.

Site Plan shall include, at a minimum, the following:

▪ The building or general work area

▪ Location of the building or area on base

▪ Location within the building or area where the work is to be performed

▪ Location and size of area required for installation

▪ Location of existing utilities relevant to the project (e.g. water, steam, natural gas, electrical conduits, high pressure air)

▪ Potential encroachment into Explosive Site Plans (ESP) or other known hazardous areas as identified by the Government

Any changes from the previous Site Plan shall be clearly identified.

Location: Presentation Format: Image with Notation

TG

TSS

TS

2 Provide a list of all expected system safety features that will be incorporated into the system.

The list shall include the following:

▪ Any safety features, components, or devices intended to protect personnel or equipment (e.g. barriers, restrictions, or interlocks)

▪ All code-required safety devices (e.g. relief valves)

If no system safety features are required, this should be clearly stated.

Location: Presentation Format: List

TG

TSS

Any required work product not provided for this review, or any work product not provided in the required state, shall have Government approval for the status of the product prior to commencing the review process.

Documentation of Government approval shall be provided, clearly identifying the associated work product(s).

Review Documentation

Design Approach

PRELIMINARY DESIGN REVIEW (PDR)

Chairperson: Decision Authority or Designee

AF Representatives: PMDC Air Force Project Manager or Designee [AF PM], PMDC Technical Advisor or Designee [PMD], Squadron/Test Group Technical Advisor or Designee [TG], TSS Asset Owner or Designee [TSS], TSDI Representative or Designee [TSDI], TSDC Representative or Designee [TSDC], TS Representative or Designee [TS], XP Representative or Designee [XP]

Entrance Criteria

Exit criteria:

Agreement that the Statement of Work defines a product that will satisfy the original Statement of Objectives.

*Meeting Minutes Signed AEDC-1683 indicating Approval

AEDC-1565 capturing Deficiencies and Action Items.

Agreement that the Statement of Work defines a product that is achievable within the estimated cost and schedule.

Agreement that the cost and schedule risks are acceptable.

Agreement that the Entrance Criteria for the next review are acceptable.

DISTRIBUTION A: Approved for public release, distribution is unlimited.

3 Provide copies of all schematics and line diagrams required to clearly depict the significant features of the intended design solution.

Schematics shall include, at a minimum, the following:

▪ All applicable design conditions

▪ Applicable code of construction

▪ Relative locations of all equipment and devices in primary flow paths

▪ Proposed external system connections

▪ All line sizes for primary flow paths

All schematics required to clearly identify the key features of the proposed solution shall be provided in the Preliminary or later state. Any additional reference schematics or schematics for auxilliary systems may be provided in the Draft or later state.

Location: Presentation Format: Image with Notation

Location: Review Folder Format: PDF

TG

TSS

TSDI

3 Provide drawings, sketches, or model images required to clearly depict the intended design solution.

Images shall be sufficient to completely identify the following:

▪ General arrangement of the system

▪ Intended installation location of each portion of the system

▪ How the system will fit into the available area

The images shall include, at a minimum, the following:

▪ General locations of expected control devices (e.g. control valves or flow restrictions)

▪ General locations of expected flow measurement devices (e.g. flow meters or orifices)

▪ General locations of expected configuration devices (e.g. primary isolation valves)

▪ General locations of expected electrical equipment (e.g. breakers or disconnects)

▪ General locations of expected supports and support structures

▪ Detailed locations, including dimensions to building walls, column lines, test cells, or other existing references, of all expected major equipment (e.g. pumps, heat exchangers, switchgears, transformers, or test equipment)

Detailed material callouts for minor components (e.g. fittings or connections) and specific system details showing the location and configuration of maintenance and operations features that do not directly affect the system's ability to satisfy the stated requirements (e.g. high point vents, low point drains, instrumentation lines, or electrical outlets, are not expected at this review.

All drawings required to clearly identify the proposed solution shall be provided in the Preliminary or later state. Any additional reference drawings or drawings for auxilliary systems may be provided in the Draft or later state.

Location: Presentation Format: Image with Notation

Location: Review Folder Format: PDF

TG

TSS

TSDI

TSDC

3 Provide any additional design details for the intended design solution known at the time of this review.

Information may include the following:

▪ Line sizes and materials

▪ Fabrication materials

▪ Methods of fabrication (e.g. welded, socket welded, or threaded)

▪ Detailed dimensions

▪ Complete material callouts

▪ Weld types and sizes

Location: Presentation Format: As Required

TG

TSS

3 Provide an initial list of ID&C I/O parameters required to accomodate all controls and instrumentation based on the provided schematics.

For each I/O parameter, the list shall identify, at a minimum, the following:

▪ Device type (e.g. flow meter, control valve, or pressure transmitter)

▪ Device name as shown on the schematic

▪ The purpose of the I/O point

▪ Which instrumentation and controls are local only

▪ Which control room or control system will be associated with all remaining instrumentation and controls

▪ Control and feedback signal types for all controls

Location: Presentation Format: Table

TG

TSS

TSDI

4 Provide a draft narrative describing the high-level control methodology for the proposed system.

Control methodology shall identify, at a minimum, the following:

▪ Control methodology for specific valves or equipment (e.g. manual or automatic)

▪ Instrumentation for automated control

▪ Permissives or safety interlocks

Location: Review Folder Format: PDF

TG

TSS

TSDI

Electrical & Power

Provide an initial list of electrical and power requirements for the system based on the provided schematics.

The list shall contain, but not be limited to, the following:

▪ Identification of all powered equipment (e.g. heaters, pump motors, valve actuator motors, lights, speakers, or building utilities)

▪ Estimated Voltage and amperage requirements for each piece of powered equipment

Location: Presentation Format: Table

TG

TSS

TSDI

4 Provide sufficient analysis to justify that the proposed design solution is generally viable and capable of satisfying the established requirements.

Analysis shall include, at a minimum, the following:

▪ Line or cable sizing for main process lines

▪ Basic component sizing and selection

▪ Major equipment sizing

▪ Preliminary stress analysis

All analysis shall be provided as a complete report, including a clear and concise conclusion.

All analysis required to justify the proposed design solution shall be in the Preliminary or later state. Additional analysis provided for information only may be in the Draft state.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

TG

TSS

4 Provide sufficient structural analysis or evaluation to justify that the proposed design solution will not negatively affect existing buildings, structures, or foundations.

Analysis or evaluation shall include, at a minimum, the following:

▪ Code of construction for each building, structure, or foundation

▪ Existing loads

▪ Currently anticipated additional loading as a result of the proposed solution.

All analysis shall be provided as a complete report, including a clear and concise conclusion.

Structural analysis shall be provided in the Preliminary or later state.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

TG

TSS

TSDC

4 Provide an initial list of all schematics and drawings that are expected to be provided as a part of the project.

List shall include all mechanical, electrical, and controls drawings. For each drawing, the list shall include, at a minimum, the following:

▪ Drawing number

▪ Drawing title

▪ Status of the drawing at the time of this review

▪ Status of the drawing recommended for the next review

Location: Presentation Format: Table

AF PM

3.10 Provide an initial list of all analysis or calculation packages that are expected to be provided as part of the project.

List shall include all mechanical, electrical, and controls analysis. For each analysis or calculation package, the list shall include, at a minimum, the following:

▪ Calculation identification number

▪ Calculation title

▪ Status of the calculation at the time of this review

▪ Status of the calculation recommended for the next review

Location: Presentation Format: Table

AF PM

Preliminary Design Documentation

Design Drawings

Instrumentation & Controls

Analysis

Design Products

DISTRIBUTION A: Approved for public release, distribution is unlimited.

4 Provide an initial Material Acquisition Strategy.

The acquisition strategy shall identify, at a minimum, the following:

▪ All expected major equipment and materials

▪ Method of procurement expected for major equipment and materials (e.g. equipment specification, data sheet, material description / bill of materials, or manufacturer partnership)

▪ All work expected to be performed by subcontractors

Commodity materials (e.g. pipe or fittings) may be addressed as a singular item as long as all procurement is expected to have the same procurement method.

Location: Presentation Format: Table

TG

TSS

4 Provide an initial list of all expected procurement documents (e.g. Statement of Work, Equipment Specification, Data Sheet, or Construction Specification) that are expected to be provided as part of the project.

For each procurement document, the list shall include, at a minimum, the following:

▪ Document number

▪ Document title

▪ Status of the document at the time of this review

▪ Status of the document recommended for the next review

Location: Presentation Format: Table

AF PM

4 Provide a list of procurement documents that will require execution, or other procurement considerations, prior to completing the Critical Design Review in order to meet the required schedule or delivery date.

For each procurement, the list shall identify, at a minimum, the following:

▪ Anticipated cost

▪ Delivery time

▪ Recommended procurement schedule

▪ Justification for early procurement

▪ Associated procurement documents (e.g. SOW, Specification, or Advanced Release BOM)

▪ Associated schematics and drawings

▪ Associated analysis and calculation reports

If there are no required early procurements, this should be clearly stated.

Location: Presentation Format: Table

TG

TSS

4 Provide copies of all procurement documentation, including all necessary supporting documentation, intended to be approved for execution as a result of this review.

Procurement documentation shall include:

▪ Procurement documents (e.g. SOW, SOO, Specification, Data Sheet, or Advanced Release BOM)

▪ All schematics or drawings associated with the listed procurement documentation

▪ All analysis or calculation reports associated with the listed procurement documentation

▪ All waivers or approvals required to execute the listed procurement documentation

All procurement documentation to be executed shall be in the Final state, all required schematics, analysis, and calculations shall be in the Approved or later state, all required drawings shall be in the Preliminary or later state, and all required waivers or approvals shall be signed and approved.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

TG

TSS

5 Provide an initial Demolition Plan.

Demolition Plan shall include, at a minimum, the following:

▪ Scope of demolition effort, including all components or structures to be removed

▪ Demolition methods and how each will be used

▪ Required equipment or machinery

▪ Summary of how the remaining existing system will be isolated or reconnected

▪ Summary of how the system or structures will be temporarily supported or stabilized

▪ Outages and permits required to perform work

▪ Issues, concerns, or limitations associated with demolition (e.g. operations, maintenance, or testing impacts)

Demolition Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE Demolition Plan is desired, the Government will provide one upon request.

TSS

5 Provide an initial Manufacturing Plan.

Manufacturing Plan shall include, at a minimum, the following:

▪ Fabrication activities that will be performed

▪ Which skills or crafts will be required

▪ General site plan for field fabricaton

▪ Equipment, utilities, or facilities required for fabrication

▪ Summary of inspection or testing activities required following fabrication

▪ General schedule of fabrication activities

▪ Issues, concerns, or limitations associated with fabrication (e.g. operations, maintenance, or testing impacts)

Manufacturing Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE Manufacturing Plan is desired, the Government will provide one upon request.

TSS

5 Provide an initial Installation Plan.

Installation Plan shall include, at a minimum, the following:

▪ Installation activities that will be performed

▪ Which skills or crafts will be required

▪ Equipment, utilities, or facilities required for installation

▪ Site plan for locating large equipment (e.g. cranes or lifts)

▪ Identification of any known specific safety or security considerations associated with installation

▪ Identification of other areas and services affected by expected installation outage

▪ General schedule of installation activities

▪ Issues, concerns, or limitations associated with installation (e.g. operations, maintenance, or testing impacts)

Installation Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE Installation Plan is desired, the Government will provide one upon request.

TSS

5 Provide an initial Concept of Operations.

CONOPS shall describe, at a high level, how the system is generally intended to be operated, including, at a minimum, the following:

▪ Description of the operational environment (e.g. conditions, assumptions, constraints, or limitations)

▪ Description of how the system is intended to operate, including expected operating conditions (NOT design conditions)

▪ Potential system configurations (e.g. startup, shutdown, maintenance, different users, or different sources)

▪ Lock out-tag out requirements for major equipment

The CONOPS shall account for all phases of operation, including checkout, pre-ops, operations, and post-ops.

CONOPS shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE Concept of Operations is desired, the Government will provide one upon request.

TG

TSS

6 Provide an initial Operations and Maintenance Plan.

O&M Plan shall include, at a minimum, the following:

▪ All expected routine and preventative maintenance activities

▪ Cost (labor and materials) associated with each activity

▪ Frequency that each activity is expected to be performed

▪ Estimated average yearly operating costs

▪ Recommended spare parts

Operations and Maintenance Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE O&M Plan is desired, the Government will provide one upon request.

TG

TSS

6 Provide an initial Failure Modes and Effects Analysis (FMEA).

The FMEA shall address, at a minimum, the following:

▪ Identify all known failure modes that could result in a non-functional system

▪ Assess the likelihood and impact of each failure mode

▪ Identify any mitigations that could be employed to limit the impact of each failure mode

▪ Assess the likelihood and impact of each mitigated failure mode

FMEA shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Excel Spreadsheet

If a TEMPLATE or EXAMPLE FMEA is desired, the Government will provide one upon request.

TG

TSS

Procurement Documentation

Procurement Planning

Early Procurements

Planning Documentation

Execution Planning

Operations Planning

DISTRIBUTION A: Approved for public release, distribution is unlimited.

6 Provide a Verification, Validation, and Acceptance Plan.

The VV&A Plan shall include high level information for the following:

▪ High-level identification of all verification and validation activities that will be performed as part of the project

▪ What requirement(s) in the requirements documents are associated with each verification activity

VV&A Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE VV&A Plan is desired, the Government will provide one upon request.

TG

TSS

6 Provide an initial System Test Plan.

System Test Plan shall include, but not be limited to:

▪ High-level identification of all inspection and testing activity that will be performed as part of the project (e.g. visual inspections, weld inspections, leak tests, hydrostatic pressure tests, operational checkouts, or performance tests)

▪ Identification of existing test procedures, instructions, codes, or standards

▪ Equipment expected to be required to perform each activity

▪ What activity in the VV&A Plan is associated with each inspection or test activity

The System Test Plan does not need to include verification activities that are limited to analysis or inspection of documentation.

System Test Plan shall be in the Draft or later state.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Word Document

If a TEMPLATE or EXAMPLE STP is desired, the Government will provide one upon request.

TG

TSS

6 Provide mapping of verification and validation activities between the current requirements documents, the Verification, Validation, and Acceptance Plan, and the System Test Plan.

VV&A mapping shall verify, at a minimum, the following:

▪ All verification activities required by the requirements documents have been addressed in the VV&A Plan activities

▪ All verification activities listed in the VV&A Plan, except for those that only require analysis or inspection of documentation, are addressed in the System Test Plan

Location: Presentation Format: Table

TG

TSS

6 Provide an initial Gap Analysis.

Gap Analysis may include the following:

▪ Activities outside the project scope that must be completed for project success

▪ Specialized materials or storage

▪ Required utility or support infrastructure upgrades

▪ Required maintenance or repair that must be performed

Location: Presentation Format: Table or List

AF PM

6 Provide a baseline WBS-based schedule.

Schedule shall include, at a minimum, the following:

▪ Timing and duration of all design activities

▪ Timing of all required design reviews and milestones

▪ Timing and duration of all procurement activities

▪ Timing and duration of all fabrication and installation activities

▪ Timing and duration of all verification activities

▪ Timing and duration of all outages

The schedule shall be exported directly from P6 or Microsoft Project.

The schedule shall be a WBS-based resource loaded schedule to Level 3 or better.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF, 11"X17" Format

Location: Review Folder Format: Original File in Native File Format

AF PM

6 Provide a baseline WBS-based project cost estimate.

Cost estimate shall include, at a minimum, the currently anticipated cost for each of the following:

▪ Major procurements

▪ Commodity materials (e.g. pipe, fittings, wire, or cable)

▪ Expendable materials (e.g. welding rod)

▪ Imposed surcharges

▪ Design labor

▪ Fabrication labor

▪ Installation labor

▪ Verification labor

▪ Verification utilities

The cost estimate shall be a detailed estimate broken down to WBS Level 3 or better.

Location: Presentation Format: List with Link

Location: Review Folder Format: PDF or Excel Spreadsheet

AF PM

6 Provide an initial Hazard Tracking Log.

Hazard Tracking Log shall identify the following:

▪ All known hazards that could pose a threat to personnel, equipment, the environment, or operational capability

▪ System, subsystem, or component associated with the hazard

▪ Conditions or events that would cause the hazard

▪ Potential adverse effects as a result of the hazard

▪ Severity of the risks associated with the hazard

▪ Probability of the risks associated with the hazard

▪ Overall risk level associated with the hazard

▪ Potential risk reduction measures and mitigations

Location: Presentation Format: Summary Table

Location: Review Folder Format: PDF or Excel Spreadsheet

If a TEMPLATE or EXAMPLE Hazard Tracking Log is desired, the Government will provide one upon request.

TSS

7 Provide an initial Risk Assessment Matrix.

Risk Assessment shall identify the following:

▪ All known risks that could significantly affect the technical solution, project cost, or project schedule including any known funding disconnects

▪ Likelihood of each listed risk

▪ Cost or schedule impact of each listed risk

▪ Potential mitigations for each listed risk, including when the mitigation was or will be implemented

▪ Adjusted likelihood and impact of each mitigated risk

Location: Presentation Format: Summary Table

Location: Review Folder Format: PDF or Excel Spreadsheet

If a TEMPLATE or EXAMPLE Risk Assessment Matrix is desired, the Government will provide one upon request.

AF PM

TG

TSS

XP*

7 Provide all information required for a draft Environmental Impact Analysis (AF-813). Location: Presentation Format: List

AF PM

7 Provide all information required for a draft Change Request.

Change Request information shall include, at a minimum, the following:

▪ Duration and schedule of all known outages

▪ Systems or facilities affected by each outage

The formal Change Request is not required to be submitted to or approved in the CMMS for this review.

Location: Presentation Format: List

AF PM

7 Provide a list of Entrance Criteria for the next scheduled review.

The list shall include the following:

▪ All Government-identified Entrance Criteria

▪ Any deviations from the Entrance Criteria requested or recommended by the Contractor

Location: Presentation Format: Table

AF PM

TG

Work Products to be Delivered by Contractor Acceptable Format

AF

Concurrence

CRITICAL DESIGN REVIEW (CDR)

Chairperson: Decision Authority or Designee

AF Representatives: PMDC Air Force Project Manager or Designee [AF PM], PMDC Technical Advisor or Designee [PMD], Squadron/Test Group Technical Advisor or Designee [TG], TSS Asset Owner or Designee [TSS], TSDI Representative or Designee [TSDI], TSDC Representative or Designee [TSDC], TS Representative or Designee [TS], XP Representative or Designee [XP]

Entrance Criteria

Programmatic Documentation

Exit criteria:

Agreement that the proposed design solution and supporting information describes a product that will likely meet the technical requirements.

*Meeting Minutes Signed AEDC-1683 indicating Approval

AEDC-1565 capturing Deficiencies and Action Items.

Agreement that the planned verification activities will likely prove the proposed design solution satisfies the technical requirements.

Agreement that the proposed design solution and supporting information defines a product that is likely achievable within the defined cost and schedule.

Agreement the technical performance, cost and schedule risks for the effort are likely acceptable.

Agreement that the Entrance Criteria for the next review are acceptable.

Verification Planning

DISTRIBUTION A: Approved for public release, distribution is unlimited.

1 Provide a Comments Log for this review.

Comments Log shall include, at a minimum, the following:

▪ All reviewer provided comments

▪ Resolution or disposition for each comment

▪ Status of reviewer concurrance for each comment

Location: Review Folder Format: Excel Spreadsheet

If a TEMPLATE or EXAMPLE Comment Log is desired, the Government will provide one upon request.

AF PM

1 Provide an updated status for all unresolved deficiencies and action items.

Update shall include the following:

▪ Copy of the signed AEDC-1565 from the most recent previous review

▪ Updated status for all deficiencies and action items listed

AEDC-1565

Location: Review Folder Format: PDF

Status List Location: Presentation Format: Table

AF PM

TG

TSS

1 Provide a copy of all requirements documents approved for use at the time of this review.

Documents shall include, as available, the following:

▪ Statement of Objectives (SOO)

▪ Additional Requirements Identified in Contract

Requirements documents shall be provided in the approved and unaltered state. Any proposed corrections, changes, or other revisions shall be provided separately.

All approved changes to the requirements documents from the previous review shall be clearly identified.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

AF PM

1 Provide a brief project summary.

Summary shall clearly identify, at a minimum, the following:

▪ Purpose of the project

▪ Scope of the project

▪ Approvals requested as part of this review

▪ Waivers or deviations requested as part of this review

▪ Scope changes or clarifications requested as part of this review

▪ Requirements revisions or clarifications requested as part of this review

Location: Presentation Format: Narrative

AF PM

2 Provide a list of Entrance Criteria with mapping.

The list shall include the following:

▪ Identification of all approved Entrance Criteria for this review

▪ Acceptable location and format for each item listed

▪ Presentation slide or file intended to satisfy each item listed

Location: Presentation Format: Table

AF PM

2 Provide a detailed list of deviations from the approved review requirements.

The list shall include the following:

▪ All Entrance Criteria that are not satisfied by the information presented at this review

▪ Verification of prior Government approval for the deviation

Location: Presentation Format: List

AF PM

TG

TSS

2 Provide a detailed summary of any significant design changes from the previous review.

Significant design changes shall include, but are not limited to, changes to the following:

▪ General configuration

▪ Installation location

▪ Overall size

▪ Fabrication method

▪ Materials

▪ Structural loads

▪ Major equipment

Changes resulting in a significant increase in project cost or schedule shall be clearly identified.

Location: Presentation Format: List

TG

TSS

2 Provide a complete list of all assumptions used in the design of the system.

The list shall include, at a minimum, the following:

▪ What assumptions were made

▪ How each assumption was used

▪ Why each assumption is considered reasonable

▪ How each assumption will be verified

All changes from the previous review shall be clearly identified. If there are no changes from the previous review, this shall be clearly stated.

Location: Presentation Format: Table or List

TG

TSS

2 Provide a final System Interface Diagram.

The diagram shall identify all external systems that interface directly with the proposed system and shall include, at a minimum, the following:

▪ Clear identification of each interfacing system (e.g. process systems, hydraulic systems, data systems, control systems, electrical power)

▪ Direction of media, information, signal, or power flow between systems

Any changes from the previous System Interface Diagram shall be clearly identified.

Location: Presentation Format: Block Diagram

TG

TSS

2 Provide a final Site Plan.

Site Plan shall include, at a minimum, the following:

▪ The building or general work area

▪ Location of the building or area on base

▪ Location within the building or area where the work is to be performed

▪ Location and size of area required for installation

▪ Location of existing utilities relevant to the project (e.g. water, steam, natural gas, electrical conduits, high pressure air)

▪ Potential encroachment into Explosive Site Plans (ESP) or other known hazardous areas as identified by the Government

▪ Location and size of recommended laydown areas

▪ Location and size of areas reserved for trailers, storage, or other structures

▪ Location and size of areas reserved for temporary facilities (e.g. restrooms or break rooms)

▪ Location and size of areas reserved for large equipment (e.g. cranes)

Any changes from the previous Site Plan shall be clearly identified.

Location: Presentation Format: Image with Notation

TG

TSS

TS

3 Provide a complete list of all expected system safety features that will be incorporated into the system.

The list shall include the following:

▪ All safety features, components, or devices intended to protect personnel or equipment

▪ All code-required safety devices (e.g. relief valves)

If no system safety features are required, this should be clearly stated.

All changes from the previous review shall be clearly identified. If there are no changes from the previous review, this shall be clearly stated.

Location: Presentation Format: List

TG

TSS

3 Provide copies of all listed schematics.

Schematics shall include, at a minimum, the following:

▪ All applicable design conditions

▪ Applicable code of construction

▪ Complete device list

▪ Manufacturer and model number or the associated procurement documentation for each device listed

▪ Relative locations of all equipment and devices

▪ All external system connections

▪ All line sizes and materials

▪ Operating notes or operating limitations

All device identification numbers shall be as provided by the Government to be in compliance with T-3 and coordinated with the device log.

Schematics shall be in the Approved state.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

TG

TSS

TSDI

Any required work product not provided for this review, or any work product not provided in the required state, shall have Government approval for the status of the product prior to commencing the review process.

Documentation of Government approval shall be provided, clearly identifying the associated work product(s).

Review Documentation

Design Approach

DISTRIBUTION A: Approved for public release, distribution is unlimited.

3 Provide copies of all listed drawings.

Drawings shall include, at a minimum, the following:

▪ All applicable design conditions and loads

▪ Applicable code of construction

▪ Complete and detailed identification for all components identified on the drawing in the form of a Bill of Materials

▪ All fabrication or assembly details required to properly fabricate and/or install the system or component

▪ All dimensions required to properly fabricate and/or install the system or component

▪ All weld types and sizes required to properly fabricate and/or install the system or component, including the associated inspection or testing

▪ Total fabricated weight for any component, weldment, or assembly that will require rigging for lifting

▪ Notes or instructions required to properly fabricate and/or install the system or component, including applicable target bolt torque values for flanged connections

Drawings shall be in the Approved state.

Location: Presentation Format: List with Links

Location: Review Folder Format: PDF

TG

TSS

TSDI

TSDC

3 Provide a complete list of ID&C I/O parameters required to accomodate all controls and instrumentation based on the provided schematics.

For each I/O parameter, the list shall identify, at a minimum, the following:

▪ Device type (e.g. flow meter, control valve, or pressure transmitter)

▪ Device name as shown on the schematic

▪ The purpose of the I/O point

▪ Which instrumentation and controls are local only

▪ Which control room or control system will be associated with all remaining instrumentation and controls

▪ Control and feedback signal types for all controls

All changes from the previous review shall be clearly identified. If there are no changes from the previous review, this shall be clearly stated.

Location: Presentation Format: Table

TG

TSS

TSDI

3 Provide a complete narrative describing, in detail, the control methodology for the system.

Control methodology shall identify, at a minimum, the following:

▪ All devices, by name, to be controlled

▪ Control methodology for each device (e.g. manual, local, or remote)

▪ Control screen for all remotely controlled devices

▪ Instrumentation, by name, required for automated control

▪ Permissives or safety interlocks

All changes from the previous review shall be clearly identified. If there are no changes from the previous review, this shall be clearly stated.

Location: Presentation Format: Narrative

TG

TSS

TSDI

Electrical & Power

Provide a complete list of electrical and power requirements for the system based on the provided schematics.

The list shall contain, but not be limited to, the following:

▪ Identification of all powered equipment (e.g. heaters, pump motors, valve actuator motors, lights, speakers, or building utilities)

▪ Voltage and amperage requirements for each piece of powered equipment

▪ Power sources for each piece of powered equipment

▪ Additional equipment or infrastructure required to accomodate power requirements

All changes from the previous review shall be clearly identified. If there are no changes from the previous review, this shall be clearly stated.

Location: Presentation Format: Table

TG

TSS

TSDI

Analysis

Provide copies of all listed analysis packages.

Analysis packages shall include mechanical, structural, and electrical analysis and shall be sufficient to justify, at a minimum, the following:

▪ Design, as shown on the provided drawings, is viable and capable of satisfying the established requirements

▪ Design, as shown on the provided drawings, is in compliance with applicable codes and standards

▪ All components and materials shown on the drawings are suitable for use in the system

▪ Design, as shown on the provided drawings, will not negatively affect existing buildings, structures, or foundations

▪ All new buildings, structures, and foundations are suitable for use with the system

All analysis shall be provided as a complete report,…