J-5_20130418_DoD_PRR_CheckList.xls
XLS spreadsheet 533 KB Posted
- Attached to
- SEWIP Block 2 FY16-FY20 Full Rate Production
- Solicitation number
- N00024-16-R-5363
About this file
N00024-16-R-5363 Attachment J-5
View the file
Other files
Show all 32
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
PRR
| “Systems Engineering for Mission Success” | ||
| Production Readiness Review | Name of the program being reviewed / date | |
| Program Risk Assessment Checklist (27 September 2010) | ||
| OVERVIEW: Although the checklist can be printed and completed as a "hard copy", it is designed to be completed electronically as an Excel spreadsheet. When viewed electronically, the small number buttons in the upper left corner of the screen are used to select the level of indenture for the questions in the checklist. A left mouse click on a number button will expand or collapse the entire checklist to the desired level. A left click on the "+" or "-" symbols in the left margin of the spreadsheet will expand or collapse the level of indenture for that section. The buttons in Row 11 run specific macros. The buttons in Column A allow a user to designate and sort specific questions as "Special Interest" (i.e., High Priority, Flagged, Question). The colored buttons in Row 11, Column C allow the user to sort questions by Technical Discipline, to provide a Level 1 roll-up of the risk characters assigned, or to hide specific information. For example selecting the "Logistics" button results in the display of all Level 1 Logistics-related questions, and assigned information. All other questions will be hidden. |
COMPLETING THE CHECKLIST:
1. In the upper right corner of the checklist, enter the name of the program being reviewed, the date(s) of the review, along with the name, code and technical specialty of the person(s) completing the checklist.
2. A "Risk Character" (i.e., R / Y / G / U / NA) should be assigned for each question by direct entry or left clicking in each box to activate the "drop down" menu. The assigned Risk Characters will automatically total and display in the Level 1 (and Level 2, as applicable) row(s). Selection of a summary tab (Excel "Sheet") at the bottom of the checklist will provide a summary of all questions assigned a particular risk character (e.g., selecting the RED tab will display all questions assigned a RED risk character).
3. Any question requiring further attention (Special Interest) should be similarly marked in Column A as "High Priority", "Flagged", or "Question" to facilitate follow-up.
4. Narrative, amplifying, and / or mitigation information should be entered in the "Comments Mitigation" box (Column J) at the right of each question.
| Name / Code / Technical Specialty of reviewer | |||||||||||
| High Priority | |||||||||||
| SAVING THE CHECKLIST: Save the completed checklist in a new file with a unique name such as "UAV FRR 8Feb07ajo". | Flagged | ||||||||||
| Risk Character | |||||||||||
| R = Red, Y = Yellow, G = Green, U = Unknown / Unavailable, NA = Not Applicable | |||||||||||
| Special | |||||||||||
| Interest | Technical Discipline | Legend: | R | Y | G | U | NA | Item | Comments / Mitigation | ||
| Level 1, logistics, programmatic, PQM, risk, technology, software, T&E | 1. Engineering and Product Design | 0 | 0 | 0 | 0 | 0 | 1 | ||||
| logistics, programmatic, PQM, risk, technology, software, T&E | Technical Documentation, Systems Integration, and Coordination | The criteria contained herein have been developed for use by team members during the on-site review to provide a basis for assuring an objective assessment of contractor readiness for production. They are not just “yes” or “no” questions to be the course of the on-site review. Subsequent to the pre-PRR meeting (when required) and prior to the on-site review, functional area leaders, with assistance of team members, should “fine tune” and tailor the list of criteria to the contractor’s development program. During the course of the PRR, team members should annotate the list of criteria for later use as an aid in preparing action items and the functional area evaluation. These are to be completed prior to departing the on-site location. | |||||||||
| logistics, PQM, PQM, software | a. Technical Documentation, Systems Integration, and Coordination | 0 | 0 | 0 | 0 | 0 | 1.a | ||||
| logistics, software | (1) Are the contractor’s engineering drawings and documents complete for describing the equipment and the applicable software to be delivered under this program? | 1.a(1) | |||||||||
| logistics | (2) Are there provisions to assure that obsolete drawings are removed and discarded? | 1.a(2) | |||||||||
| logistics | (3) Are there procedures to assure that all engineering drawings are consistently prepared and that all revisions and Class I engineering changes are incorporated into the drawings? | 1.a(3) | |||||||||
| logistics | (4) Is there an effective system for managing standards such as drawings, engineering changes, and specifications? | 1.a(4) | |||||||||
| logistics | (5) Are incorporated changes identified on the contractor’s inspection records? | 1.a(5) | |||||||||
| logistics, PQM | (6) Are the engineering drawings and specifications complete and descriptive for production purposes? | 1.a(6) | |||||||||
| logistics, PQM | (7) Are critical characteristics identified for all critical safety items? | 1.a(7) | |||||||||
| logistics | (8) Are copies of drawings provided to the appropriate inventory control point? | 1.a(8) | |||||||||
| software | (9) Is the software documentation complete and have the appropriate data rights been secured? | 1.a(9) | |||||||||
| logistics, software, PQM | b. Status of System Integration | 0 | 0 | 0 | 0 | 0 | 1.b | ||||
| logistics | (1) Are the functional responsibilities of all disciplines adequately documented in contracts, Memoranda of Agreements (MOA), and Interface Control Documents (ICD)? | 1.b(1) | |||||||||
| logistics | (2) Have the interface responsibilities of the contractor and the government been described for all Government Furnished Equipment (GFE)? | 1.b(2) | |||||||||
| logistics, software, PQM | (3) Have the physical, functional, and performance characteristics for all parts and assemblies been described, and the product baseline established as a result of functional and physical configuration audits? | 1.b(3) | |||||||||
| logistics, software, PQM | (4) Have all problems encountered during Engineering and Manufacturing Development (EMD)), production, and testing of the Engineering Development Model (EDM) been resolved and corrective action implemented? | 1.b(4) | |||||||||
| logistics, software, PQM | (5) Are procedures in place for the identification, reporting, analysis and corrective action for system integration problems? | 1.b(5) | |||||||||
| logistics, PQM | (6) Are procedures in place to assure that the complete system, including all parts and assemblies, conform to all required design specifications such as performance, reliability, cost, and life-cycle? | 1.b(6) | |||||||||
| logistics | (7) Do the documented procedures assure that the system meets system safety engineering objectives? | 1.b(7) | |||||||||
| logistics, software | (8) Is the contractor’s system integration organization staffed with qualified personnel? | 1.b(8) | |||||||||
| logistics | (9) Have the designs of all parts and assemblies been included in a coordinated system integration effort? | 1.b(9) | |||||||||
| logistics, programmatic, PQM, risk, technology, software, T&E | c. Concurrent Engineering | 0 | 0 | 0 | 0 | 0 | 1.c | ||||
| logistics | (1) Do the manufacturing and engineering organizations review engineering changes to determine work center performance? | 1.c(1) | |||||||||
| programmatic, logistics | (2) Does the contractor utilize a Computer Aided Design (CAD) system in development and transition from development to production? | 1.c(2) | |||||||||
| programmatic, logistics | (3) Does corporate policy define CAD as an integral part of an overall factory modernization program? | 1.c(3) | |||||||||
| programmatic, logistics | (4) Is CAD integrated with Computer Aided Manufacturing (CAM) on a common database containing parts and materials information as well as design engineering information? | 1.c(4) | |||||||||
| programmatic, logistics, PQM, technology | (5) Does the manufacturing organization meet with design engineers to discuss the latest developments in manufacturing technology? | 1.c(5) | |||||||||
| T&E, software, logistics, programmatic | (6) Do the test activities (hardware and software) interface with all other functional disciplines? | 1.c(6) | |||||||||
| T&E, logistics, software, PQM | (7) Is there coordination among design, test, and production organizations to assure compliance with cost, schedule and performance parameters? | 1.c(7) | |||||||||
| logistics, PQM | (8) Are deficiency data sent to engineering and manufacturing by quality assurance to assure implementation of corrective action? | 1.c(8) | |||||||||
| logistics | (9) Is there a system that provides for an adjustment for material on order in the event of order changes? | 1.c(9) | |||||||||
| logistics, PQM | (10) Are design drawings and specifications reviewed for producibility by the manufacturing organization? | 1.c(10) | |||||||||
| technology, risk | (11) Have there been trade studies conducted by the various functional disciplines in order to enhance the high-risk advanced technology components or systems? | 1.c(11) | |||||||||
| PQM, risk | (12) Are procedures in place to identify potential production problems to management for analysis and corrective action? | 1.c(12) | |||||||||
| logistics, PQM | (13) Are procedures in place to assure follow-up action on problems and corrective action? | 1.c(13) | |||||||||
| logistics, programmatic, software | (14) Is there coordination of proposed engineering changes with all functional disciplines prior to approval? | 1.c(14) | |||||||||
| logistics | (15) Are procedures in place to assure that the contractor has the dedicated resources including personnel, facilities, materials and tools to support this program? | 1.c(15) | |||||||||
| programmatic, T&E, PQM, logistics, software, risk, | d. Engineering and Product Design | 0 | 0 | 0 | 0 | 0 | 1.d | ||||
| T&E | (1) Have testability, maintainability, and supportability requirements been defined and adequately considered in the final design? | 1.d(1) | |||||||||
| T&E | (2) Does Reliability and Maintainability (R&M) test data indicate all testing is complete and all objectives have been achieved? | 1.d(2) | |||||||||
| logistics | (3) Do the reliability growth plot(s) for all major assemblies indicate good growth and achievement of specified performance requirements? | 1.d(3) | |||||||||
| logistics, risk, software, PQM | (4) Does failure and yield data indicate that an operational failure reporting and corrective action system is in place that documents all failures and identifies that effective corrective actions have been implemented a timely manner? | 1.d(4) | |||||||||
| logistics, PQM | (5) Is the incoming parts screening program effective in keeping defective parts out of the manufacturing cycle? | 1.d(5) | |||||||||
| programmatic, logistics, PQM | (6) Does the manufacturing screening program use Environmental Stress Screening (ESS) e.g., thermal cycling and random vibration at all levels i.e., Module, Shop Replaceable Assembly (SRA), Weapon Replacement Assembly (WRA), and System to eliminate latent defects and workmanship problems from the equipment during the manufacturing process prior to final acceptance by the Government? | 1.d(6) | |||||||||
| programmatic, logistics | (7) Where required, have provisions for Unique Identification (UID) of parts been incorporated? | 1.d(7) | |||||||||
| T&E, logistics, software | e. Contractor Test Policy and Procedure Documentation | 0 | 0 | 0 | 0 | 0 | 1.e | ||||
| T&E, software | (1) Do the contractor’s test policies define the scheduling, test methods, resource utilization, and reporting procedures for each test relative to the design of this system? | 1.e(1) | |||||||||
| T&E | (2) Has the contractor identified any planned tests where policies and procedures have not been documented? | 1.e(2) | |||||||||
| T&E | (3) Are the contractor’s testing policies and procedures for test methods updated as revisions and changes are approved? | 1.e(3) | |||||||||
| T&E, software | (4) Do the contractor’s policies and procedures assure that hardware and software test activities are coordinated with all other functional disciplines to assure compatibility of objectives? | 1.e(4) | |||||||||
| T&E | (5) Does the contractor’s test policy identify all responsible groups and specific individuals necessary to implement a test and evaluation program for the system being reviewed? | 1.e(5) | |||||||||
| T&E, software | (6) Do corporate policies describe the authority and accountability of the organization responsible for the implementation of a controlled test program? | 1.e(6) | |||||||||
| T&E, logistics, software | (7) Are procedures in place for incorporating changes resulting from analysis of test results into the design requirements and processes? | 1.e(7) | |||||||||
| T&E | (8) Does the contractor address the excessive lead times required for the scheduling of Test and Evaluation (T&E) services? | 1.e(8) | |||||||||
| T&E | (9) Are procedures in place for monitoring the progress of test programs in order to eliminate redundant testing where possible? | 1.e(9) | |||||||||
| T&E, PQM | f. Validity and Reliability of Test Programs | 0 | 0 | 0 | 0 | 0 | 1.f | ||||
| T&E | (1) Is the contractor’s integrated test program structured around a philosophy of Test, Analyze, And Fix (TAAF) from component to complete system? | 1.f(1) | |||||||||
| software | (a) Is the contractor's integrated test program structured around an industry-accepted software corrective action program? | 1.f(1)(a) | |||||||||
| T&E, PQM | (2) Are tests conducted on critical safety items at subcontractor facilities witnessed by the prime contractor? | 1.f(2) | |||||||||
| T&E, software | (3) Has the test program been coordinated among all other functional groups? | 1.f(3) | |||||||||
| T&E | (4) Is the T&E program structured to provide reliable data relative to there operational requirements of this system? | 1.f(4) | |||||||||
| T&E, software | (5) Are the engineering development tests capable of attaining the desired design goals? | 1.f(5) | |||||||||
| T&E, logistics, software, PQM | g. Testing - Planned, Completed, and Analyzed | 0 | 0 | 0 | 0 | 0 | 1.g | ||||
| T&E | (1) Has the testing to date shown a lack of capability that could lead to a restructuring of the test program? | 1.g(1) | |||||||||
| T&E | (2) Does the contractor’s test plan support the total test program by identifying other resources such as test articles, user support, test sites and ranges, targets, instrumentation, and support equipment? | 1.g(2) | |||||||||
| T&E, software | (3) Are changes to test plans and procedures controlled and approved by management? | 1.g(3) | |||||||||
| T&E | (4) Does the Nondestructive Test (NDT) Plan describe how materials and parts will be classified; how design requirements will be identified; how NDT methods will be selected; and how NDT specifications and procedures will be prepared and implemented? | 1.g(4) | |||||||||
| T&E | (5) Does the NDT Plan address the handling of fatigue, fracture, and operationally critical components? | 1.g(5) | |||||||||
| T&E | (6) Does the Nondestructive Inspection (NDI) Plan thoroughly describe how significant items will be selected; how critical flaw size and orientation will be established; how inspection intervals are determined; and how techniques are developed, validated and documented? | 1.g(6) | |||||||||
| T&E, software | (7) Does the T&E program provide all of the physical testing, experimentation, and analyses performed during the Research and Development (R&D) of the system? | 1.g(7) | |||||||||
| T&E | (8) Was development testing useful in solving problems necessary to achieve program objectives prior to production? | 1.g(8) | |||||||||
| T&E | (9) Is the T&E program structured to development objectives, acquisition milestones and system operation? | 1.g(9) | |||||||||
| T&E, logistics, software | (10) Is the logistic support T&E program phased in with the integrated hardware and software system test and evaluation plan? | 1.g(10) | |||||||||
| T&E | (11) Does the T&E program meet the contract requirements for the system and components? | 1.g(11) | |||||||||
| T&E, PQM | (12) Is qualification testing planned to support design limit / life testing during the system demonstration? | 1.g(12) | |||||||||
| T&E | h. Contingency Test Alternatives | 0 | 0 | 0 | 0 | 0 | 1.h | ||||
| T&E | (1) Are specific contingency test plans available that describe schedules and resources for near term Development Test and Evaluation (DT&E) as well as Initial Operational Test and Evaluation (IOT&E)? | 1.h(1) | |||||||||
| T&E | (2) Are the test resources and schedule flexible to add additional tests if necessary? | 1.h(2) | |||||||||
| T&E | (3) Does the contractor’s destructive testing plan provide for back-up test articles if necessary? | 1.h(3) | |||||||||
| T&E | (4) Are procedures in place for re-inspection and test of end items that fail initial inspection and test? | 1.h(4) | |||||||||
| logistics, PQM, technology | i. Material Properties Requirements | 0 | 0 | 0 | 0 | 0 | 1.i | ||||
| logistics, PQM, technology | (1) Have all required material properties necessary to meet the design requirements been considered during the material selection process? | 1.i(1) | |||||||||
| logistics, PQM, technology | (2) Were design modifications considered where required material properties would indicate the need for high cost, limited quantity exotic materials? | 1.i(2) | |||||||||
| logistics, technology | (3) Were considerations given in the material selection process of corrosion caused by adjoining dissimilar materials? | 1.i(3) | |||||||||
| logistics, PQM, technology | (4) Were material properties considered to assure proper bonding where required? | 1.i(4) | |||||||||
| Level 1, software, programmatic, PQM, logistics, T&E, technology, risk | 2. Materials and Purchased Parts | 0 | 0 | 0 | 0 | 0 | 2 | ||||
| programmatic, logistics, PQM | a. Contractor Make / Buy Decision | 0 | 0 | 0 | 0 | 0 | 2.a | ||||
| programmatic, logistics, PQM | (1) What is the involvement of all appropriate functional areas such as engineering, manufacturing, quality assurance, procurement, contracts, and pricing in the make / buy decision? | 2.a(1) | |||||||||
| programmatic, logistics | (2) What is the Program Manager's role in make / buy decisions? | 2.a(2) | |||||||||
| programmatic, logistics, T&E, PQM | b. Contractor Make / Buy and Procedure Documentation | 0 | 0 | 0 | 0 | 0 | 2.b | ||||
| programmatic, logistics, PQM | (1) How do the policies and procedures identify the use of corporate components, subsidiaries, and affiliates for the inter-company transfer of work? | 2.b(1) | |||||||||
| programmatic, logistics | (2) What evidence shows the make / buy program is in compliance with the Federal Acquisition Regulation (FAR)? | 2.b(2) | |||||||||
| programmatic, logistics | (3) What procedures govern items to be excluded from make / buy consideration? | 2.b(3) | |||||||||
| programmatic, logistics, PQM | (4) What procedures are used for revision of make / buy decisions based upon changes in engineering, manufacturing, or the availability of qualified subcontractors? | 2.b(4) | |||||||||
| programmatic, logistics, T&E, PQM | (5) What procedures govern make / buy decisions for test equipment and tooling? | 2.b(5) | |||||||||
| programmatic, logistics, PQM | c. Make / Buy Trade-Off Analyses and Decisions | 0 | 0 | 0 | 0 | 0 | 2.c | ||||
| programmatic, logistics | (1) How has the make cost versus the buy cost affected the make / buy decision? | 2.c(1) | |||||||||
| programmatic, logistics | (2) How has plant capacity affected the make / buy decision? | 2.c(2) | |||||||||
| programmatic, logistics | (3) How has workload affected the make / buy decision? | 2.c(3) | |||||||||
| programmatic, logistics, PQM | (4) How has impact on production schedules affected the make / buy decision? | 2.c(4) | |||||||||
| programmatic, logistics | (5) How has special tooling requirements affected the make / buy decision? | 2.c(5) | |||||||||
| programmatic, logistics | (6) How has technical experience affected the make / buy decision? | 2.c(6) | |||||||||
| programmatic, logistics | (7) How has the use of Government-owned facilities affected the make / buy decision? | 2.c(7) | |||||||||
| programmatic, logistics | (8) How has the availability of qualified subcontractors affected the make / buy decision? | 2.c(8) | |||||||||
| programmatic, logistics | (9) How are make / buy analyses traced to the Work Breakdown Structure (WBS) for all systems / subsystems / components to be produced? | 2.c(9) | |||||||||
| programmatic, logistics | (10) How have production lot sizes affected the economic value in the procurement process? | 2.c(10) | |||||||||
| programmatic, logistics, software | d. Contractor Procurement Organization | 0 | 0 | 0 | 0 | 0 | 2.d | ||||
| programmatic, logistics | (1) How is the procurement organization staffed from pre-award selection through production, and what are the established lines of responsibilities and authority for subcontract's management personnel? | 2.d(1) | |||||||||
| programmatic, logistics, software | (2) How does the procurement organization interface with other functional areas such as program management, hardware and software engineering, manufacturing, and quality assurance for material and service acquisition including pre-award surveys? | 2.d(2) | |||||||||
| programmatic, logistics | (3) How are experienced personnel resources in the procurement organization going to administer this program? | 2.d(3) | |||||||||
| programmatic, logistics, PQM, technology, risk, software | e. Contractor Procurement Policy and Procedure Documentation | 0 | 0 | 0 | 0 | 0 | 2.e | ||||
| programmatic, logistics | (1) What procedures ensure that procurement policies are current and understood by all personnel in acquisition management? | 2.e(1) | |||||||||
| programmatic, logistics, PQM | (2) How do internal audits identify acquisition system deficiencies and ensure prompt corrective actions? | 2.e(2) | |||||||||
| programmatic, logistics, technology, risk, software | (3) What are the procedures for the review of designs, drawings, and specifications of subcontracted items such as hardware, computer software, technical data, and identified high-risk subsystems? | 2.e(3) | |||||||||
| programmatic, logistics, software | (4) What is the source selection process for subcontractors providing software products, and were the contract software organization maturity requirements (i.e., Capability Maturity Model (CMM) or Capability Maturity Model Integration (CMMI) level 3) considered during source selection? | 2.e(4) | |||||||||
| programmatic, logistics, PQM | (5) Do all functional disciplines use and provide input to the vendor rating system and vendor case history? | 2.e(5) | |||||||||
| programmatic, logistics | (6) How do procedures provide for timely preparation, review, and approval of a complete data package and / or purchase requisition? | 2.e(6) | |||||||||
| programmatic, logistics, PQM | (7) How do the procurement instructions provide for the preparation, processing, and insurance of purchase orders? | 2.e(7) | |||||||||
| programmatic, logistics, PQM | (8) Do the contractor's purchasing procedures provide for source inspection requirements? | 2.e(8) | |||||||||
| programmatic, logistics, PQM | (9) How do procurement document procedures provide for flow down of contract requirements in the purchasing documents? | 2.e(9) | |||||||||
| programmatic, logistics | (10) What procedures provide for written justification of single / sole source procurement? | 2.e(10) | |||||||||
| programmatic, logistics | (11) Do procedures allow for the justification of subcontractor's selection based on technical or risk assessment when appropriate? | 2.e(11) | |||||||||
| programmatic, logistics | (12) Are there documented procedures for cost and price analysis? | 2.e(12) | |||||||||
| programmatic, logistics | (13) What procedures assure that procurement documents are reviewed and approved by appropriate personnel before award? | 2.e(13) | |||||||||
| programmatic, logistics | (14) Is there an effective policy providing for compliance with the Small Business / Labor Surplus Area / Minority Business Enterprises subcontracting clauses? | 2.e(14) | |||||||||
| programmatic, logistics | (15) What procedure is used for establishing alternate sources for critical production items? | 2.e(15) | |||||||||
| programmatic, logistics | (16) Are there established instructions for procurement to include transportation requirements with economic routings that agree with shipment / delivery schedules? | 2.e(16) | |||||||||
| technology, programmatic, software | f. Trade-Off Analyses for Subcontractor Selection | 0 | 0 | 0 | 0 | 0 | 2.f | ||||
| technology, programmatic, software | (1) How are factors such as technical compliance, price, contract terms and conditions, management experience, and plans / schedules considered in the evaluation of supplier's proposals? | 2.f(1) | |||||||||
| technology, programmatic, software | (2) What procedure assures that a bidder's technical capabilities are carefully evaluated for items that approach the "state-of-the-art" in contract award consideration? | 2.f(2) | |||||||||
| software | (a) Will there be a Standard CMMI Appraisal Method for Process Improvement (SCAMPI) to determine maturity of the software organization prior to award for subcontracts where software is being provided? | 2.f(2)(a) | |||||||||
| programmatic | (3) How is the vendor rating system or vendor case history used as criteria in the selection of suppliers? | 2.f(3) | |||||||||
| programmatic | (4) Is subcontractor selection based in part on information gathered during the pre-award survey? | 2.f(4) | |||||||||
| programmatic | (5) Are bidder's cost estimates audited and reconciled prior to being included in the evaluation of supplier's proposals? | 2.f(5) | |||||||||
| PQM, programmatic | g. Quality of Subcontracts | 0 | 0 | 0 | 0 | 0 | 2.g | ||||
| PQM, programmatic | (1) Are the subcontractor's post-award reporting requirements are effective and compatible with the contract schedule and milestones? | 2.g(1) | |||||||||
| PQM, programmatic | (2) How is it assured that the subcontractor quality system is in compliance with the prime contract quality assurance program requirements? | 2.g(2) | |||||||||
| programmatic | (3) How are subcontracts prepared so they are legally binding and complete? | 2.g(3) | |||||||||
| PQM, programmatic | (4) How are subcontracts traceable to the prime contract and the contract WBS? | 2.g(4) | |||||||||
| PQM, programmatic | (5) Do subcontracts contain requirements for subcontractor participation in appropriate program reviews? | 2.g(5) | |||||||||
| PQM, programmatic | h. Management System for Subcontractor Control | 0 | 0 | 0 | 0 | 0 | 2.h | ||||
| programmatic | (1) How does the subcontractor system provides for control of cost reimbursement, time and material, and labor-hour subcontracts? | 2.h(1) | |||||||||
| programmatic | (2) Does the contractor assure that subcontractors maintain complete files of documents essential to performance? | 2.h(2) | |||||||||
| programmatic | (3) Is subcontractor performance verified before progress payments are allowed? | 2.h(3) | |||||||||
| programmatic | (4) Does the contractor require subcontractors to identify and record nonconformances, determine cause, implement corrective action, and provide notification of these actions to the customer? | 2.h(4) | |||||||||
| PQM, programmatic | (5) Does the contractor assure that a proper change control system is in place at subcontractor's facilities? | 2.h(5) | |||||||||
| PQM, programmatic | (6) What system is used for controlling the use of nonstandard parts? | 2.h(6) | |||||||||
| PQM, programmatic | (7) How are subcontractors required to maintain control of registered components and qualified products? | 2.h(7) | |||||||||
| PQM, programmatic | (8) How does the contractor verify subcontractor control of calibration, measuring and test equipment, and production tooling used as a media of inspection? | 2.h(8) | |||||||||
| PQM, programmatic | (9) Does the contractor exercise control over the acquisition of special tools and test equipment by subcontractors? | 2.h(9) | |||||||||
| programmatic, T&E, PQM | (10) How does the contractor verify and assure subcontractor compliance to the approved quality and engineering test programs? | 2.h(10) | |||||||||
| programmatic | (11) Does the contractor's system provide for obtaining prompt payment discounts from subcontractors? | 2.h(11) | |||||||||
| PQM, programmatic | (12) How effective is the contractor's system to assure product quality through adequate source information? | 2.h(12) | |||||||||
| programmatic | (13) Is special priority assistance processed through the contractor when requested by the subcontractor? | 2.h(13) | |||||||||
| programmatic | (14) Does the contractor assign resident subcontract managers as appropriate when required? | 2.h(14) | |||||||||
| programmatic | (15) Does the contractor provide for field representatives to support subcontract on-site requirements where resident subcontract managers are not assigned? | 2.h(15) | |||||||||
| programmatic | (16) Are subcontractors required to establish and maintain a control system to provide cost and schedule data as required by the prime contractor? | 2.h(16) | |||||||||
| programmatic | (17) What system is used for tracking and managing Government and company owned facilities, tools or equipment furnished to subcontractors? | 2.h(17) | |||||||||
| programmatic | i. Contractor Material Management Documentation | 0 | 0 | 0 | 0 | 0 | 2.i | ||||
| programmatic | (1) What is the contractor's inventory control system for assets to meet schedule? | 2.i(1) | |||||||||
| programmatic | (2) Is there a segregation of Government owned material from contractor owned material? | 2.i(2) | |||||||||
| programmatic | (3) What procedure is used for segregating material dedicated to this program from material intended for other programs? | 2.i(3) | |||||||||
| programmatic | (4) Does the contractor provide for the preservation and inspection of property in storage to assure protection and maintain critical environments? | 2.i(4) | |||||||||
| programmatic | (5) What assures physical inventories are conducted in accordance with contractual requirements? | 2.i(5) | |||||||||
| programmatic | (6) How is it assured that materials issued from stores do not exceed work-in-process requirements? | 2.i(6) | |||||||||
| programmatic | (7) What is the procedure for the transfer or disposal of property? | 2.i(7) | |||||||||
| programmatic | (8) Does the contractor maintain accurate scrap and salvage records? | 2.i(8) | |||||||||
| programmatic | (9) How does the contractor assure the safeguarding of Government property? | 2.i(9) | |||||||||
| programmatic | (10) Is the contractor able to account for the return of reusable containers? | 2.i(10) | |||||||||
| programmatic | (11) How does the contractor maintain control and protect precious metals? | 2.i(11) | |||||||||
| programmatic, risk | (12) Does the contractor maintain absolute control, including identification, handling, storage, and shipping of flammable or hazardous materials? | 2.i(12) | |||||||||
| programmatic | (13) What procedure is used for controlling sensitive or classified material? | 2.i(13) | |||||||||
| programmatic | (14) Are commercial freight bills reviewed to assure that proper charges are assessed? | 2.i(14) | |||||||||
| programmatic | (15) Does the contractor have a system that authorizes advance procurement of long lead-time materials? | 2.i(15) | |||||||||
| programmatic | (16) What is the system to assure that material handling for planned production correlates with planned workflow and schedules? | 2.i(16) | |||||||||
| programmatic | (17) What method identifies shortages and deficiencies and initiates prompt corrective action? | 2.i(17) | |||||||||
| programmatic | (18) What system identifies handling and transportation deficiencies and formulates corrective actions? | 2.i(18) | |||||||||
| Level 1, T&E, risk, training, programmatic, PQM | 3. Industrial Resources | 0 | 0 | 0 | 0 | 0 | 3 | ||||
| programmatic, PQM, T&E | a. Policies and Procedures for Facilities and Equipment Selection | 0 | 0 | 0 | 0 | 0 | 3.a | ||||
| programmatic | (1) What are the procedures for using labor standards when developing facilities and equipment requirements? | 3.a(1) | |||||||||
| programmatic | (2) What analyses have been conducted to determine facilities and equipment requirements? | 3.a(2) | |||||||||
| programmatic | (3) How does the facilities management system respond to the needs and priorities of this program? | 3.a(3) | |||||||||
| programmatic | (4) What facilities constraints are identified in program documentation and does the preferred system concept address these constraints? | 3.a(4) | |||||||||
| programmatic | (5) What safety, health, and environmental standards are considered in the analysis for facilities and equipment selection? | 3.a(5) | |||||||||
| programmatic | (6) How consistent is your facilities and equipment modernization plan with program requirements and how will the impact to current facilities be determined? | 3.a(6) | |||||||||
| programmatic, PQM, T&E | (7) How have facilities and equipment planning been coordinated with all other functions, such as production, tooling and test, manpower, and etc? | 3.a(7) | |||||||||
| programmatic | (8) Does the Product Support Plan (PSP) include analysis conducted to determine facility requirements? | 3.a(8) | |||||||||
| programmatic | (9) Have Military Construction (MILCON) requirements been identified in the Logistics Requirements and Funding Summary (LRFS)? | 3.a(9) | |||||||||
| programmatic | (10) Does the facilities requirements identification schedule support MILCON lead times? | 3.a(10) | |||||||||
| programmatic | (11) Is the a Facility Requirement Document (FRD) developed? | 3.a(11) | |||||||||
| programmatic | (12) Is there a schedule to conduct site surveys for all known facilities? | 3.a(12) | |||||||||
| programmatic | (13) Have integration issues been considered in the analysis of the preferred system concept? | 3.a(13) | |||||||||
| programmatic | (14) Were security and classification considerations (i.e., storage and handling of classified material and equipment) part of the facilities and equipment selection? | 3.a(14) | |||||||||
| programmatic | b. Facilities and Equipment Utilization Planning | 0 | 0 | 0 | 0 | 0 | 3.b | ||||
| programmatic | (1) What are the provisions for scheduled and unscheduled maintenance on facilities and equipment? | 3.b(1) | |||||||||
| programmatic | (2) How are major considerations of planned workloads, production rates, and workflow addressed in the facilities and equipment utilization plans? | 3.b(2) | |||||||||
| programmatic | (3) What are the alternative uses of the existing facilities and equipment, when they are not experiencing maximum usage? | 3.b(3) | |||||||||
| programmatic | (4) What considerations exist in the utilization plan for fire protection, waste disposal, fuel, and other facilities? | 3.b(4) | |||||||||
| programmatic | c. Facilities and Equipment Allocation | 0 | 0 | 0 | 0 | 0 | 3.c | ||||
| programmatic | (1) Have all facilities and equipment to be used for the production of this program been identified? | 3.c(1) | |||||||||
| programmatic | (2) How have the facilities and equipment required for this program been factored into the program schedule? | 3.c(2) | |||||||||
| programmatic | (3) How will the facilities support transportation, storage, and handling of planned inventories? | 3.c(3) | |||||||||
| programmatic, PQM | d. Plant Layout Policy and Procedure | 0 | 0 | 0 | 0 | 0 | 3.d | ||||
| programmatic, PQM | (1) What is the plant layout policy? | 3.d(1) | |||||||||
| programmatic, PQM | (2) How has the plant layout been coordinated with the various internal disciplines such as methods and processes, quality assurance, production control, manpower, facilities and equipment, security, and so forth? | 3.d(2) | |||||||||
| programmatic, PQM | e. Functional and Physical Arrangement Analyses and Decisions | 0 | 0 | 0 | 0 | 0 | 3.e | ||||
| programmatic, PQM | (1) What constraining factors, such as floor loading and location of utilities, have been considered in plant layout? | 3.e(1) | |||||||||
| programmatic, PQM | (2) How are safety, health, physical security, and environmental standards used in plant layout analyses? | 3.e(2) | |||||||||
| programmatic, PQM | (3) How has equipment maintenance been considered in plant layout analyses? | 3.e(3) | |||||||||
| programmatic, PQM | (4) Has consideration for walkways, working space, rest rooms and other personnel requirements been included in plant layout? | 3.e(4) | |||||||||
| programmatic, PQM | f. Plant Layout Design | 0 | 0 | 0 | 0 | 0 | 3.f | ||||
| programmatic, PQM | (1) Where is the physical arrangement diagram that identifies and depicts dimensions of all functional areas to be used? | 3.f(1) | |||||||||
| programmatic, PQM | (2) Where is the plant layout, which shows the component and product flow including material receiving and storage? | 3.f(2) | |||||||||
| programmatic, PQM | (3) What is the contingency plan for adaptation to the plant layout for revised production rates? | 3.f(3) | |||||||||
| programmatic, PQM | (4) How can the plant layout can be adapted to accommodate change in the event of engineering or manufacturing revisions? | 3.f(4) | |||||||||
| programmatic, PQM | (5) What facilities and equipment modernization / expansion plans are considered in the plant layout plans? | 3.f(5) | |||||||||
| programmatic, T&E | g. Test Equipment and Tooling Policy and Procedure | 0 | 0 | 0 | 0 | 0 | 3.g | ||||
| programmatic, T&E | (1) What are the procedures that provide for the analysis of tooling rework and repair data that enables the correction of tool design deficiencies? | 3.g(1) | |||||||||
| programmatic, T&E | (2) What are the procedures for maintaining test equipment and tool designs as engineering and manufacturing methods change? | 3.g(2) | |||||||||
| programmatic, T&E | (3) What procedures govern the storage, maintenance, repair and overhaul of test equipment and tooling? | 3.g(3) | |||||||||
| programmatic, T&E | (4) What procedure governs how test equipment and tooling are assigned to the work centers, and how is accountability maintained? | 3.g(4) | |||||||||
| programmatic, T&E | (5) What is the procedure that addresses Government ownership of test equipment and tooling? | 3.g(5) | |||||||||
| programmatic, T&E | (6) How do the procedures for test equipment and tooling design provide for coordination with all other disciplines such as methods / processes, quality assurance, production, plant layout, etc.? | 3.g(6) | |||||||||
| programmatic, T&E | (7) What sort of master tooling system is in place to control the interchangeability of parts? | 3.g(7) | |||||||||
| programmatic, T&E | (8) Does the contractor employ CAD / CAM techniques to design and build tooling? | 3.g(8) | |||||||||
| programmatic, T&E | (9) What procedures that provide test compatibility between the prime and subcontractor ground support equipment? | 3.g(9) | |||||||||
| programmatic, T&E | (10) What are the requirements for the calibration, inspection, and test of test equipment and tooling according to specifications? | 3.g(10) | |||||||||
| programmatic, T&E | (11) What procedures assure test equipment and tooling meet specifications for production? | 3.g(11) | |||||||||
| programmatic, T&E, risk | h. Analyses of Requirements, Design and Procurement / Fabrication | 0 | 0 | 0 | 0 | 0 | 3.h | ||||
| programmatic, T&E | (1) How are factors such as human engineering, safety and material considered in the design of test equipment and tooling? | 3.h(1) | |||||||||
| programmatic, T&E, risk | (2) Has tooling which is considered high risk been identified and, what plans have been made to reduce the risk? | 3.h(2) | |||||||||
| programmatic, T&E | (3) How are factors such as durability, reliability, and maintainability considered in the design of test equipment and tooling? | 3.h(3) | |||||||||
| programmatic, T&E | (4) Are cost estimates, including scrap value, used in the design of test equipment and tooling? | 3.h(4) | |||||||||
| programmatic, T&E | (5) What is the make / buy policy for test equipment and tooling? | 3.h(5) | |||||||||
| programmatic, T&E | i. Completeness of Design, Selection and Quality of Documentation | 0 | 0 | 0 | 0 | 0 | 3.i | ||||
| programmatic, T&E | (1) What percentage of the required production test equipment and tooling is presently available? | 3.i(1) | |||||||||
| programmatic, T&E | (2) How have all test equipment and tooling requirements been designed to meet scheduled engineering development and production? | 3.i(2) | |||||||||
| programmatic, T&E | (3) Are the master tool drawings complete, and how are they maintained to serve as permanent records? | 3.i(3) | |||||||||
| programmatic, T&E | (4) Do the master tool records contain all pertinent information such as function, fabrication method, designation and important features? | 3.i(4) | |||||||||
| programmatic, T&E | (5) Have requirements been determined for all test equipment that will be subcontracted or procured? | 3.i(5) | |||||||||
| programmatic, training | j. Contractor Manpower and Personnel Organization | 0 | 0 | 0 | 0 | 0 | 3.j | ||||
| programmatic | (1) How does the manpower and personnel organization provides for lines of communication among the various functional organizations? | 3.j(1) | |||||||||
| programmatic, training | (2) What is the system that provides for training and updating the skills of the work force? | 3.j(2) | |||||||||
| programmatic | (3) Does the contractor conduct periodic analysis of manpower requirements based on changes to programs and / or budgeting? | 3.j(3) | |||||||||
| programmatic, training | (4) What is the personnel administration system that is responsible for the areas of employee benefits, medical, safety, training, labor relations, and wages? | 3.j(4) | |||||||||
| programmatic | (5) How does the personnel administration system provides for the application of fringe benefits, granting of salary increases and establishment of bonuses and incentives? | 3.j(5) | |||||||||
| programmatic | k. Contractor Manpower and Personnel Policy and Procedure Documentation | 0 | 0 | 0 | 0 | 0 | 3.k | ||||
| programmatic | (1) What is the methodology that establishes the priority of work force assignments relative to the various production programs? | 3.k(1) | |||||||||
| programmatic | (2) What procedures describe the level and mix of labor classifications that are required? | 3.k(2) | |||||||||
| programmatic | (3) What procedures are in place for analyzing data such as turnover rates, complaints, grievances and absenteeism, and the implementation of methods to improve the work force efficiency? | 3.k(3) | |||||||||
| programmatic | (4) What are the policies and procedures relative to the evaluation of employee performance, and are they well documented and utilized? | 3.k(4) | |||||||||
| programmatic | (5) What metric provides for management review of productivity and performance for each work center? | 3.k(5) | |||||||||
| programmatic | l. Contractor Labor Agreements | 0 | 0 | 0 | 0 | 0 | 3.l | ||||
| programmatic | (1) What management-union agreements provide a ready source of qualified personnel in all phases of contract performances? | 3.l(1) | |||||||||
| programmatic | (2) What is the history of management-union relations and has it created a general agreement and harmony? | 3.l(2) | |||||||||
| programmatic, training | m. Work Force Composition | 0 | 0 | 0 | 0 | 0 | 3.m | ||||
| programmatic | (1) How will the Manpower Procurement Plan support the production plan and delivery schedule during EMD and transition from EMD to production? | 3.m(1) | |||||||||
| programmatic, training | (2) What steps are taken to ensure that new employees are thoroughly indoctrinated and trained, and that they are qualified to work on this program? | 3.m(2) | |||||||||
| programmatic, training | (3) What is the lead-time schedule for the acquiring and training of personnel for this program? | 3.m(3) | |||||||||
| programmatic, training | (4) What safety training and special education have been provided to supervisors for this program? | 3.m(4) | |||||||||
| programmatic, training | (5) What program or procedure ensures that all employees receive safety briefings on the hazards of their tasks and environments? | 3.m(5) | |||||||||
| Level 1, PQM, programmatic, software, T&E | 4. Quality Assurance | 0 | 0 | 0 | 0 | 0 | 4 | ||||
| programmatic, T&E, PQM, software | a. Quality Assurance Policy and Procedure Documentation | 0 | 0 | 0 | 0 | 0 | 4.a | ||||
| PQM, programmatic | (1) What is the process for performing internal audits and initiating corrective actions? | 4.a(1) | |||||||||
| PQM, programmatic | (2) What plans and milestones identify additional quality assurance staffing requirements? | 4.a(2) | |||||||||
| PQM, programmatic | (3) How does the Quality Program Plan address the role of quality in the inspection and acceptance of software? | 4.a(3) | |||||||||
| T&E, PQM, programmatic | (4) Does the Quality Program Plan require the quality functional area to interface with other functional areas in the development of software, i.e. programming, engineering, and testing? | 4.a(4) | |||||||||
| programmatic, software, PQM | (5) Does the Quality Program Plan provide for the reporting of software discrepancies and implementation of corrective action? | 4.a(5) | |||||||||
| programmatic, software, PQM | (6) Are trend analyses conducted that show the percent of rework and repair to total man-hours for both the current and previous year? | 4.a(6) | |||||||||
| PQM, programmatic | (7) Have all Quality Assurance Program Plans been accepted in accordance with the contract or subcontracts? | 4.a(7) | |||||||||
| PQM, programmatic | (8) What is the quality organization's role in the preparation, classification, and distribution of waivers, deviations, and engineering changes? | 4.a(8) | |||||||||
| PQM, programmatic | (9) Is the quality program clearly defined as the objective and policy of top management? | 4.a(9) | |||||||||
| PQM, programmatic | (10) What is the quality organization's procedure for assuring that documented procedures and changes are issued to all concerned? | 4.a(10) | |||||||||
| programmatic, T&E, PQM | (11) What procedures ensure that work instructions comply with inspection and test requirements? | 4.a(11) | |||||||||
| PQM, programmatic | (12) What procedures ensure that improper work instructions are corrected? | 4.a(12) | |||||||||
| PQM, programmatic | (13) Are records kept by the quality organization available to the Government? | 4.a(13) | |||||||||
| programmatic, software, PQM | (14) Do the inspection records include the number and type of defects, and indicate the quantities of acceptable and rejected items? | 4.a(14) | |||||||||
| PQM, programmatic | (15) Are quality records analyzed and used as a basis for management action to correct product and system deficiencies? | 4.a(15) | |||||||||
| PQM, programmatic | (16) What system is used for collecting and tracking of cost related to quality, and is this data available for Government review? | 4.a(16) | |||||||||
| PQM, programmatic | (17) What process ensures that drawings, specifications, and instructions are available at inspection stations? | 4.a(17) | |||||||||
| PQM, programmatic | (18) What procedure is utilized to remove and properly dispose of obsolete drawings from all locations? | 4.a(18) | |||||||||
| PQM, programmatic | (19) What procedure ensures the accuracy of inspection media tooling prior to its use? | 4.a(19) | |||||||||
| programmatic, T&E, PQM | (20) What is the process for inspection and calibration of tooling at regular intervals, and the identification / removal and / or correction of tooling that shows wear between inspection interval, and are calibration records properly maintained for inspection test equipment and tooling? | 4.a(20) | |||||||||
| programmatic, T&E, PQM | (21) Is the measuring and test equipment labeled or coded to indicate the date of last calibration and date of next calibration? | 4.a(21) | |||||||||
| programmatic, T&E, PQM | (22) Are there established controls for calibration of personally owned measuring instruments? | 4.a(22) | |||||||||
| PQM, programmatic | (23) Is the calibration system included as a part of the Quality Program or inspection system? | 4.a(23) | |||||||||
| PQM, programmatic | (24) What is the procedure for handling unusual or state-of-the-art measuring requirements that cannot be performed? | 4.a(24) | |||||||||
| PQM, programmatic | (25) What is the process to clearly define the assignments, responsibility, and authority of the personnel on the Preliminary Review, Material Review, and Corrective Action Boards? | 4.a(25) | |||||||||
| PQM, programmatic | (26) What are the procedures for reporting and determining cause of product damage, and the establishment of additional procedures and controls where required? | 4.a(26) | |||||||||
| programmatic, T&E, PQM | b. Quality Assurance Organization and Personnel | 0 | 0 | 0 | 0 | 0 | 4.b | ||||
| PQM, programmatic | (1) How does the quality program provide for lines of communication among all functional organizations? | 4.b(1) | |||||||||
| PQM, programmatic | (2) What is the quality assurance manager's role and authority in the elimination of deficiencies and the establishment of corrective actions regardless of the functional element responsible? | 4.b(2) | |||||||||
| programmatic, T&E, PQM | (3) Does the quality organization assure that inspection and test requirements contained in work instructions are in accordance with drawings, specifications, and the contract? | 4.b(3) | |||||||||
| PQM, programmatic | (4) Are only qualified / certified personnel used for manufacturing, inspection and processes that require special skills? | 4.b(4) | |||||||||
| PQM, programmatic | (5) Have staffing requirements for quality assurance personnel been considered for the transition from EMD to production? | 4.b(5) | |||||||||
| programmatic, T&E, PQM, software | c. Completeness and Adequacy of Quality Assurance Planning | 0 | 0 | 0 | 0 | 0 | 4.c | ||||
| PQM, programmatic | (1) What is the procedure that ensures that Engineering Change Proposals (ECPs) are routed through the quality organization? | 4.c(1) | |||||||||
| PQM, programmatic | (2) What are the procedures used to govern the identification, storage, and control of Government-furnished material? | 4.c(2) | |||||||||
| PQM, programmatic | (3) Who has the authority and responsibility for the accomplishment of quality program contract requirements? | 4.c(3) | |||||||||
| PQM, programmatic | (4) Does the Quality Assurance Program Plan provide for the development of inspection and test planning during the earliest practical phase of the contract? | 4.c(4) | |||||||||
| programmatic, T&E, PQM | (5) How is the quality assurance planning for inspection and testing compatible with manufacturing methods and processes? | 4.c(5) | |||||||||
| PQM, programmatic | (6) How does the Quality Assurance Program Plan assures compliance with contract cost, schedule, and performance throughout production? | 4.c(6) | |||||||||
| programmatic, software, PQM | (7) How does the Quality Assurance Program Plan provide for the early detection of deficiencies and timely corrective action? | 4.c(7) | |||||||||
| PQM, programmatic | (8) What is quality assurance's involvement in the management of standards such as drawings, changes, and measuring equipment that are used to assure product quality? | 4.c(8) | |||||||||
| programmatic, T&E, PQM | (9) Are flow charts that define the various processes, inspections, and tests traceable to materials and equipment from receiving to final shipment? | 4.c(9) | |||||||||
| PQM, programmatic | d. Manufacturer and Supplier Quality Control | 0 | 0 | 0 | 0 | 0 | 4.d | ||||
| PQM, programmatic | (1) What procedures assure the latest drawings and specifications are supplied to subcontractors? | 4.d(1) | |||||||||
| PQM, programmatic | (2) Were trend analyses conducted based on the number of Material Review Board (MRB) actions for a given period of time? | 4.d(2) | |||||||||
| PQM, programmatic | (3) Does the review of completed MRB actions indicate any misuse of procedures regarding disposition? | 4.d(3) | |||||||||
| PQM, programmatic | (4) What procedures provide for the review and follow-up of corrective action as a result of MRB activities? | 4.d(4) | |||||||||
| PQM, programmatic | (5) Does the contractor receive, record, and provide timely response with corrective actions for field complaints on all Government contracts? | 4.d(5) | |||||||||
| PQM, programmatic | (6) Do procedures exist that govern notification to suppliers of special requirements such as calibration, MRB authority, and waiver requirements? | 4.d(6) | |||||||||
| PQM, programmatic | (7) What is the vendor rating system for periodic reviews and actions for those who exceed the rating criteria? | 4.d(7) |
This is the start of the file's text. The full file is on GovTribe.
File details come from the government source that posted it. Updated .