7. DI-SESS-81704 Test Plans and Procedures.pdf

DI -SESS-81704

DATA ITEM DESCRIPTION

Title: Test Plans/Test Procedures

Number: DI-SESS-81704 Approval Date: 20061122 AMSC Number: F7658 Limitation: N/A DTIC Applicable: N/A GIDEP Applicable: N/A Preparing Activity: 10 (ASC/YFPC) Applicable Forms:

Use/relationship: The Test Plans/Test Procedures provide a roadmap of the System Test Program. It includes general planning factors, objectives, scope and details of the contract portions of the test programs. In defining specific test objectives, data priorities, support, resource and configuration requirements, it is used to evaluate the proposed test program/ test procedures.

This DID contains the format and content preparation instructions for the data product generated by the specific and discrete task requirement as delineated in the contract.

Requirements:

1. Reference documents. The applicable issue of the documents cited herein, including their approval dates and dates of any applicable amendments, notices, and revisions, shall be as specified in the contract.

2. Format. Contractor format is acceptable.

3. Content. The Test Plans/Test Procedures shall include detailed planning information on each test specified in each of the specifications on the contract and other contractual requirements documents that include test methods and success requirements.

Subparagraphs Data and Test Information Sheets shall be in separate volumes.

3.1. Applicable Tests: Tests to be covered shall include verification demonstrations and tests. Test to be covered shall include the following functional test categories:

3.1.1. Engineering Development Tests

3.1.2. Preliminary Qualification Tests

3.1.3. Formal Qualification Tests

3.1.4. Human Factors

3.1.5. Acceptance Tests

The contractor shall assign each test to the appropriate functional category above.

3.2. Test Plan: Tests to be covered shall include verification demonstrations and tests.

The contractor shall prepare a test plan that contains the following elements:

Source: http://assist.dla.mil -- Downloaded: 2022-07-02T17:20Z

Check the source to verify that this is the current version before use.

3.2.1. Test objectives, description success criteria and the applicable specification or other contractual requirements document paragraph(s), to include problems and the order of priority of objectives for each activity or flight. Test descriptions shall include location of testing, flight profiles and associated parameters, geometrics and restrictions.

Identify the number of trial/runs required.

3.2.2. Test item configuration identification for each system, subsystem, component, or aircraft, stores and expendables and instrumentation, to include quantities. Include success criteria, as well as parametric and video/cockpit data required to establish test success or failure.

3.2.3. Flight (or test sequence) profiles, including flight (or test sequence) performance and data presentation predictions. Also including:

3.2.3.1. Anticipated restrictions with justification for each

3.2.3.2. Anticipated parameters (velocity, altitude, maneuvers, etc)

3.2.3.3. Specific high risk details if test involves high risk to personnel or material, or if the test requires performance outside of normal parameters.

3.2.4. Test schedules, including a test requirements matrix, notations on GFE and other resource availability constraints, and the location, number, duration and frequency of tests. Information shall be traceable to the contractual requirements as applicable.

3.2.5. Instrumentation requirements and calibration instructions (measurement, accuracies and criteria). Projected test schedule and sequence (if sequential execution is required) complete with sortie generation and anomaly factors along with data processing and analysis timelines.

3.2.6. Data processing and reporting procedures to include data priorities, observable data requirements, data documentation, reduction and analysis criteria and procedures.

Include facility and special test equipment and/or asset requirements. Highlight government test facilities and/or assets required.

3.2.7. Interface Identifications: Airborne, ground, site-to-site, internode, intersystem or other. Include special and/or significant technical and/or logistical support required to execute the tests. These requirements shall be expressed in sufficient detail to permit determination of action required to assure support is available.

3.2.8. Safety: Safety considerations and constraints relative to risks to both personnel and/or material. Summarize personnel test support requirements to include air vehicle, avionics, support and supplier manpower and skills needed to execute the tests. Identify government manpower and skills required to execute the tests.

3.3.9. Flow Diagram: The plan should include by attachment or reference, an overall flow diagram of the entire test and deployment program. Appropriate notations and references shall be included for traceability to the contractual requirements. This flow shall be sequentially arranged to include all significant test milestones and efforts in the development phase, associated with each class of test; identification of specific CIs which will undergo development testing and deployment; identification of all test documentation associated with each test phase or activity; test locations;

contractor/agency responsible for each activity and event; and any additional information which clarifies the description of the test program (such as attachments to the flow diagram for site location maps, block diagram, interconnection link diagrams, etc.

Describe data reduction and analysis process and map results back to success criteria.

3.3.10. Test Support Requirements: This section shall identify and describe all significant technical and logistical support required to implement each class of detail to permit a determination of whether the agency has the capability to support the test or needs to take action to acquire a capability. In general, consideration should be given to the following major requirements for each test phase as applicable. This section shall be traceable to contractual requirements, as applicable.

3.3.10.1. Test logistics, including supply, maintenance, facilities, resources and transportation available/required.

3.3.10.2. Personnel Planning Information. For each contractor or agency involved, summarize personnel test support requirements including an assessment of the kind of skills, number of personnel, skill level of each. A recommended program for training Air Force operator and maintenance personnel for active participation in the test program shall be included along with a description of the extent of proposed prime, associate, and subcontractor participation and the extent of proposed government participation.

3.3.10.3. Personnel Support Requirements. For each contractor or agency involved, summarize personnel test support requirements. This shall include an assessment of the kind of skills, number of personnel, and skill level and authority of each. Include training requirements.

3.3.10.4. Test Information Sheets. Detailed test procedure information shall be documented on a test information sheet (TIS), or equivalent, to satisfy the individual contractual verification requirements. Each TIS shall reflect the test planning, shall be bound in separate volumes and may be delivered separate from the plans volume. Each TIS shall include (1) title and number of applicable specification, (2) paragraph number(s) of applicable specification, (3) title of test, (4) functional category of test, and

(5) the identification whether ground test or flight test, where applicable. Each TIS shall include the following information to the depth necessary to show the adequacy of the test methods and test limits:

3.3.10.4.1. Planning Information. Each TIS shall include to the depth needed to show the adequacy of the test method and test limits:

3.3.10.4.1.1. Objectives. Describe the objectives of the test, including both primary and secondary purposes. Define the success criteria relating to the specific test. Include step by step procedures to be followed (e.g., user’s manuals). Include data logs and forms to be used.

3.3.10.4.1.2. Description of Test Item: Describe the test item as it relates to the specification and to the particular test. Include, where applicable, a description of all subsystems having a direct bearing on the purpose of the test.

3.3.10.4.1.3. Approach: Describe the test approach to the depth necessary to establish baseline for support needed (e.g., wind tunnel hours, flight test hours, etc) for each test.

3.3.10.4.1.4. Location, schedule and number of tests.

3.3.10.4.1.5. Support Equipment. Description of support equipment required from other sources (i.e., GFE or associate contractor.)

3.3.10.4.1.6. Extent of prime and associate contractor participation.

3.3.10.4.1.7. Extent of government participation.

3.3.10.4.1.8. Instrumentation. Indicate type and recording devices to be used and number of parameters to be recorded.

3.3.10.4.1.9. Data reduction and analysis. Indicate data to be recorded and describe the data reduction and analysis techniques.

3.3.10.4.1.10. Government test facilities. For tests to be conducted at a Government facility, indicate the applicable facility, and provide a reference to the appropriate Facility Requirements Document and other governing documents.

3.3.10.4.2. Phase Procedural Information. For submittal in the verification/validation or qualification phase, each TIS shall be expanded and updated and shall include:

3.3.10.4.2.1. Objectives. Describe the objectives of the test, both primary and secondary.

Define the success criteria relating to the specific test.

3.3.10.4.2.2. Description of test item. Describe the test item as it relates to the specification and to the particular test. Examples of information to be included, as appropriate, are:

3.3.10.4.2.2.1. Weight changes and center of gravity travel during flight (due to fuel consumption.)

3.3.10.4.2.2.2. Description of all subsystems having a direct bearing on the purpose of the test.

3.3.10.4.2.2.3. Description of design features such as boattail, fins, external stores, etc.)

3.3.10.4.2.2.4. Anticipated flight/system restrictions or component/subsystem limitations (redlines), with justification for each restriction.

3.3.10.4.2.2.5. Identification and location of all nonproduction equipment (e.g., data pickups, console controls, recording equipment, etc.)

3.3.10.4.2.2.6. Test apparatus and method of installation.

3.3.10.4.2.3. Approach.

3.3.10.4.2.4. Location, schedule and number of tests.

3.3.10.4.2.5. Extent of prime and associate contractor participation.

3.3.10.4.2.6. Extent of anticipated government participation.

3.3.10.4.2.7. Instrumentation. Describe, including:

3.3.10.4.2.7.1. Sensing and recording devices. Include FSN, model number and part number, or their equivalent in design criteria.

3.3.10.4.2.7.2. Interface wiring diagrams between sensing and recording devices.

3.3.10.4.2.7.3. Calibration constants and methods of calibration.

3.3.10.4.2.7.4. Accuracy required.

3.3.10.4.2.7.5. Check-out procedure.

3.3.10.4.2.7.6. Operating instructions.

3.3.10.4.2.8. Test phasing, scheduling and duration. Indicate test scheduling and duration of test.

3.3.10.4.2.9. Test objectives. Describe the step-by-step procedures to be followed.

Include the number of items to be tested and the number of times each item is to be tested. Data logs and forms for recording data shall be presented. For TISs on flight tests, include parameters such as velocity, altitude, flight maneuvers, power settings, etc.

3.3.10.4.2.10. Data reduction and analysis: Indicate data to be recorded and describe the data reduction and analysis techniques. It is necessary that all test results be presented in terms which can be correlated with specific CI specification requirements.

3.3.10.4.2.11. Government test facility. For tests to be conducted at a Government facility, indicate the applicable facility and provide reference to the appropriate Facility Requirements Document and other governing document.

3.3.10.4.3. Summary. A summary shall be submitted for the qualification phase only.

The summary shall include a complete index of TISs, with cross-reference to the applicable specification paragraph number for each TIS.

3.3.10.4.4. Organization of Plan. When the qualification phase test plan is specified as a single submittal, the plan shall be prepared in separate volumes. Volume I shall consist of the summary and index, and subsequent volumes shall consist of TISs, grouped according to the functional test categories, i.e., a volume for engineering test and evaluation, a volume for prequalification test, etc. Where both flight and ground tests are included in a single function test category, the TISs shall be in a separate section of that volume.

4. End of DI-SESS-81704