TE F- A004 Test Plans Procedures Reports.docx

DATA ITEM DESCRIPTION

Form Approved

OMB NO. 0704-0188

Public reporting burden for this collection of information is estimated to average 110 hours per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302, and to the Office of Management and Budget, Paperwork Reduction Project (0704-0188), Washington, DC 20503.

1. TITLE

A006 – TE F, Test Plans, Procedures and Reports

2. IDENTIFICATION NUMBER

3. DESCRIPTION/PURPOSE

To prescribe minimum requirements for contractor prepared test plans, test procedures, and test reports for test technology development and validation. Contractor shall provide general and administrative support for sustaining technical capabilities.

4. APPROVAL DATE (YYMMDD)

5. OFFICE OF PRIMARY RESPONSIBILITY (OPR)

USAOTC FSTD-AMDTD

6a. DTIC APPLICABLE

6b. GIDEP APPLICABLE

7. APPLICATION/INTERRELATIONSHIP

This Data Item Description is applicable to all types of testing performed by the contractor to demonstrate conformance to Task Orders requiring technology acquisition or development. Types of test included are: technology evaluations, systems integration, software verification, delivery acceptance, and quality conformance. The resulting documents are subject to Government approval before being accepted as a deliverable.

8. APPROVAL LIMITATION

9a. APPLICABLE FORMS

9b. AMSC NUMBER

10. PREPARATION INSTRUCTIONS

10.1 The contractor shall provide test plans, procedures, and reports that meet the requirements of the Task Order and paragraph 10.4 below. Contractor format is acceptable.

10.2 Only those portions of paragraph 10.4 as specified in the Task Order are required. The contractor shall use his best judgment in determining the applicability of each submittal.

10.3 Definitions. Applicable to this data item only.

3. Engineering evaluation – exploratory type tests conducted to measure and record the performance characteristics of hardware, software, or systems.

a. Not Used.

b. Not Used

c. Software verification – tests conducted on computer software and firmware, prior to system integration, to verify requirements in the work statement.

d. System integration – test conducted on systems, consisting of two or more items that have undergone separate testing, or consisting of both hardware and software, to demonstrate conformance of the system to the requirements of the work statement.

e. Quality conformance – inspections and tests, conducted at a manufacturer or sub-contractor facility, to verify and demonstrate conformance with the work statement.

f. Delivery acceptance – tests conducted after delivery to the Government facility to assure that the item is free from shipping damage and to verify function and safe operating characteristics.

g. Verification Validation and Accreditation (VVA) – documentation needed to gain ATEC accreditation that the technology, simulation, or stimulation provides and accurate representation of the real world and that the information collected is accurate and usable.

i. Verification Validation and Accreditation (VVA) Software Plans for, results of, and recommendations resulting from Software VV testing

10.4 Test plans, procedures and reports, when required by the work statement, shall include, but are not limited by the following items and topics:

4. Test Plans/Procedures/Reports: All documents shall include the following:

0. Title Page

(1) Table of Contents

(2) List of Illustrations

(3) Introduction/Purpose

(4) Test dates and location

(5) References

(6) Test Procedures

(7) Test Results

(8) Conclusion

(9) Recommendations

11. DISTRIBUTION STATEMENT

DISTRIBUTION STATEMENT A: Approved for public release; distribution unlimited.

OMB NO. 0704-0188

10. Test plans… (continued)

5. Test Plan. The test plan describes what the contractor intends to do to fulfill test requirements and in addition to “10.4 a” above, all test plans shall include:

0. Basic test philosophy and approach

(11) Government furnished property (GFP), if required.

(12) Acceptance/rejection criteria

a. Test Plan (software). In addition to “10.4 b” above, all test plans involving software shall include:

1. Interface requirements - This portion of the plan shall describe all interface conditions which must be satisfied. It shall include interface data for the following:

(a) Hardware I/O (Input/Output)

(b) Executive program

(c) Other supporting software

(d) Errors

(14) Software test environment

(15) Test identification

(16) Timing requirements

(17) Volume requirements (data)

(18) Input data format

b. Test Procedures. The test procedure describes in detail how the examinations and tests are to be performed and in addition to “10.4 a” above, all test procedures shall include:

2. Scope

(20) Technical approach

(21) Functional block diagram of test set up

(22) Identification of test equipment required

(23) Number of test units or lot size and sampling plan

(24) Step-by-step procedures to be followed referenced to the particular requirement in the work statement.

(25) Data reduction and analysis

(26) Acceptance/rejection criteria

(27) Definitions and abbreviations

(28) Sample data sheets

(29) List of required GFP

(30) Planned test to be subcontracted

c. Test Procedures (software): In addition to “10.4 d” above, all test procedures involving software shall include:

3. A full description of the procedures, giving particular attention to the following:

(a) Describe the function tested.

(b) Arrange test sequence for optimum performance.

(c) Provide detailed step-by-step procedures required to obtain desired results.

(d) Identify test results expected and provide for recording the actual results obtained.

(32) A description of all operating procedures including the following:

(a) Initial system set up and pre-operating procedures

(b) Normal operation modes

(c) Program completion notes

(d) Error conditions (and operator action, if applicable)

(e) Messages (and operator action, if applicable)

(f) Halts (and restart procedures, if applicable)

d. Test Report: The test report shall, in addition to “10.4 a” above include: [Note: Sections (1) through (6) shall be included in the main body of the report. Section (7) and (8) shall be included as an appendix].

4. Executive Summary

4. Description of test facility and conduct of the test including a description of how the test article was operated during the test. Brief description of test article.

4. Manpower requirements

4. Identification of test equipment and its calibration status

(37) Summary of tests results. Where these tests were to show compliance with a given statement of work and/or specification

(38) Functional block diagram of test set up

OMB NO. 0704-0188

10. Test Report… (continued)

(39) Deviation from test conditions. If value of data has been compromised due to test conditions, the reason and implication shall be stated.

(40) Data Collection and reduction

6. Recorded test data or logs as appropriate, including instrument readings, correction factors, and reduced results presented in tabular or graphic form.

6. Test log

(43) Certification that the test results are authentic, accurate, current, and in accordance with approved test procedures.

6. Recorded test data or logs as appropriate, including instrument readings, correction factors, and reduced results presented in tabular or graphic form.

6. Test Report Addendum: This report used to update the test report when design changes made and test are performed after the test report has been published. The updated information shall be related to the previous data in the test report.

6. Interim Test Report. Interim reports are prepared when reporting of test status is required during the period of the test.

9. Initial interim reports shall contain the same contents as for test reports, except that the results and conclusions shall be preliminary.

(45) Subsequent interim reports need not include descriptive data provided in the initial report, but only changes thereto.

10.7 Explanation of terms in paragraph 10.4: Self-explanatory terms are not listed. Other terms are listed to aid the contractor in understanding the requirement. Items listed under each term are to be included as applicable.

7. Basic test philosophy and approach.

0. Facility requirements

(47) Test preparation plans

(48) Key personnel responsibilities

(49) Sub-contracting plan

(50) Description of test content and conduct

(51) Documentation requirement

(52) Logistics support

(53) Applicable MIL-STDs

a. Schedule of events.

1. Network diagrams

(55) Gantt charts

b. Government Furnished Property (GFP)

2. Describe contractor plan for maintenance and repair.

(57) Describe security measures to be taken for safeguarding.

(58) Describe accountability procedures.

c. General test approach.

3. Facility requirements

(60) General description of the test content and conduct (i.e., will environmental test be conducted? Will test article be operated during the test?

d. Data reduction and analysis.

4. Types of data to be recorded.

(62) Data reduction process and time test.

(63) Description of method for data reduction and analysis.

e. Subcontracting.

5. Show which portions of the test are to be performed by the prime contractor.

(65) Show which portions of the test are to be performed by the sub-contractor(s).

(66) Identify sub-contractors by name and address.

f. Accept/reject criteria.

6. Statements of test objectives are sufficient for exploratory type tests.

(68) Include criteria to be evaluated with pass/fail levels.

(69) Include exceptions or deviations (good or bad) and resulting impact.

DD Form 1664, APR 89 Previous editions are obsolete Page 3 of 3