J012 RIPSA FA DIDs.doc

DATA ITEM DESCRIPTION

3. Description/Purpose

The Test Report documents the results of a test and the subsequent data analysis. It is used to identify and evaluate discrepancies between expected and actual test results.

TBD

7. Application/Interrelationship

This Data Item Description (DID) contains the format and content preparation instructions for the Test Report requirements under this contract.

N/A

A004

10. Preparation Instructions

The test report shall provide the results of formal test and subsequent data analysis. The Test Report shall be prepared in Contractor-specified format and shall include, at a minimum, the following:

10.1 Title Page. The title page shall identify the title of the test event, the contract item or item tested, and the primary functions or segments tested. It shall also provide a unique identifying number for the document as well as revision level (version) and date of submittal.

10.2 Scope. The scope of this document in terms of the date(s) and location(s) of the test activities being covered shall be provided.

10.3 Test Objective. The specific test objective shall be provided, including reference to the requirements designated for this test in the Verification Requirements Traceability Matrix (VRTM).

10.4 References. Reference documents applicable to the test shall be listed. Such references shall include:

a. Test Plan (Ref. applicable sections)

b. Test Procedure (Ref. applicable sections)

c. Specification for the functions tested

Preparation Instructions Continued

10.5 Test Article Description. A general description of the test article shall be provided that:

a. Identifies whether a full or partial system configuration was utilized (if partial, identify specific parts included or left out, whichever is shorter, along with rationale for using partial configuration).

b. Identifies quantity of site configurable components utilized in test configuration.

c. Identifies the number of hardware, software, and adaptation configurations used in this test. If more than one configuration is used, identify all configurations and provide rationale for each.

d. Includes test configuration diagrams for each configuration used in the test.

e. References to the Product Configuration Document (PCD) included as an attachment to this document.

f. Identifies location of the test article (i.e. factory, on-site).

10.6 Test Equipment. A list of all test equipment, including manufacturer, model, calibration status, and serial number shall be included. Reference may be made to the applicable Test Log entry numbers or Test Readiness Review (TRR) materials included as attachments to this document.

10.7 Test Tools. A list of all system, test, and Data Reduction and Analysis (DR&A) software and adaptation utilized shall be provided, identifying title, release level, and release date.

10.8 Test Approach. A description of the test approach and success criteria utilized to verify each requirement tested shall be provided. Redlines (if any) introduced during test execution shall be accounted for in these descriptions.

10.9 Test Matrix. A test matrix shall be included that provides a summary of the test results. This matrix shall include the following information for each requirement tested in this event:

a. The full text of each requirement.

b. Requirement number, as identified in the VRTM.

c. Identification of whether the requirement has been fully or partially verified by this test event.

d. Procedure section in which the requirement is addressed. If a requirement is addressed in multiple sections, a separate line item shall be provided for each procedure section in which it is addressed.

e. Pass/Fail status of the requirement as a result of this test event. If a requirement is addressed in multiple sections of the procedure, a pass/fail status for each section and an overall status for the requirement shall be provided.

f. Identify whether regression testing is planned for further verification of each requirement as a result of test failure or planned fixes resulting from a System Problem Report (SPR) that may affect performance of that requirement.

g. Identify any SPRs by number that were generated during this test event that impact the pass/fail status of each requirement. A full copy of each SPR listed shall be included as an attachment to this document.

10.10 Regression Testing. A complete description of any planned or actual regression test activities as a result of SPRs generated during execution of this test event due to test failures or other noted system anomalies shall be provided. This description shall include reference to the specific test case, section, and steps that need to be executed from the test procedure or indicate that new or additional steps must be generated to address the SPR.)

Preparation Instructions Continued

10.11 Action Items Matrix. A matrix identifying all Action Items (AIs) generated as a result of this test event during:

a. Test Readiness Review (TRR)

b. Test conduct (from test log entries)

c. Test de-briefs The Action Item matrix shall include the following information:

a. The unique identification number assigned to each AI

b. Full text description of each AI

c. Indication of the Open/Closed status of each AI

d. Resolution and description of action(s) taken up to the time of report submittal for each AI

e. SPR number, if any, for any SPRs generated in connection with or for closure of each AI.

An SPR shall be generated for each AI that remains open at the time of submittal for this Test Report, with a copy of each SPR attached to the report as an appendix.

10.12 Test Results. Detailed test results, including the items listed below shall be provided:

a. An assessment of results obtained with respect to the defined success criteria, including conclusions regarding pass/fail status of each requirement.

b. A discussion of any raw or reduced data that either provides the basis for or directly supports conclusions regarding the pass/fail status of each requirement or group of requirements. This shall include an explanation of how the data presented supports the pass/fail status assigned to related requirements. Any graphical or tabular outputs produced by data analysis tools along with a detailed description of what is depicted or represented by each figure or table shall also be included.

c. Reference to the applicable Test Plan and Test Procedure sections that generated the results for each requirement.

d. A discussion of any SPRs generated during test conduct that includes a detailed description of the discrepancy, references the SPR number, references the procedure step at which the discrepancy occurred, references the Test Log entry describing the discrepancy, and assesses the impact of the discrepancy on the validity of preceding or following steps of the procedure. A full copy of each SPR generated shall be included as an appendix to this document.

e. A discussion of any Action Items (AIs) generated during test conduct that includes a detailed description of the issue, references the AI number, references the procedure step at which the issue was written, references the Test Log entry describing the issue, and assesses the expected impact of the issue on the validity of preceding or following steps of the procedure.

10.13 Discrepancy Reports. A full text copy of each SPR generated as a result of this test event shall be included as an appendix to this document. These copies shall include the latest status and closure action information available from the SPR database at the time this Test Report is submitted.

10.14 Test Evaluation. An overall analysis of the functional performance of the article tested shall be provided. This analysis shall describe the functional capability as it was demonstrated in the test, noting any specific deficiencies (making reference to SPRs) that were discovered. A general statement shall be provided for each MTP requirement deficiency that references the SPR. This statement shall describe the impact of the SPR on system design performance if the deficiency detected is retained or corrected. Other test events shall be identified that address each requirement that is only partially allocated to this test.

10.15 Test Results Certification. A certification shall be provided that the test results are authentic, accurate, current, and in accordance with related requirements and test plans. The names of Contractor and Government personnel present during the test shall be included. Contractor shall use J006 for Certification.

10.16 As-Run Procedures. A full copy of the as-run Test Procedures, with recorded results, signatures, and all red-lines introduced during test execution shall be provided as an appendix to this document.

Preparation Instructions Continued

10.17 Test Log. A complete copy of all Test Logs generated during test execution and signed by both the Government test witness and the Contractor shall be included as an appendix to this document.

The Test Log shall include, at a minimum, the following:

a. The name and organization of all personnel involved in the conduct or witnessing of the test.

b. Date and time of each event documented in the test log.

c. A pre-test briefing summary prior to test execution.

d. Date and start and stop times of the test.

e. Configuration changes.

f. System status at start of test, including system health and security status.

g. Procedure deviations and redlines.

h. Problems encountered or unexpected events, including affected test steps, and any subsequent recommendations and resolutions.

i. Effect of deviations or problems on test validity.

j. System problem reports generated or identified during the test, including affected test steps.

k. Action Items generated during the test, including affected test steps.

l. Pass/fail status of each test event.

10.18 Test Readiness Review (TRR) materials. A full copy of all materials presented at the TRR conducted for this test event shall be included as an appendix to this document.

11. Distribution Statement

DATA ITEM DESCRIPTION

3. Description/Purpose

The Site Acceptance Test follows the procedures specified in the Site Acceptance Test Report to verify that the RIPSA First Article system meets all the requirements.

TBD

7. Application/Interrelationship

This Data Item Description (DID) is a checklist item to verify that the Site Acceptance Test was conducted in accordance with the instructions specified in the Site Acceptance Test Procedures.

N/A

A015

10. Preparation Instructions

10.1 Test Evaluation. An overall analysis of the functional performance of the article tested shall be provided. This analysis shall describe the functional capability as it was demonstrated in the test, noting any specific deficiencies (making reference to SPRs) that were discovered. A general statement shall be provided for each MTP requirement deficiency that references the SPR. This statement shall describe the impact of the SPR on system design performance if the deficiency detected is retained or corrected. Other test events shall be identified that address each requirement that is only partially allocated to this test.

10.2 Test Results Certification. A certification shall be provided that the test results are authentic, accurate, current, and in accordance with related requirements and test plans. The names of Contractor and Government personnel present during the test shall be included. Contractor shall use J008 for Certification.

11. Distribution Statement

DATA ITEM DESCRIPTION

3. Description/Purpose

The Test Report documents the results of a test and the subsequent data analysis. It is used to identify and evaluate discrepancies between expected and actual test results.

TBD

7. Application/Interrelationship

This Data Item Description (DID) contains the format and content preparation instructions for the Test Report requirements under this contract.

N/A

A016

10. Preparation Instructions

The test report shall provide the results of formal test and subsequent data analysis. The Test Report shall be prepared in Contractor-specified format and shall include, at a minimum, the following:

10.1 Title Page. The title page shall identify the title of the test event, the contract item or item tested, and the primary functions or segments tested. It shall also provide a unique identifying number for the document as well as revision level (version) and date of submittal.

10.2 Scope. The scope of this document in terms of the date(s) and location(s) of the test activities being covered shall be provided.

10.3 Test Objective. The specific test objective shall be provided, including reference to the requirements designated for this test in the Verification Requirements Traceability Matrix (VRTM).

10.4 References. Reference documents applicable to the test shall be listed. Such references shall include:

d. Test Plan (Ref. applicable sections)

e. Test Procedure (Ref. applicable sections)

f. Specification for the functions tested

Preparation Instructions Continued

10.5 Test Article Description. A general description of the test article shall be provided that:

g. Identifies whether a full or partial system configuration was utilized (if partial, identify specific parts included or left out, whichever is shorter, along with rationale for using partial configuration).

h. Identifies quantity of site configurable components utilized in test configuration.

i. Identifies the number of hardware, software, and adaptation configurations used in this test. If more than one configuration is used, identify all configurations and provide rationale for each.

j. Includes test configuration diagrams for each configuration used in the test.

k. References to the Product Configuration Document (PCD) included as an attachment to this document.

l. Identifies location of the test article (i.e. factory, on-site).

10.6 Test Equipment. A list of all test equipment, including manufacturer, model, calibration status, and serial number shall be included. Reference may be made to the applicable Test Log entry numbers or Test Readiness Review (TRR) materials included as attachments to this document.

10.7 Test Tools. A list of all system, test, and Data Reduction and Analysis (DR&A) software and adaptation utilized shall be provided, identifying title, release level, and release date.

10.8 Test Approach. A description of the test approach and success criteria utilized to verify each requirement tested shall be provided. Redlines (if any) introduced during test execution shall be accounted for in these descriptions.

10.9 Test Matrix. A test matrix shall be included that provides a summary of the test results. This matrix shall include the following information for each requirement tested in this event:

h. The full text of each requirement.

i. Requirement number, as identified in the VRTM.

j. Identification of whether the requirement has been fully or partially verified by this test event.

k. Procedure section in which the requirement is addressed. If a requirement is addressed in multiple sections, a separate line item shall be provided for each procedure section in which it is addressed.

l. Pass/Fail status of the requirement as a result of this test event. If a requirement is addressed in multiple sections of the procedure, a pass/fail status for each section and an overall status for the requirement shall be provided.

m. Identify whether regression testing is planned for further verification of each requirement as a result of test failure or planned fixes resulting from a System Problem Report (SPR) that may affect performance of that requirement.

n. Identify any SPRs by number that were generated during this test event that impact the pass/fail status of each requirement. A full copy of each SPR listed shall be included as an attachment to this document.

10.10 Regression Testing. A complete description of any planned or actual regression test activities as a result of SPRs generated during execution of this test event due to test failures or other noted system anomalies shall be provided. This description shall include reference to the specific test case, section, and steps that need to be executed from the test procedure or indicate that new or additional steps must be generated to address the SPR.)

Preparation Instructions Continued

10.11 Action Items Matrix. A matrix identifying all Action Items (AIs) generated as a result of this test event during:

d. Test Readiness Review (TRR)

e. Test conduct (from test log entries)

f. Test de-briefs The Action Item matrix shall include the following information:

f. The unique identification number assigned to each AI

g. Full text description of each AI

h. Indication of the Open/Closed status of each AI

i. Resolution and description of action(s) taken up to the time of report submittal for each AI

j. SPR number, if any, for any SPRs generated in connection with or for closure of each AI.

An SPR shall be generated for each AI that remains open at the time of submittal for this Test Report, with a copy of each SPR attached to the report as an appendix.

10.12 Test Results. Detailed test results, including the items listed below shall be provided:

f. An assessment of results obtained with respect to the defined success criteria, including conclusions regarding pass/fail status of each requirement.

g. A discussion of any raw or reduced data that either provides the basis for or directly supports conclusions regarding the pass/fail status of each requirement or group of requirements. This shall include an explanation of how the data presented supports the pass/fail status assigned to related requirements. Any graphical or tabular outputs produced by data analysis tools along with a detailed description of what is depicted or represented by each figure or table shall also be included.

h. Reference to the applicable Test Plan and Test Procedure sections that generated the results for each requirement.

i. A discussion of any SPRs generated during test conduct that includes a detailed description of the discrepancy, references the SPR number, references the procedure step at which the discrepancy occurred, references the Test Log entry describing the discrepancy, and assesses the impact of the discrepancy on the validity of preceding or following steps of the procedure. A full copy of each SPR generated shall be included as an appendix to this document.

j. A discussion of any Action Items (AIs) generated during test conduct that includes a detailed description of the issue, references the AI number, references the procedure step at which the issue was written, references the Test Log entry describing the issue, and assesses the expected impact of the issue on the validity of preceding or following steps of the procedure.

10.13 Discrepancy Reports. A full text copy of each SPR generated as a result of this test event shall be included as an appendix to this document. These copies shall include the latest status and closure action information available from the SPR database at the time this Test Report is submitted.

10.14 Test Evaluation. An overall analysis of the functional performance of the article tested shall be provided. This analysis shall describe the functional capability as it was demonstrated in the test, noting any specific deficiencies (making reference to SPRs) that were discovered. A general statement shall be provided for each MTP requirement deficiency that references the SPR. This statement shall describe the impact of the SPR on system design performance if the deficiency detected is retained or corrected. Other test events shall be identified that address each requirement that is only partially allocated to this test.

10.15 Test Results Certification. A certification shall be provided that the test results are authentic, accurate, current, and in accordance with related requirements and test plans. The names of Contractor and Government personnel present during the test shall be included.

10.16 As-Run Procedures. A full copy of the as-run Test Procedures, with recorded results, signatures, and all red-lines introduced during test execution shall be provided as an appendix to this document.

Preparation Instructions Continued

10.19 Test Log. A complete copy of all Test Logs generated during test execution and signed by both the Government test witness and the Contractor shall be included as an appendix to this document.

The Test Log shall include, at a minimum, the following:

m. The name and organization of all personnel involved in the conduct or witnessing of the test.

n. Date and time of each event documented in the test log.

o. A pre-test briefing summary prior to test execution.

p. Date and start and stop times of the test.

q. Configuration changes.

r. System status at start of test, including system health and security status.

s. Procedure deviations and redlines.

t. Problems encountered or unexpected events, including affected test steps, and any subsequent recommendations and resolutions.

u. Effect of deviations or problems on test validity.

v. System problem reports generated or identified during the test, including affected test steps.

w. Action Items generated during the test, including affected test steps.

x. Pass/fail status of each test event.

10.20 Test Readiness Review (TRR) materials. A full copy of all materials presented at the TRR conducted for this test event shall be included as an appendix to this document.

11. Distribution Statement

DATA ITEM DESCRIPTION

3. Description/Purpose

The Contractor Acceptance Inspection (CAI) confirms that the RIPSA First Article system is ready for Field Checkout and that the FAA assumes ownership of the system.

TBD

7. Application/Interrelationship

This Data Item Description (DID) is a checklist item to verify that the Contractor Acceptance Inspection (CAI) meeting was conducted in accordance with the requirements specified in this procurement.

N/A

A017

10. Preparation Instructions

10.1 Inspection Certification. A certification shall be provided that the test results are authentic, accurate, current, and in accordance with related requirements and test plans. The names of Contractor and Government personnel present during the test shall be included. Contractor shall use J009 for Certification.

11. Distribution Statement

DATA ITEM DESCRIPTION

3. Description/Purpose

The Contractor Field Checkout confirms that the RIPSA First Article system is ready for Operational Testing.

TBD

7. Application/Interrelationship

This Data Item Description (DID) is a checklist item to verify that the Field Checkout meeting was conducted in accordance with the requirements specified in this procurement.

N/A

B007

10. Preparation Instructions

10.1 Inspection Certification. A certification shall be provided that the test results are authentic, accurate, current, and in accordance with related requirements and test plans. The names of Contractor and Government personnel present during the test shall be included. Contractor shall use J010 for Certification.

11. Distribution Statement