Fighter OTES DRAFT PWS.docx

DRAFT

AIR FORCE OPERATIONAL TEST AND EVALUATION CENTER (AFOTEC) FIGHTER OPERATIONAL TEST AND EVALUATION SERVICES (FIGHTER OTES) PERFORMANCE WORK STATEMENT (PWS)

15 July 2010

TABLE OF CONTENTS

2.0 APPLICABLE DOCUMENTS 5

4.0 PERFORMANCE REPORTING 10

AIR FORCE OPERATIONAL TEST AND EVALUATION CENTER (AFOTEC)

FIGHTER OPERATIONAL TEST AND EVALUATION SERVICES (FIGHTER OTES)

PERFORMANCE WORK STATEMENT (PWS)

1.0 SCOPE

The objective of this acquisition is to obtain operational test and evaluation (OT&E) services in response to task orders issued by the contracting officer related to the OT&E of proposed fighter systems and programs. Services include a broad range of engineering, technical, and analytical test services in support of OT&E activities. OT&E activities include integrated test functions for Air Force and Multiservice fighter aircraft acquisition programs; test design; test planning, execution, and reporting; post test data analysis; information assurance evaluation, digital test tool development and associated tool training; special studies and analysis; and, research and development of test capability requirements, shortfalls, and solutions.

The scope of this acquisition is to provide engineering, technical and analytical services to support accomplishment of AFOTEC Detachment 1 (Det) and Det 6’s OT&E activities using the following core competencies:

Core Competencies

Low Observable (LO) Maintainability and Supportability

Crypto-key Management

Aerospace Ground Equipment (AGE)

Support Equipment (SE)

Fighter Airframe and Powerplant

Aircraft Structures

Fighter Aircraft Avionics, Electrical and Environmental

Fighter Weapons Loading and Alternate Mission Equipment (AME)

Fighter Life Support and Survival Equipment

Computerized Maintenance Management Systems

Fighter Logistics (home station and deployed)

Maintenance Training Systems

Joint Reliability and Maintainability Evaluation Team (JRMET)

Information Operations (IO) specifically Information Assurance (IA) and Electronic Warfare (EW)

Interoperability

Mission Planning

Fighter LO Employment, Tactics, Concept of Operations (CONOPS)

Advanced Sensors (AESA Radar, RF, EO, IR)

Sensor Fusion

Fighter Performance

Fighter Datalinks (Link 16, IFDL, MADL)

Aircrew Training Systems

Scenario Development including red/blue capabilities

Multirole Fighter Aircrew

Programmer/software engineer/Database Management

Fighter Test Instrumentation and Real-time/Post flight data processing

Mission Level, Man-in-the-Loop Modeling and Simulation (Requirements and VV&A)

Fighter Weapons Effectiveness Analysis

Air-to-Air Range Infrastructure (AARI)

Intel/Operations Debriefing

Range Training Officer/Kill Removal Officer (Red Flag, Cope Thunder or similar)

Range Requirements/Coordination/Scheduling

Operations Analysis (including Math/Statistics/DOE, data analysis)

Flight Test Execution and Analysis

The Contractor shall support task orders for various test and evaluation efforts and phases, consisting of various sizes and complexities of Department of Defense related systems, where a system is understood to be an assembly or combination of interrelated elements (hardware, software, materiel, training, tactics, or procedures) working together toward a common objective or performance requirement.

Each task order shall direct tasks in one or more areas specified in Section 3.0 of this PWS. The potential places of performance include Edwards AFB, CA, Nellis AFB, NV, any Det 1 or Det 6 geographically separated unit (GSU) or operating location (OL), any government test range and contractor test facilities. Current OL and GSU locations include Fort Worth, TX, Arlington, VA and, Norfolk, VA. This effort applies only to Det 1 and Det 6 operating locations:

Each approved task order may identify: the objective, scope, specific work location(s), background, applicable documents, technical requirements, desirable skill set (core competency), period of performance and required schedule, data items, deliverables, government property and any other considerations for each task.

In rendering services to the identified tasks, outputs may take the form of information, advice, opinions, alternatives, analyses, evaluations, recommendations, and/or services to complement the Government’s technical expertise in accomplishing its mission.

1.1 Background. The overarching functions of Test and Evaluation (T&E) are to mature system designs, manage risks, identify and help resolve deficiencies as early as possible, and ensure systems are operationally mission capable (i.e., effective and suitable). AFOTEC is responsible for planning, executing, and reporting independent OT&E. AFOTEC supports Air Force, DoD and other government agencies by:

· Testing and evaluating new weapon system capabilities in operationally realistic battlespace environments to provide independent, fact-based, decision-quality data to inform decision makers on a range of accurate, balanced, and timely assessments of effectiveness, suitability, and mission capability

1. Conducting and/or participating in the following types of testing: Initial Operational Test and Evaluation (IOT&E); Follow-on Operational Test and Evaluation (FOT&E): Multi-Service OT&E (MOT&E); Qualification OT&E (QOT&E); and others as defined in AFI 99-103

· Achieving positive effect on air, space and cyberspace capabilities through early influence of capability requirements development, early acquisition strategy/planning efforts, integrated development/operational testing, and timely operational test reporting

· Directly supporting Air Force Goals: Sustain air, space, and cyberspace capabilities; and, foster Air Force Smart Operations across the Total Air Force

AFOTEC Det 1, headquartered at Edwards AFB, CA, serves as the lead Operational Test Agency (OTA) for the multi-service, multi-national Operational Test and Evaluation (OT&E) of the F-35 Air System. In addition to AFOTEC, the Joint Strike Fighter (JSF) Operational Test Team (JOTT) consists of IOT&E participants from other OTAs that include the United States Navy/United States Marine Corps (USN/USMC) Commander, Operational Test and Evaluation Force (COMOPTEVFOR) and the United Kingdom (UK) Air Warfare Centre (AWC). Other international participants may be added to the JOTT. The F-35 OT&E will consist of multiple Operational Assessments (OA), OT&E, and Initial Operational Test and Evaluation (IOT&E). Associate Contractor Agreements (ACA) may be required as detailed in the task orders. The contractor shall work in a joint and combined test team environment where F-35 OT&E products are developed and coordinated with the Air Force, Navy, USMC, and UK Air Warfare Centre (AWC) team members.

AFOTEC Det 6, headquartered at Nellis AFB, NV, is the lead for all other AFOTEC fighter and fighter system OT&E to include the F-22, F-15C, F-15E, F-16, and A-10 aircraft and related systems such as targeting pods and data links.

2.0 APPLICABLE DOCUMENTS

Applicable guidance consists of Department of Defense, Air Force and AFOTEC documents associated with requirements definition, acquisition, and test and evaluation. The contractor shall use the most current version. Key documents applicable to this PWS are listed in the table below. The government documents cited as references in this PWS are available electronically and well be provide by AFOTEC only if not readily available from publically accessible sources. Each task order will identify unique guidance not contained herein.

Paragraphs 2.12 and 2.24

Paragraphs 3.2, 3.3, 3.8, 3.9, 3.13, 3.14, 7.1, 7.2 and 7.5-7.11

DoD 5400.7-R AF Supplement

3.0 PERFORMANCE REQUIREMENTS

The contractor shall perform requirements within the service task areas listed in this section. Task orders will identify specific tasks for completion within a specific period of time. The contractor shall initiate no work under a task order without approval by the contracting officer. These efforts apply to new and legacy fighter aircraft and associated systems.

3.1 Management Requirements. The contractor shall:

3.1.1 Prepare task order proposals in support of task order performance requirements in accordance with the task order procedures set forth in Section H. Identify and propose mitigation for any organizational conflict of interest associated with supporting each task order. Task management costs, both direct and indirect, shall be reflected for each task order. The contractor shall identify an appropriate management approach for each task order and shall be required to submit corrective management plans as necessary.

3.1.2 Be responsible for overall responsiveness, cost control and reporting, adherence to schedule, ability to adapt to schedule changes, responsible and cooperative behavior, data management, technical quality of work, management of contractor team’s efforts including level of understanding of AFOTEC’s mission and commitment to customer satisfaction.

3.1.3 Maintain a Quality Control Program (QCP) that ensures the government receives the level of quality that is consistent with the requirements specified in each task order.

3.1.4 Be responsible for risk identification and mitigation associated with supporting each task order.

3.1.5 Include a method for information flow/sharing between test programs including both Det 1 and Det 6 task orders.

3.2 Test Capabilities. Test capabilities consist of infrastructure (ranges, simulators, labs, instrumentation, etc.), modeling and simulation tools, data management and analysis tools, analytical methodologies and techniques used to support OT&E. Test capability activities are the formal processes of identifying/developing test capability requirements, shortfalls, and solutions. Activities include identifying test capability requirements, documenting existing test capabilities, identifying shortfalls, performing trade-off analyses, and recommending approaches to solve issues.

The contractor shall:

3.2.1 Perform analysis of test capabilities. Activities include: identifying test capability requirements, documenting existing test capabilities, identifying shortfalls, performing trade-off analyses, and recommending approaches to solve issues.

3.2.2 Identify, develop, modify, verify, and/or validate modeling and simulation tools such as constructive tools that represent real world entities by means of computer models, virtual tools involving real people operating simulated systems and live tools involving real people operating real systems.

3.2.3 Participate, develop, and/or update modeling and simulation (M&S) verification, validation, and accreditation (VV&A) plans and/or reports.

3.2.4 Maintain configuration management of developed and modified tools.

3.2.5 Train government personnel in the operation, interpretation of outputs, and maintenance of contractor developed test tools such as computer software, applications, instrumentation, and models and simulations.

3.2.6 Identify, develop, and/or apply analytical techniques, methodologies, and tools for OT&E.

3.2.7 Identify, develop, recommend, and/or integrate test capabilities for ranges, and ways to use test capabilities to answer operational questions.

3.2.8 Provide input to assist with developing and coordinating annual forecasts for munitions, missiles, targets, and expendables.

3.2.9 Develop an instrumentation plan for system under test (SUT). Identify instrumentation system requirements and document system design in an interface control document (ICD) or appropriate document.

3.2.10 Develop and/or integrate COTS based data and graphical analysis tools that are capable of high fidelity mission data replay using any combination of aircraft, M&S, and/or /range instrumentation truth data.

3.2.11 Provide system level/test methodology training in subject matter expert (SME) areas to appropriate government personnel using continuity books, briefings, and on the job training.

3.2.12 Identify and document modifications to Air-to-Air Range Infrastructure (AARI) graphical displays, user interfaces, and weapon models beyond existing AARI toolset to meet test execution and data requirements. Work on-site with AARI development team .

3.2.13 Perform fighter weaponeering including weapons analysis, infrared and radar missiles, and fighter expendables and countermeasures.

3.2.14 Develop and deliver combined OT&E briefings and debriefings for program/OT&E events.

3.3 Test Planning. Test planning focuses on developing test designs/concepts, supporting program/technical reviews, developing test plans, developing Data Management and Analysis Plans (DMAP), establishing deficiency reporting, supporting test readiness reviews, and developing briefings.

The contractor shall:

3.3.1 Provide input to develop and/or revise the Initial Test Design (ITD), the Test Concept, and the Design of Experiment.

3.3.2 Provide input to develop and/or revise the evaluation framework.

3.3.3 Provide input to develop and/or revise the basis of estimate for test resources (e.g. test resource plan) to accomplish the test design.

3.3.4 Review for test and evaluation considerations and document feedback on program documents such as the: program management directive (PMD), any capabilities documents, system threat assessment report (STAR), test and evaluation master plan (TEMP), lifecycle management plan (LCMP), Program Protection documents, and concepts of operations and maintenance.

3.3.5 Participate as an Integrated Test Team member to gain knowledge of Integrated Developmental Test/Operational Test (IDT/OT) activities.

3.3.6 Identify OT&E test planning requirements and design priorities in order to eliminate redundancies between the DT&E and the OT&E program.

3.3.7 Prepare, submit and/or revise AFOTEC portions of test documentation such as test team charters, test and evaluation master plans (TEMPs), integrated test plans, OT&E plans, data management and analysis plans (DMAPs), detailed test procedures, test planning briefings, and schedules.

3.3.8 Provide input in developing critical operational issues (COIs), measures of effectiveness (MOE) and measures of suitability (MOS).

3.3.9 Provide input into developing test methodologies and test scenarios for AFOTEC, DOT&E, and program special interest items.

3.3.10 Analyze and submit test methodologies, test scenario descriptions, test measures, test risk/ limitation and mitigation strategies, and test readiness and support requirements needed to complete the OT&E plan.

3.3.11 Provide input in developing operational test scenarios.

3.3.12 Perform site surveys on potential test sites, and prepare site preparation requirements such as defining site-specific installation, integration, preparation of environmental permit plans, and integration of AFOTEC equipment with equipment available from other agencies or host areas.

3.3.13 Provide environmental health and safety planning services for test programs addressing occupational health, and environmental concerns.

3.3.14 Identify, describe, and/or apply distributed test techniques and real-time simulations to enable interactions among many users.

3.3.15 Identify and describe data requirements and specific data processing and analysis tools needed to complete the Data Management and Analysis Plan (DMAP).

3.3.16 Review and incorporate joint and combined Lessons Learned from other OT&E efforts into Det 1 and Det 6 test plans and execution.

3.3.17 Develop, propose staff coordination, and provide configuration control for OT&E Test Plans, briefings, reports and other related program documents. All product timelines shall be linked to program requirements or current OT schedule.

3.3.18 Develop program introduction documents (PIDs) for the appropriate range support.

3.3.19 Provide input in developing the Joint Reliability and Maintainability Evaluation Team (JRMET) charter.

3.3.20 Prepare and track status of deficiency reports.

3.3.21 Support Readiness to Test (RTT) planning, tracking, resolution, and checklist items.

3.3.22 Prepare for the conduct of OT control room White Force command and control operations during test trials. Define white force tasks (i.e. white force commander, kill removal officers, lead analyst, and observers) task rehearsals, and post trial debriefing efforts.

3.3.23 Develop and/or present talking papers or briefings on OT&E efforts to various meetings and conferences.

3.4 Test Execution. Consists of all activities associated with executing the T&E plan with identified resources. The contractor shall:

3.4.1 Provide field operations services such as deployment/redeployment, requesting/scheduling/ tracking of test equipment resources, identifying/preparing test equipment, and calibrating test instrumentation and site support equipment with onsite equipment and power.

3.4.2 Provide safety services such as ground, flight, and environmental protection support in compliance with safety, occupational health, and environmental concerns/regulations.

3.4.3 Participate in the execution of test plans, data management and analysis plans, and detailed test procedures.

3.4.4 Use, develop, modify, and/or maintain the required automated data collection/reduction systems to include developing interfaces with existing digital information stored on available databases. Analyze content for interoperability and compatibility with existing information (data) systems.

3.4.5 Conduct OT&E control room White Force command and control operations during test trials including white force tasks (i.e. white force commander, kill removal officers, analyst, and observers) task rehearsals, and post trial debriefing efforts.

3.4.6 Participate in and collect data from DT&E operations to support Integrated DT/OT.

3.5 Test Evaluation. Test evaluation determines if the system under test meets the warfighter’s mission needs, in addition to system requirements as outlined in the program requirement documents.

The contractor shall:

3.5.1 Collect, compile, review, and analyze test data.

3.5.2 Run computer models and simulations and analyze/characterize the resulting output.

3.5.3 Conduct studies, analyses and evaluations on operation effectiveness, suitability and mission capability of weapon system programs undergoing OT&E.

3.5.4 Conduct analyses and evaluations for AFOTEC, DOT&E, and program special interest items.

3.5.5 Participate in the Joint Reliability and Maintainability Evaluation Team (JRMET) and attend on-going meetings to provide subject matter expertise on the accuracy and completeness of the JRMET process and charter, joint logistics modeling and simulation, joint deficiency reporting (DR) system, and the system design and development (SDD) verification and validation and accreditation (VV&A) process. Report findings.

3.6 Test Reporting. Test reporting consists of communicating the analysis and evaluation of test results. Test reporting may be required in any multimedia format.

The contractor shall:

3.6.1 Prepare test documentation for inclusion in Test & Evaluation reports.

3.6.2 Participate with government personnel in the research and preparation of audio, animation, video, graphics, and still pictures and insert into test plans, reports and associated briefings.

3.6.3 Prepare and/or present briefings as a part of the report coordination process.

3.6.4 Prepare lessons learned reports.

3.6.5 Participate in the development of quick-look, interim, and final reports. Contractor shall also be prepared to brief SME areas to associated audiences as pertaining to these reports.

3.7 Program Protection Support Service Requirements. The contractor shall support the program protection support service requirements of this effort.

The contractor shall:

3.7.1 Follow public laws, Country MOUs, DoD, AF, and AFOTEC regulations that require the protection of information. This protection shall be built into all joint and combined OT&E activities. The contractor shall provide input for the conduct of program security risk assessments to include threat and vulnerability analyses. The contractor shall provide inputs for the development and implementation of plans to mitigate security risks, which include foreign country participation, test range operations, education, training, and countermeasures. The contractor shall participate in the efforts to provide security support such as the monitoring and execution of International Traffic in Arms Regulation (ITAR) requirements, information security, computer security, communications security, and operations security.

4.0 SERVICE SUMMARY ITEMS

4.1 Contracting Officer Representatives (CORs) will use Table 4.1 as a guide when identifying service summary items in Task Orders.

Table 4.1 Service Summary

5.0 GENERAL INFORMATION

5.1 Government Furnished Property – Base Support. When the Task Order requires the Contactor to work in a Government facility, the Government may furnish or make available working space, equipment, and network access. Copies of required materials cited in the RFP, PWS, DD Form 254, and/or in the Task Order may be provided to the contractor in hard copy or soft copy. All materials will remain the property of the Government and will be returned to the COR upon request or at the end of the Task Order period of performance.

5.2 Travel Requirements. Contractor employees may be required to travel to various locations both CONUS and outside the continental United States (OCONUS) in performance of Task Orders. For OCONUS travel, contractor employees shall possess passports, visas, and medical clearance for designated operations areas. The Government will not directly reimburse the contractor for these types of expenses. Travel will be cost reimbursable (no fee) in accordance with the Joint Travel Regulation (JTR). Contractors will not be required to price any travel costs on task orders. Ceilings will be established at time of award of each individual task order where the ceilings shall be inclusive of all indirect costs.

5.3 Transition. It is anticipated that some important work will be in progress through the phase-in and phase-out periods of this contract. Interruptions or delays to the work would impact the mission. It is essential that attention be given to minimizing the interruption. Therefore, the contract must provide for maximum cooperation between successor and incumbent while insuring that no work receives inadequate attention during phase-in/phase-out. The contractor shall plan for the transfer of work control delineating the method for processing and assigning tasks during phase-in/phase-out.

5.3.1 Phase-In. As a successor, the Fighter OTES contractor shall insure a smooth transition with the incumbent ETS contractor during the phase-in period. The contractor shall develop plans for assumption of awarded Task Orders. The contractor must provide an orderly transition of work acceptance and accomplishment so that impact to program is minimized.

5.3.2 Phase-Out. The Fighter OTES incumbent shall ensure a smooth transition with the successor during phase-in period, prior to completion of contractual performance. The contractor shall aid the successor in the development of plans, procedures and methods for assumption of all on-going work. The contractor must provide an orderly transition of work acceptance and accomplishment so that full control by the successor is achieved by the end of the new phase-in period.

5.3.3 Associate Contractor Agreements. The Contractor may enter into Associate Contractor Agreements (ACA) for portions of individual Task Orders requiring joint participation in the accomplishment of the Government’s requirement. The agreements shall include the basis for sharing information, data, technical knowledge, expertise, and/or resources essential to the integration of Task Order requirements, which shall ensure the greatest degree of cooperation to meet the terms of the Task Order.

6.0 SECURITY REQUIREMENTS

6.1 Security Clearances. The contractor shall comply with the security requirements in accordance with DD Form 254, DoD Contractor Security Classification Specification. Additionally, the contractor shall:

6.1.1 Possess or obtain a facility security clearance at the minimum classification level identified in each Task Order prior to performing contract work. If the contractor does not possess a facility clearance the government will request one.

6.1.2 Process classified visits via the Joint Personnel Adjudication System (JPAS) in support of tasks within Department of Defense (DoD). Classified visits outside DoD require Visit Authorization Letters (VALs) IAW the National Industrial Security Program Operating Manuel (NISPOM).

6.1.3 Maintain a current listing of employees. The list shall include the employee's name, social security number, and level of security clearance. The list shall be validated and signed by the company Facility Security Officer (FSO), and provided to the Sponsoring Agencies Security Manager. An updated listing shall be provided when an employee's status or information changes.

6.2 Safeguarding Information. The contractor shall:

6.2.1 Comply with DoD 5400.7-R, Chapter 4, DoD Freedom of Information Act (FOIA) Program, and AFI 33-332, Privacy Act Program requirements. These regulations set policy and procedures for the disclosure of records to the public and for marking, handling, transmitting and safeguarding FOUO material.

6.2.2 Report to an appropriate authority any information or circumstances of which they are aware may pose a threat to the security of DOD personnel, contractor personnel, resources and classified or unclassified defense information. Contractor employees shall be briefed by their immediate supervisor upon initial on-base assignment.

image1.jpeg