Draft OTES PWS.pdf

AIR FORCE OPERATIONAL TEST AND EVALUATION CENTER (AFOTEC)

OPERATIONAL TEST AND EVALUATION SERVICES (OTES)

PERFORMANCE WORK STATEMENT (PWS)

10 Nov 2009

TABLE OF CONTENTS

1.0 SCOPE

1.1 Background

2.0 APPLICABLE DOCUMENTS

3.0 PERFORMANCE REQUIREMENTS

3.1 Management Requirements

3.2 Test Capabilities

3.3 Test Planning

3.4 Test Execution

3.5 Test Evaluation

3.6 Test Reporting

4.0 PERFORMANCE REPORTING

5.0 GENERAL INFORMATION

5.1 Government-Furnished Property

5.2 Travel Requirements

5.3 Transition

6.0 SECURITY REQUIREMENTS

6.1 Security Clearances

6.2 Safeguarding Information

AIR FORCE OPERATIONAL TEST AND EVALUATION CENTER (AFOTEC)

OPERATIONAL TEST AND EVALUATION SERVICES (OTES)

PERFORMANCE WORK STATEMENT (PWS)

1.0 SCOPE

The objective of this acquisition is to obtain operational test and evaluation (OT&E) services in response to task orders issued by the contracting officer related to the OT&E of proposed systems and programs. Services include a broad range of engineering, technical, and analytical test services in support of OT&E activities. OT&E activities include integrated test functions for Air Force and Multiservice air, space and cyberspace acquisition programs; test design; test planning, execution, and reporting; post test data analysis; information assurance evaluation, digital test tool development and associated tool training; special studies and analysis; and, research and development of test capability requirements, shortfalls, and solutions.

The scope of this acquisition is to provide engineering, technical and analytical services to support accomplishment of AFOTEC’s OT&E activities using the following core competencies:

Core Competencies T&E capability knowledge (including test infrastructure capabilities, distributed test capabilities, integrated test capabilities, survivability testing) Systems Engineering (air, space, cyberspace) Operations Analysis (including Math/Statistics/DOE, data analysis) Logistics Planning and Analysis Software/Communications Engineering Aerospace Engineering EW/Radar/IR/EO Engineering Information Assurance evaluation knowledge Defense Acquisition process and T&E process knowledge Modeling and Simulation applications (including verification, validation and accreditation process knowledge) Human Factors Engineering (or Engineering Psychology or Behavior Science) Weather Analysis Directed Energy and Advanced Technologies expertise

The Contractor shall support task orders for various test and evaluation efforts and phases, consisting of various sizes and complexities of Department of Defense related systems, where a system is understood to be an assembly or combination of interrelated elements (hardware, software, materiel, training, tactics, or procedures) working together toward a common objective or performance requirement.

Each task order shall direct tasks in one or more areas specified in Section 3.0 of this

PWS. The potential places of performance include Kirtland AFB (Headquarters AFOTEC), any AFOTEC geographically separated unit (detachment) or operating location with an AFOTEC test activity, and any government test range. This effort applies only to the following Detachment and operating locations: Edwards AFB, CA (Det 5); Eglin AFB, FL (Det 2); Peterson AFB, CO (Det 4); Buckley AFB, CO (OL-BC), and Hurlburt AFB, FL (OL-HF). It does not apply to fighter programs supported by Edwards AFB, CA (Det 1) or Nellis AFB, NV (Det 6).

Each approved task order will identify: the objective, scope, specific work location(s), background, technical requirements, desirable skill set (core competency), the period of performance and the required schedule, data items, deliverables, and any other considerations for each task.

In rendering services to the identified tasks, outputs may take the form of information, advice, opinions, alternatives, analyses, evaluations, recommendations, and/or services to complement the Government’s technical expertise in accomplishing its mission.

1.1 Background. The overarching functions of Test and Evaluation (T&E) are to mature system designs, manage risks, identify and help resolve deficiencies as early as possible, and ensure systems are operationally mission capable (i.e., effective and suitable).

AFOTEC is responsible for planning, executing, and reporting independent OT&E.

AFOTEC supports Air Force, DoD and other government agencies by:

• Testing and evaluating new weapon system capabilities in operationally realistic battlespace environments to provide independent, fact-based, decision-quality data to inform decision makers on a range of accurate, balanced, and timely assessments of effectiveness, suitability, and mission capability

• Conducting and/or participating in the following types of testing: Initial Operational Test and Evaluation (IOT&E); Multi-Service OT&E (MOT&E);

Qualification OT&E (QOT&E); and others as defined in AFI 99-103

• Achieving positive effect on air, space and cyberspace capabilities through early influence of capability requirements development, early acquisition strategy/planning efforts, integrated development/operational testing, and timely operational test reporting

• Directly supporting Air Force Goals: Sustain air, space, and cyberspace capabilities; and, foster Air Force Smart Operations across the Total Air Force

AFOTEC testing activities evaluate the capabilities (operational effectiveness, operational suitability, and mission capability) of air, space and cyberspace systems such as: aircraft; missiles; motor vehicles; communications; ordinance; instrumentation;

computer systems; automated information systems; simulators/trainers; avionics; radar;

laser; directed energy weapons; satellites; weather systems; air traffic control and landing systems; command, control, communications, computer, intelligence, surveillance, and reconnaissance (C4ISR) systems; combat support systems; electronic warfare systems;

and, augmentations of these systems by new technologies in the future.

2.0 APPLICABLE DOCUMENTS

Applicable guidance consists of Department of Defense, Air Force and AFOTEC documents associated with requirements definition, acquisition, and test and evaluation.

The contractor shall use the most current version. Key documents applicable to this PWS are listed in the table below. The government will furnish the documents cited as references in this PWS. Each task order will identify unique guidance not contained herein.

Reference Title Specific Paragraphs/Chapters/Sections

DoD Directive 5000.01

The Defense Acquisition System

Paragraphs 3 and 4; Enclosure 1

DoD Instruction 5000.02

Operation of the Defense Acquisition System

Paragraph 4; Enclosures 2 (paragraphs 1-7 only), 3-6 and

Defense Acquisition Guidance (DAG)

Interim DAG Chapters 4 and 9

CJCS Instruction 3170.01

Joint Capabilities Integration and Development System

Enclosures A, B and C

AFI 10-601 Capabilities-based Requirements Development

Chapters 2, 4, 5 and 6

AFI 16-1001 Verification, Validation and Accreditation (VV&A)

Sections A, B and C

AFI 16-1002 Modeling and Simulation (M&S) Support to Acquisition

Sections B and C

AFI 63-101 Acquisition and Sustainment Life Cycle Management

Chapters 1 and 3;

Paragraphs 2.12 and 2.24

AFMAN 63-119 Certification of System Readiness for Dedicated Operational Test and Evaluation

Entire document

AFI 99-103 Capabilities-based Test and Evaluation

Chapters 1, 2, 4, 5, 6 and 8;

Paragraphs 3.2, 3.3, 3.8, 3.9, 3.13, 3.14, 7.1, 7.2 and 7.5-7.11

AFOTECI 99-101 Conduct of Operational Test and Evaluation

Entire document

AFOTEC OT&E

Guide

AFOTEC OT&E Guide, 6th Edition

Entire document except chapter

AFOTECPAM 99-

AFOTEC Operational Suitability Test and Evaluation Guide

Entire document

DoDI 8500.2 Information Assurance Implementation

Paragraph 5.12; Enclosures 3 and 4

AFI 33-100 User Responsibilities and Entire document

Guidance for Information Systems

AFI 33-200 Information Assurance Program

Entire document

AFOTEC OT of IA Guide

AFOTEC OT of IA Guide, 2nd Edition, chg 1

Entire document

DoD 5400.7-R DoD Freedom of Information Act (FOIA) Program

Chapter 4

AFI 33-332 Privacy Act Program Chapters 10 and 12

3.0 PERFORMANCE REQUIREMENTS

The contractor shall perform requirements within the service task areas listed in this section. Task orders will identify specific tasks for completion within a specified period of time. The contractor shall initiate no work under a task order without approval by the contracting officer. These efforts apply to new and legacy systems, and emerging weapons technologies.

3.1 Management Requirements. The contractor shall:

3.1.1 Prepare task order proposals describing management and technical approach in support of task order performance requirements in accordance with the task order procedures set forth in Section H. Identify and propose mitigation for any organizational conflict of interest associated with supporting each task order. Task management costs, both direct and indirect, shall be reflected for each task order.

The contractor shall identify an appropriate management approach for each task order and shall be required to submit corrective management plans as necessary.

3.1.2 Be responsible for overall responsiveness, cost control and reporting, adherence to schedule, ability to adapt to schedule changes, responsible and cooperative behavior, data management, technical quality of work, management of contractor team’s efforts including level of understanding of AFOTEC’s mission and commitment to customer satisfaction.

3.1.3 Maintain a Quality Control Program (QCP) that ensures the government receives the level of quality that is consistent with the requirements specified in each task order.

3.1.4 Be responsible for risk identification and mitigation associated with supporting each task order.

3.2 Test Capabilities. Test capabilities consist of infrastructure (ranges, simulators, labs instrumentation, etc.), modeling and simulation tools, data management and analysis tools, analytical methodologies and techniques used to support OT&E. Test capability activities are the formal processes of identifying/developing test capability requirements, shortfalls, and solutions. Activities include identifying test capability requirements, documenting existing test capabilities, identifying shortfalls, performing trade-off analyses, and recommending approaches to solve issues.

The contractor shall:

3.2.1 Perform analysis of test capabilities. Activities include: identifying test capability requirements, documenting existing test capabilities, identifying shortfalls, performing trade-off analyses, and recommending approaches to solve issues.

3.2.2 Identify, develop, modify, verify, and/or validate modeling and simulation tools such as constructive tools that represent real world entities by means of computer models, virtual tools involving real people operating simulated and live tools involving real people operating real systems.

3.2.3 Develop accreditation plans and/or reports.

3.2.4 Maintain configuration management of developed and modified tools.

3.2.5 Train government personnel in the operation, interpretation of outputs, and maintenance of contractor developed test tools such as computers, instrumentation, and models and simulations.

3.2.6 Identify, develop, and/or apply analytical techniques, methodologies, and tools for

OT&E.

3.2.7 Identify, develop, recommend, and/or integrate test capabilities for ranges, and ways to use test capabilities to answer operational questions.

3.2.8 Provide input to assist with developing and coordinating annual forecasts for munitions, missiles, targets, and foreign material expendables.

3.3 Test Planning. Test planning focuses on developing test designs/concepts, supporting program/technical reviews, developing test plans, developing DMAPs, establishing deficiency reporting, supporting test readiness reviews, and developing briefings.

The contractor shall:

3.3.1 Provide input to develop and/or revise the Initial Test Design (ITD).

3.3.2 Provide input to develop and/or revise the evaluation framework.

3.3.3 Provide input to develop and/or revise the basis of estimate for test resources (e.g.

test resource plan) to accomplish the design.

3.3.4 Review for test and evaluation considerations and document feedback on program documents such as the: program management directive (PMD), any capabilities documents, system threat assessment report (STAR), test and evaluation master plan (TEMP), lifecycle management plan (LCMP), Program Protection documents, and concepts of operations and maintenance.

3.3.5 Participate as an Integrated Test Team member to gain knowledge of Integrated

DT/OT activities.

3.3.6 Prepare, submit and/or revise AFOTEC portions of test documentation such as test team charters, test and evaluation master plans (TEMPs), integrated test plans, OT&E plans, data management and analysis plans (DMAPs), detailed test procedures, test planning briefings, and schedules.

3.3.7 Provide input in developing critical operational issues (COIs), measures of effectiveness (MOE) and measures of suitability (MOS).

3.3.8 Analyze and submit test methodologies, test scenario descriptions, test measures, test risk/ limitation and mitigation strategies, and test readiness and support requirements needed to complete the OT&E plan.

3.3.9 Provide input in developing operational test scenarios.

3.3.10 Perform site surveys on potential test sites, and prepare site preparation requirements such as defining site-specific installation, integration, preparation of environmental permit plans, and integration of AFOTEC equipment with equipment available from other agencies or host areas.

3.3.11 Provide environmental health and safety planning services for test programs addressing occupational health, and environmental concerns.

3.3.12 Identify and describe distributed test techniques and real-time simulations to enable interactions among many users.

3.3.13 Identify and describe data requirements and specific data processing and analysis tools needed to complete the Data Management and Analysis Plan (DMAP).

3.4 Text Execution. Consists of all activities associated with executing the T&E plan with identified resources.

The contractor shall:

3.4.1 Provide field operations services such as deployment/redeployment, requesting/scheduling/tracking of test equipment resources, identifying/preparing test equipment, and calibrating test instrumentation and site support equipment with onsite equipment and power.

3.4.2 Provide airspace/range management services such as providing airspace management for manned aircraft and/or unmanned air vehicles and ground vehicles (UAV and UGV) tests, assessments, and field evaluation activities both within the continental United States (CONUS) and overseas.

3.4.3 Provide safety services such as ground, flight, and environmental protection support in compliance with safety, occupational health, and environmental concerns/regulations.

3.4.4 Participate in the execution of test plans, data management and analysis plans, and detailed test procedures.

3.4.5 Use, develop, modify, and/or maintain the required automated data collection/reduction systems to include developing interfaces with existing digital information stored on available databases. Analyze content for interoperability and compatibility with existing information (data) systems.

3.4.6 Provide evaluation services for special interest items.

3.5 Test Evaluation. Test evaluation determines if the system under test meets the warfighters’ mission needs, in addition to system requirements as outlined in the program requirement documents.

The contractor shall:

3.5.1 Collect, compile, review, and analyze test data.

3.5.2 Run computer models and simulations and analyze/characterize the resulting output.

3.5.3 Conduct studies, analyses and evaluations on operational effectiveness, suitability and survivability of weapon system programs undergoing OT&E.

3.5.4 Determine the capability of a weapon system to withstand a man-made environment and quantify the degree of impairment of its ability to accomplish its designated mission. The environments include: nuclear, conventional, electronic, directed energy, chemical/biological and unconventional operations warfare.

3.6 Test Reporting. Test reporting consists of communicating the analysis and evaluation of test results. Test reporting may be required in any multimedia format.

The contractor shall:

3.6.1 Prepare test documentation for inclusion in Test & Evaluation reports.

3.6.2 Prepare briefings as a part of the report coordination process.

3.6.3 Prepare lessons learned reports.

4.0 PERFORMANCE REPORTING

4.1 Data and documents to be delivered under each authorized task order shall include one or more of the data items listed in Attachment 1 (CDRLs) and on the DD Forms 1423. Deliverable requirements specific to each task will be specified in each individual task order.

4.2 Contracting Officer Technical Representatives (COTRs) will use Table 4.1 as a guide when identifying performance objectives in Task Orders.

Table 4.1 Service Summary Performance Objective PWS

Ref Performance Threshold Method of

Assessment Provide responsive Task Order/team management including quick response to contingencies, Task Order modifications or change orders.

3.1.1 Clear, consistent, and timely written and verbal

communication (i.e., returns phone calls, emails or other communication attempts within 24 hours) with no customer complaints.

Observed

Deliverables are completed in an accurate and timely manner.

All Within each task order, no more than one late document per month and no more than five days late. No more than two sets of corrections/edits and all corrections must be accomplished within two working days.

Monthly Surveillance

Maintains a stable workforce (Effective retention of personnel with the appropriate levels of education, expertise and experience/skill to accomplish the PWS/Task Order)

3.1.1 Personnel turnover rate not to exceed 10%

annually

Annual Surveillance

Contractor successfully meets requirements of Task Order.

All Contractor receives less than two formal customer complaints/contract discrepancy reports per year from all Task Orders. The contractor successfully resolves customer complaints within 10 working days of receipt, 100% of the time.

Monthly Surveillance

Assured Task Order Cost/Schedule Control.

3.1.1 A Monthly Status and Cost Schedule Report will

be used as a tracking tool to identify impact on budget and schedule. Actual task order expenditures shall be within TBD% (Contracting Officer Technical Representative (COTR) determined) of approved projected budget.

Meets task order schedule requirements.

Cost Schedule Report

Comply with applicable portions of the DD Form 254 for Task Order requirements.

All No security violations Observed

5.0 GENERAL INFORMATION

5.1 Government Furnished Property. When the Task Order requires the Contactor to work in a Government facility, the Government may furnish or make available working space, equipment, and network access. Copies of required materials cited in the RFP, PWS, DD Form 254, and/or in the Task Order will be provided to the contractor in hard copy or soft copy. All materials will remain the property of the Government and will be returned to the COTR upon request or at the end of the Task Order period of performance. Headquarters (HQ) AFOTEC members will be available for technical exchanges with the contractor. They will provide technical input, answer questions, review completed work, and provide feedback regarding contractor task order efforts.

5.2 Travel Requirements. Contractor employees may be required to travel to various locations both CONUS and outside the continental United States (OCONUS) in performance of Task Orders. For OCONUS travel, contractor employees shall obtain passports, visas, and medical clearance for designated operations areas. Travel will be cost reimbursable (no fee) in accordance with the Joint Travel Regulation (JTR).

Contractors will not be required to price any travel costs on task orders. Ceilings will be established at time of award of each individual task order where the ceilings shall be inclusive of all indirect costs.

5.3 Transition. It is anticipated that some important work will be in progress through the phase-in and phase-out periods of this contract. Interruptions or delays to the work would impact the mission. It is essential that attention be given to minimizing the interruption. Therefore, the contract must provide for maximum cooperation between successor and incumbent while insuring that no work receives inadequate attention during phase-in/phase-out. The contractor shall plan for the transfer of work control delineating the method for processing and assigning tasks during phase-in/phase-out.

5.3.1 Phase-In. As a successor, the OTES contractor shall insure a smooth transition with the incumbent ETS contractor during the phase-in period. The contractor shall develop plans for assumption of awarded Task Orders. The contractor must provide an orderly transition of work acceptance and accomplishment so that impact to program is minimized.

5.3.2 Phase-Out. The OTES incumbent shall ensure a smooth transition with the successor during phase-in period, prior to completion of contractual performance. The contractor shall aid the successor in the development of plans, procedures and methods for assumption of all on-going work. The contractor must provide an orderly transition of work acceptance and accomplishment so that full control by the successor is achieved by the end of the new phase-in period.

6.0 SECURITY REQUIREMENTS

6.1 Security Clearances. The contractor shall comply with the security requirements in accordance with DD Form 254, DoD Contractor Security Classification Specification.

Additionally, the contractor shall:

6.1.1 Possess or obtain a facility security clearance at the minimum classification level of Secret or higher as identified in each Task Order prior to performing contract work. If the contractor does not possess a facility clearance the government will request one.

6.1.2 Process classified visits via the Joint Personnel Adjudication System (JPAS) in support of tasks within Department of Defense (DoD). Classified visits outside DoD require Visit Authorization Letters (VALs) IAW the National Industrial Security Program Operating Manuel (NISPOM).

6.1.3 Maintain a current listing of employees. The list shall include the employee's name, social security number, and level of security clearance. The list shall be validated and signed by the company Facility Security Officer (FSO), and provided to the Sponsoring Agencies Security Manager. An updated listing shall be provided when an employee's status or information changes.

6.2 Safeguarding Information. The contractor shall:

6.2.1 Comply with DoD 5400.7-R, Chapter 4, DoD Freedom of Information Act (FOIA) Program, and AFI 33-332, Privacy Act Program requirements. These regulations set policy and procedures for the disclosure of records to the public and for marking, handling, transmitting and safeguarding FOUO material.

6.2.2 Report to an appropriate authority any information or circumstances of which they are aware may pose a threat to the security of DOD personnel, contractor personnel, resources and classified or unclassified defense information. Contractor employees shall be briefed by their immediate supervisor upon initial on-base assignment.