QA for Data Driven Test.pdf

Data Driven Test Q&A

1. What are the dollar thresholds for this commercial Software simple acquisition contract? Min/Max.

If there is a specific software needed for this service that USAF TPS does not have, it can be evaluated – there is not a set min/max at this moment.

2. Within a calendar year, what is the expected duration and frequency of each training session?

This course will occur twice a year, once for each respective class cycle (example, one course for 24B in January 2025, and one course for 25A in the late summer/early fall 2025 and so forth) The duration of the course depends on the content and format, based on historical data, USAF TPS expects 60-80 hours of contact time per class (totaling 120-160 hours annually for both classes). 60 hours of instructor contact time annually is expected when it can be scheduled. USAF TPS expects that 4 weeks annually will be necessary to instruct each class and 2 weeks annually will be necessary for instructor training.

3. What is the expected frequency of travel? How often are we expected onsite at Edwards AFB? What other travel if any are expected?

Personnel will be expected to be onsite for the entire duration of the course which will take place twice a year in addition to USAF TPS instructor training when available. Travel to US Naval TPS in Patuxent River, MD will also be expected once the curriculum has been developed for USAF TPS.

4. What time slots are expected for training?

This depends on the content and format of the training – USAF TPS would defer to the contractor with the right to approve and make changes to the structure and time slots.

5. Will the KTR have access to the data sources?

The contractor would have access to USAF TPS curriculum and applicable software to meet learning objectives.

6. Can you share any information on the existing Enterprise Architecture?

This is currently the most up to date strategic architecture for the school:

edwards.af.mil/Portals/50/documents/2024/240295B TPS Strategic Plan_For Release.pdf?ver=S9p8ZErD69saN1eYi-HHjg%3d%3d

7. What is the expected Period of Performance start date?

If awarded, curriculum is anticipated to be developed for approval by USAF TPS in December 2024 and prepared for instruction in January 2025.

https://www.edwards.af.mil/Portals/50/documents/2024/240295B%20TPS%20Strategic%20Plan_For%20Release.pdf?ver=S9p8ZErD69saN1eYi-HHjg%3d%3d https://www.edwards.af.mil/Portals/50/documents/2024/240295B%20TPS%20Strategic%20Plan_For%20Release.pdf?ver=S9p8ZErD69saN1eYi-HHjg%3d%3d

8. What is the expected student capacity during the base year?

35 students are currently enrolled in Class 24B and 25A.

9. What is the expected student enrollment and capacity for each option year?

The enrollment amount should remain between 35-40 students for each cycle (Alpha or Bravo) for a total of up to 80 students a year. This is subject to change within the next 4 years depending on AFTC and USAF TPS requirements for graduates.

10. What constitutes a completed training session? What is the performance metric and guidance?

The performance objectives for the contractor are as follows:

1. The contractor shall be responsible for supporting USAF TPS FTC and/or STC students by developing academic material for USAF TPS students in some or all curriculum areas outlined in Section 1.4.2 of this PWS and the specific task order (1.4.2. is italicized below for reference).

PERFORMANCE THRESHOLD: The contractor provides curriculum materials within deadline set by US government, via a means agreed upon by the US government, in electronic (soft) copy at a minimum, via hard copy if requested, and includes all applicable source documentation, computer code or scripts (Python, Matlab, or other as needed) or other artifacts pertinent to the curriculum materials as needed to continue updating and maintaining the material after delivery.

2. The contractor shall be responsible for supporting USAF TPS FTC and/or STC (and USN TPS students if applicable) students by providing academic instruction of USAF TPS curriculum to achieve all learning objectives as defined within the syllabus for the curriculum topic and the specific task order.

PERFORMANCE THRESHOLD: The contractor provides instruction to USAF TPS students (and USN TPS students if applicable) that facilitates learning in accordance with all applicable USAF TPS learning objectives and outcomes, to include any necessary individual or small-group instruction outside of scheduled, regular curriculum events. Contractors is able to accommodate schedule changes to the maximum reasonable extent. Contractor will conform to all guidance and directives on instruction provided by applicable regulations and procedures, as well as, direction and guidance given by USAF TPs authorities. The contractor communicates any pertinent student performance feedback to USAF TPS/ED division.

Ref: “1.4.2 Curriculum Focus Areas

The contractor shall include content in all of the following curriculum focus areas referenced below.

1.4.2.1 Data-Analysis and Controls for Flight Sciences. Understanding and applying data-driven approaches for the analysis of flight sciences data and learning-based approaches for the control of aircraft. Instruction should focus on the technical underpinnings of data-driven approaches, comparisons and contrasts to classical approaches, and considerations for safe and efficient system characterization, flying qualities/performance testing, and envelope expansion.

1.4.2.2 Data-Driven Analysis and Decision Making for Mission

Systems. Understanding and applying data-driven approaches for perception, navigation, networking, sensor fusion and management, and electronic warfare. Instruction should focus on the technical underpinnings of data-driven approaches, comparisons and contrasts to classical approaches, and considerations for safe and efficient system characterization and testing.

1.4.2.3 Practical Capstone Exercise. Designing and coordinating practical capstone exercises that mimic real developmental flight test and data analysis utilizing the USAF TPS X-62 VISTA, the Joint Simulation Environment, or other suitable systems.”

11. What are the standard training requirements?

The curriculum focus areas are as follows:

Data-Analysis and Controls for Flight Sciences: Understanding and applying data-driven approaches for the analysis of flight sciences data and learning-based approaches for the control of aircraft. Instruction should focus on the technical underpinnings of data-driven approaches, comparisons and contrasts to classical approaches, and considerations for safe and efficient system characterization, flying qualities/performance testing, and envelope expansion.

Data-Driven Analysis and Decision Making for Mission Systems: Understanding and applying data-driven approaches for perception, navigation, networking, sensor fusion and management, and electronic warfare. Instruction should focus on the technical underpinnings of data-driven approaches, comparisons and contrasts to classical approaches, and considerations for safe and efficient system characterization and testing.

Practical Capstone Exercises: Designing and coordinating practical capstone exercises that mimic real developmental flight test and data analysis utilizing the USAF TPS X-62 VISTA, the Joint Simulation Environment, or other suitable systems.

12. Are we expected to create the training curriculum from scratch or are we enhancing existing curriculums?

There are currently no courses for the Data Drive Test Course within the current USAF TPS curriculum. Development of this curriculum will be from scratch and informed by USAF TPS requirements as well as guided by USAF TPS staff feedback prior to instruction.

13. Are one on one trainings/tutorials needed/expected?

The Government is not anticipating one-on-one trainings/tutorials as a focus of this requirement; however, this type of interaction may occur. Instruction for both staff and students is expected to occur in a small to large group setting.

14. Can the Government confirm that training is expected for all pilots or other personnel?

Training will be expected for all enrolled USAF TPS students (pilots, engineers, WSOs, CSOs, operators, etc), as well as applicable USAF TPS staff. USNTPS students and staff will also be included once curriculum has been developed for

USAF TPS.

15. Can some of the trainings be completed remotely?

All trainings must be completed in-person. Remote training may become an option in mission critical circumstances only.

16. Any clearance requirements? Will you support a facility’s clearance for hybrid training?

All trainings must be completed in-person. Hybrid training may become an option for mission critical circumstances only.

17. Item 7 states that this is a request for quote (RFQ), but Item 1 requests a proposal. Are you asking for a full proposal or just a quote?

USAF TPS would like a quote provided in accordance with the solicitation. Thank you.

18. How will the KTR be evaluated on performance?

Below is a service summary:

SS # Performance Objective PWS Paragraph

Performance Threshold

Rating Criteria

The contractor shall be responsible for

1.4.2 Contractor provides

curriculum materials

Exceptional supporting USAF TPS and FTC and/or STC students by developing academic material for USAF TPS students in some or all curriculum areas outlined in Section

1.4.2 of this PWS.

no less than 30 days prior to date instruction commences, via a means agreed upon by the US government, in electronic (soft) copy at a minimum, via hard copy if requested, and includes all applicable source documentation, computer code or scripts (Python, Matlab, or other as needed), or other artifacts pertinent to the curriculum materials as needed to continue updating and maintaining the material after delivery.

Materials Meet Satisfactory criteria. In addition, materials are learner-centered and include real-life, pertinent examples (modern and/or historical as appropriate).

Satisfactory Material meets all Marginal criteria; in addition, Material is well-organized and searchable, free of grammatical errors and in a professional, consistent format.

Marginal Materials delivered on or ahead of schedule via agreed-upon delivery method.

Material includes all necessary supporting documentation or references needed (an example would be a standard atmospheric table if referencing a standard atmosphere).

Materials include any computer code or scripts in all requested formats. Materials meet all applicable learning objectives or outcomes.

Unsatisfactory Any of the following criteria are unsatisfactory:

-Materials not delivered on time

-Materials not delivered via appropriate delivery method.

-Materials do not meet all applicable learning objectives or outcomes.

-Materials lack supporting documentation, source code, or other necessary artifacts to enable student learning.

The contractor shall be responsible for supporting USAF TPS and FTC and/or STC students by providing academic instruction of USAF TPS curriculum to achieve all learning objectives as defined within the syllabus for the curriculum topic.

1.4.4 Contractor provides

instruction to USAF TPS students that facilitates learning in accordance with all applicable USAF TPS learning objectives and outcomes, to include any necessary individual or small-group instruction outside of scheduled, regular curriculum events. Contractor is able to accommodate schedule changes to the maximum reasonable extent.

Contractor will conform to all guidance and directives on instruction provided by applicable regulations and procedures, as well as direction and guidance given by USAF TPS authorities.

Contractor communicates any pertinent student

Exceptional Contractor passes all applicable qualification programs.

Contractor provides instruction that easily fulfills all pertinent learning objectives and outcomes.

Contractor is available for any additional instruction outside of regular, scheduled curriculum events.

Audits of contractor instruction do not yield deficiencies and find exemplary instructional techniques.

Contractor meets all timelines for scheduled events, to include student gradebook inputs if applicable.

Satisfactory Contractor passes all performance feedback to USAFTPS/ED.

applicable qualification programs.

Contractor provides instruction that fulfills all pertinent learning objectives and outcomes. Audits of contractor instruction do not yield major deficiencies.

Marginal Contractor passes all applicable qualification programs.

Contractor provides instruction that fulfills most pertinent learning objectives and outcomes.

Audits of contractor instruction may yield one or two major deficiencies.

Unsatisfactory Any of the following conditions:

-Contractor does not pass all qualification programs.

-Contractor does not instruct to applicable pertinent learning objectives/outcomes.

-Contractor provides instruction that is unsafe or not technically sound.

-Contractor fails to meet established and negotiated timelines.

19. How much curriculum development is expected class to class? What level of effort is projected for short vs long term curriculum development to meet TPS needs?

Curriculum development will be completed first on the front end and then sustained and instructed. Once this contract is awarded curriculum development is expected to occur until Dec 2024 to prepare for instruction in Jan 2025. Future iterations of the course are anticipated to require less curriculum development effort, assuming expectations for course objectives/delivery, and exercise objectives/delivery continue to be met. Future years will likely require the same degree of instructor mentorship to build out data-driven test case studies for existing the full range of TPS courses.

20. For a Firm Fixed Price contract the KTR needs to know what the specific desired outcome of our performance is so they can accurately scope the work to be done and price the work accordingly. Does TPS have more information to provide, defining the specific desired outcomes of the KTR’s performance?

1. Required CDRLs to support curriculum

We will require deliverables such as the course paperwork, the actual curriculum, written events, lab events, exams, instructions, codes for any exercises or learning.

2. What Is the maximum time required per year?

This course will occur twice a year, once for each respective class cycle (example, one course for 24B in January 2025, and one course for 25A in the late summer/early fall 2025 and so forth). The duration of the course depends on the content and format, based on historical data, USAF TPS expects 60-80 hours of contact time per class (totaling 120-160 hours annually for both classes). 60 hours of instructor contact time annually is expected when it can be scheduled. USAF TPS expects that 4 weeks annually will be necessary to instruct each class and 2 weeks annually will be necessary for instructor training.

3. Does TPS require supporting material for Curriculum Planning Council or TPS Master Syllabus as well as material to support each course?

Yes, we will be looking for standard course development products necessary for accreditation including learning objectives aligned to school outcomes, course descriptions for the TPS syllabus, summary of course content and proposed metrics to measure objectives suitable for out brief at the CPC.