Attachment_01_Peformance_Work_Statement_R01.docx

AFMC OO-ALC/OBH

Maintenance Training Branch Hill Air Force Base (AFB), Utah

Instructional System Development and Training Services (ISDTS)

Performance Work Statement (PWS)

13 May 2019

Revision 01 07 August 2019

Prepared by:

Air Force Materiel Command Ogden Air Logistics Complex

(AFMC OO-ALC/OBH)

6092 Fir Lane Bldg. 1231, Rm 19 Hill AFB, UT 84056-5820

Table of Contents

1.0 SCOPE

The Instructional Systems Development Training Services program supports training and related tasks for the Ogden Air Logistics Complex (OO-ALC) Utah and Continental United States (CONUS) Geographically Separated Units (GSUs) including but not limited to: Arizona, Aerospace Maintenance and Regeneration Group Davis-Monthan AFB; California, Vandenburg AFB; Montana, Malstrom AFB; North Dakota, Minot AFB; Texas, Randolph AFB; and Wyoming FE Warren AFB, as outlined in this Performance Work Statement (PWS).

Individual Task Order (TO) requirements will specifically define locations requiring support, primary work areas, project requirements and deliverables, project scheduling, and other related performance criteria. Representative task services include: instructional system design, training courseware development, training support, and instructional process improvement services as detailed in paragraph 2.0 and subparagraphs below.

No part of this PWS, the basic contract, or any Task Order issued under the basic contract shall be construed to require the Contractor to provide personal services to the Government. The Contractor shall comply with this PWS in its entirety.

2.0 DESCRIPTION OF SERVICES

This PWS describes general training related requirements from AFMC OO-ALC and their customers. Contractor responsibilities shall include staffing positions with qualified personnel to fulfill requirements of this basic contract and specific task assignments as designated by individual Task Orders. This contract covers the following training support categories: Instructional System Development, Training Instruction, Training Related Services, and Instructional Process Improvement.

The Contractor shall be capable of managing multiple Task Order sites simultaneously. Multiple sites is defined as two or more sites requiring separate workloads to be completed in different locations identified in paragraph 1.0 of this PWS. The individual Task Orders will define the location, base, GSU or squadron, and skill set in which the work will be performed. The Contractor shall support multiple new Task Orders. New Task Orders may be issued while the Contractor is maintaining an existing Task Order, which may or may not be in the same location, base, GSU or squadron as the new Task Orders.

2.1 Instructional Systems Development (ISD)

The Contractor shall provide experienced and qualified courseware developers to perform activities associated with the Air Force Instructional System Design (ISD) process. This process is a lockstep approach which includes: analyses, design, development, testing, validation, and implementation of training courseware material using AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide, when finalized and released, and AFH 36-2235, Information for Designers of Instructional Systems (V1-13). The Contractor shall adhere to Air Force ISD requirements format and content standards identified in Appendix A.

2.2 Training Instruction

The Contractor shall provide experienced and qualified instructors to conduct formal and/or informal courses to AFMC OO-ALC/OBH trainers and AFMC OO-ALC/OBH customers. The Contractor shall perform training events and other instructor duties as defined at the Task Order level. Contractor shall, when requested, have the capability to outsource by partnering with commercial training organizations, industrial companies, colleges, universities, and agencies to instruct commercial-off-the-shelf and/or targeted (customized) training events.

2.3 Training Related Services

The Contractor shall provide experienced and qualified personnel to perform training related services such as testing proctor, for the efficient and effective operations of AFMC OO-ALC/OBH and their customer processes as detailed by individual Task Orders.

2.4 Instructional Process Improvement

The Contractor shall provide experienced and qualified personnel to perform process assessments, system analysis, complex program evaluations, expert advice, technology adoption, and training for the effective improvement and efficient operation of AFMC OO-ALC/OBH and their customer processes. (CDRL A004)

2.5 Labor Resources

The Contractor shall provide all qualified personnel as specified in individual Task Orders. The Contractor shall be responsible for the selection, recruitment, hiring, assignment of duties, and reassignment of duties, transfer, supervision, management, control, and termination of Contractor employees in performance of ISDTS requirements. Contractor personnel are employees of the Contractor and under its administrative control and supervision. The Contractor and its employees shall not supervise, direct or control the activities of Government personnel or the employees of any other contractor. The Contractor shall immediately contact Contracting Officer’s Representative(s) (COR) and Wide Area Work Flow (WAWF) Invoice Acceptor(s) when any personnel changes or vacancies occur after individual Task Order awards.

The objectives and requirements identified within this PWS are described in general terms. Each Task Order will specifically address skill set, task requirements, deliverables, project scheduling, and other related performance criteria. The Contractor shall fully staff positions identified at the Task Order level with qualified personnel detailed in Appendix B. The Contractor shall provide first right of refusal and make a good faith effort to retain qualified incumbent personnel in order to satisfy customer and Task Order requirements.

2.6 Presentation Materials

In rendering the foregoing services, outputs may take the form of information, advice, opinions, alternatives, analyses, evaluations, recommendations, training, and/or services to complement the Government’s technical expertise in accomplishing its mission. The nature of this work will at times require the Contractor be capable of quick response to stringent deadlines. All materials produced remain the property of the Government with unlimited data rights and no license encumbrances, and shall be delivered as detailed in individual Task Order requirements. (CDRL A005)

3.0 SERVICE SUMMARY

The services summary table for the basic contract is listed below. Specific performance objectives and thresholds unique to the Task Order requirement will be identified in its associated PWS. Circumstances or external influences beyond the control of the Contractor which impact the ability of the Contractor to meet performance standards will not affect Contractor performance measurements. The Government will determine which circumstances or external influences are beyond the Contractor’s control.

· Instructional systems are delivered within fourteen days of the agreed scheduled date 95% of the time during Task Order period of performance. The remaining 5% will be rescheduled according to Government program account manager directions.

· Instructional systems are satisfactory or higher on 95% of the product during Task Order period of performance. The remaining 5% will be resolved according to Government program account manager directions.

· Instructors are available 95% of the time during Task Order period of performance. The remaining 5% Contractor provides a qualified replacement.

· Student feedback is satisfactory or higher on 85% of the surveys during Task Order period of performance.

· Customer feedback is satisfactory or higher on 95% of the surveys during Task Order period of performance.

· Administer Certification Tests and report results to applicable Group Training Office 100% of the time.

· Process improvement services are satisfactory or higher on 95% of the tasking during Task Order period of performance. The remaining 5% will be resolved according to Government program account manager directions.

The Government will provide workspace, working supplies, furniture, and access to business telephones (for business purposes only), computer facilities and computer time as required to on-site Contractor personnel at no cost to the Contractor. Contractor-owned or operated software may be utilized; however, the software must meet all security requirements for Government-owned software contained in AFMAN 17-1203 Information Technology (IT) Asset Management (ITAM) and other AFMC base supplements which may apply. The Contractor must provide to the Government “Proof-of-License Ownership”, which may include software user manuals, purchase documentation, compact disks, etc. These shall be stored by the Government in a secure location (e.g., a locked file cabinet). Additionally, annual inventory will be taken on all installed software to ensure license compliance.

4.2 Information Resources

The Government shall provide the Contractor access to required non-classified technical data; Government information management systems; “dot mil” websites; Government learning management systems; and Government courseware repositories in support of the development effort. The Government will provide the Contractor access to personnel, work areas, facilities and property in support of the development effort.

The Government will not supervise or otherwise direct Contractor employees. The Government will inspect Contractor performance IAW clauses included in the contract and each respective Task Order.

5.2 Familiarization Point of Contact

The Contractor shall request all requirements regarding contract performance of services and duties from the OO-ALC/OBH Program Manager or Contract Officer Representative (COR).

5.3 Task Order Period of Performance

The period of performance for Task Orders against this Indefinite Delivery/Indefinite Quantity (IDIQ) contract will be identified at the respective Task Order level.

5.4 Place of Performance

Unless otherwise specified in the Task Orders, the primary work location will be at the Government’s AFMC OO-ALC training or industrial facilities located at Hill AFB, Utah.

5.5 Hours of Operation

The Contractor shall perform services during OO-ALC hours of operations. The flexible schedule of the OO-ALC operates from 5:00 a.m. to 6:00 p.m. Monday through Friday. The Contractor is responsible for designating work hours for their employees but at a minimum shall be available as required by the Government according to the area assigned. This may vary depending on location, project, Task Order, or event.

5.6 Attendance

The Contractor shall perform services required under this contract per OO-ALC production work schedules. Specific work schedules will be defined in each Task Order. Contractors may align with a 40-hour work week or with the Government’s “5-4-9” schedule (i.e., 1st week: 4 days of 9-hour days and Friday 8-hour day; 2nd week: 4 days of 9-hour days). However, the Government reserves the right to mandate a 40-hour work week for full-time employees which will be determined at the TO level.

Unless otherwise required by the Government, the Contractor shall not have access to Government facilities to work on the following federal holidays: New Year’s Day, Martin Luther King Jr.’s Day, President’s Day, Memorial Day, Independence Day, Labor Day, Columbus Day, Veterans’ Day, Thanksgiving Day, and Christmas Day.

If the federal holiday falls on Sunday, it is observed on the subsequent Monday. If the holiday falls on Saturday, it is observed on the preceding Friday. There may also be up to six AFMC Goal Days and four Wingman Days per year awarded to Government civilian employees, as well as possible weather-related days and Government directed holidays. On these days, the Contractor shall not generally be required to work and the Government shall not be billed for work not performed.

NOTE: Good Friday is regarded as a holiday by the Utah Wage Determination; however, Good Friday is not a Federal Holiday. Government facilities will remain open for work. The Contractor shall plan on employees working business as usual on Good Friday, unless the Government supervisor or section chief determines such services are either unnecessary or will be less-than a normal workday.

5.7 Travel

On occasion, employees may be required at a location necessitating travel. These locations shall be considered TDY locations. When the Government requests travel, the travel expenses shall be reimbursed per the DoD Joint Travel Regulation, and are subject to cost limitations under FAR 31.205-46. The Contractor shall be responsible for making all necessary travel, car rental, lodging arrangements, and subsistence requirements for their personnel to support the Task Order requirements. Travel is restricted to round trip coach/economy airfare tickets, economy class car rental, and per diem rates not to exceed Federal Travel Regulation (FTR) rates for the TDY location. Travel will be funded as required at the Task Order level. All travel shall be performed on a firm-fixed-price basis. The travel CLIN will not be used for the Post-Award Conference. Receipts for Contractor travel will be provided to the COR for validation. Following travel, the Contractor shall provide applicable expenditure documentation, IAW FAR 31.205-46, as attachments to their WAWF request for payment within five workdays after completion of the trip.

The Contractor shall be responsible for ensuring proper procedures for Contractor personnel access to travel locations are adhered to by the Contractor to include, but not limited to, completion of Visit Requests and other travel documentation necessary for access.

Travel must be approved by the squadron flight chief and coordinated through the COR to the PCO in advance of the Contractor arranging travel. The Government will determine when Contractor travel may be required and provide the Contractor no-less-than 5 business days’ notice.

5.8 Installation-Specific Safety and Health Standards

The Air Force Sustainment Center (AFSC) has adopted the Occupational Safety and Health Administration (OSHA) Voluntary Protection Program (VPP). Consequently, VPP impacts all “applicable contractors” operating on AFSC Installations. It is the Contractor’s responsibility to ensure its employees and managers have a comprehensive understanding of VPP, as well as full compliance with OSHA requirements. Contractors (to include applicable contractors), whether regularly involved in routine site operations or engaged in temporary projects such as construction or repair, must follow the safety and health rules of the installation or VPP site. Detailed information regarding the Voluntary Protection Program is available on the OSHA website (http://www.osha.gov/dcsp/vpp/index.html).

VPP requirements apply to contractors whose employees work more than 1,000 hours per quarter collectively. The contractor shall flow-down these requirements to all subcontractors who qualify as applicable contractors under this contract.

Total Case Incident Rate/Days Away Restricted or Transferred (TCIR/DART) Reporting: Contractors are required to provide from their OSHA 300 information the TCIR/DART rate by 15 January of each year to the COR for submission as part of the installation's annual OSHA VPP self-evaluation report. (CDRL A001)

Quality Program Plan: In compliance with the clause entitled “Inspection of Services”, 52.246-4, the Contractor shall establish a complete Quality Program Plan to ensure the requirements of this contract are provided as specified; Contractor format is acceptable. The Contracting Officer will notify the Contractor of acceptance or required modifications to the plan before the contract start date. The Contractor shall make appropriate modifications at no additional costs to the Government, and obtain acceptance of the plan by the Contracting Officer before the start of the first operational performance period. (CDRL A002)

5.9.2 Quality Assurance

The Government will periodically evaluate the Contractor’s performance IAW the Service Delivery Summary at Section 2.0 to ensure services are received. The Contracting Officer’s Representative will evaluate the Contractor’s performance through intermittent on-site inspections of the Contractor’s quality control program and receipt of complaints from Base personnel. The Government may inspect each task or activity as completed or increase the number of quality control inspections if deemed appropriate because of repeated failures discovered during quality control inspections or because of repeated customer complaints. Likewise, the Government may decrease the number of quality control inspections if merited by performance. The Contractor shall be responsible for initially validating customer complaints. The Government will also investigate complaints received from various customers located on the installation; however, the Contracting Officer’s Representative shall make final determination of the validity of customer complaint(s) in cases of disagreement with customer(s) and provide for resolution.

5.10 Contracting Officer’s Representative (COR)

The COR is a representative(s) of the Contracting Officer and will participate in the administration of this contract. Subsequent to contract award, the identity of the COR(s) and a brief list of their duties and authority will be promptly furnished to the successful offeror.

The COR(s) or alternate(s) will inform the Contractor when discrepancies occur and will request corrective action. The COR(s) or alternate(s) will make a notation of discrepancies , the date and time the discrepancy was noted, and request the contractor to initial the entry on a surveillance report.

Any matter concerning a change to the scope, price, terms, or conditions of this contract shall be referred to the Contracting Officer only.

The services to be performed by the Contractor during the period of this contract at all times and places shall be subject to review by the Contracting Officer or authorized representative(s).

5.11 Management Plan

The Contractor shall produce a Management Plan which includes a program schedule, time line, and milestones for each Task Order, as required by the Task Order PWS. The Management Plan shall be submitted to the AFMC OO-ALC/OBHB Contract Manager Specialist (COR) no later than 30 calendar days after the start of the Task Order. (CDRL A003)

5.12 Status Report

A Monthly Status Report which includes activities accomplished during the period, any obstacles encountered and corrective action taken, any delays and a schedule to correct them, number of personnel certification completions or exam vouchers issued, financial and labor hours status, and a forecast for work to be accomplished in the upcoming month, is due within 10 business days after the end of each month of report to the AFMC OO-ALC/OBHB Contract Manager Specialist (COR). (CDRL A001)

5.13 Contractor Manpower Reporting

The Contractor shall report ALL Contractor labor hours (including subcontractor labor hours) required for performance of services provided under this contract for Instructional System Development and Training Services via a secure data collection site. The Contractor is required to completely fill in all required data fields at http://www.ecmra.mil.

Reporting inputs will be for the labor executed during the period of performance for each Government fiscal year (FY from 01 October through 30 September. While inputs may be reported any time during the FY, all data shall be reported no-later-than 31 October of each calendar year. Contractors may direct questions to the Contractor Manpower Reporting Application (CMRA) help desk.

Information from the secure web site is considered to be proprietary in nature when the contract number and Contractor identity are associated with the direct labor hours and direct labor dollars. At no time will any data be released to the public with the Contractor name and contract number associated with the data.

Data for Air Force service requirements must be input at the Air Force CMRA link. User manuals for Government personnel and contractors are available at the Army CMRA link at http://www.ecmra.mil.

The Unit Identification Code (UIC) will be provided at the Task Order level.

5.14 Hill AFB ISD Evaluation Reviewer

The Government shall periodically evaluate the Contractor’s performance through reviews of activities and deliverables. The Hill AFB ISD Evaluation Reviewer ensures:

(1) the content of the training has been validated by subject matter experts as being accurate and complete

(2) the training meets the defined training need and the technical specifications of this requirements document

(3) all courseware activities and deliverables comply with the AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide and Air Force ISD AFH 36-2235 Volumes 1-13, Information for Designers of Instructional Systems process standards and formats.

The Hill AFB ISD Evaluation Reviewer shall submit ISD Evaluation Reviewer Review Notes to the Contractor developer with requested corrective actions and/or authority to move to the next phase of development activities.

5.15 Reporting Deficiencies

The Hill AFB Courseware Manager or AFMC OO-ALC/OBH management representative shall inform the COR in person when corrective actions have been requested but not accomplished, or when a customer complaint, validated by the COR, has not been resolved.

The Contractor shall comply with DoD, Air Force, and AFB location specific security requirements which pertain to this contract. The Contractor must meet the same security requirements as Government employees for access to the Government installation’s network, and Automated Information Systems (AIS).

The Contractor shall ensure all employees possess the required security clearance and base access requirements upon the start of Task Order period of performance (post ramp up period); including favorable Local File Check, Contractors are required to report in a timely manner (3 days) to the appropriate security manager & Functional System Administrator, personnel who no longer need network or AIS access.

Access to the Hill AFB computer network will be required to accomplish the requirements of this PWS. The following must be completed prior to receiving that access:

5.16.1.1 Personnel Security Investigations

Personnel security investigations National Agency Check (NAC) or Single Scope Background Investigation AFMAN 16-1405 Air Force Personnel Security Program. Favorable or higher adjudication by Air Force or other authorized Central Adjudication Facility based on NACI or higher personnel security investigation. The process to establish personnel security requirements can be lengthy, several months in some cases. Ensure all personnel requiring security clearance have such and are updated in Joint Personnel Adjudication System (JPAS) prior to start of performance period.

5.16.1.2 Total Force Awareness Training

Contractor employees requiring a Government provided e-mail account shall complete Total Force Awareness Training (TFAT). The Contractor is required to fill out an AF Form 4394, Air Force User Agreement Statement - Notice and Consent Provision form and take the Cyber Awareness Challenge (Latest Version) training (included in TFAT), and annually thereafter. This training is currently available at https://golearn.adls.af.mil/.

5.16.1.3 OPSEC Training

Contractors who have access to OO-ALC and satellite operating locations facilities or critical information shall have OPSEC training IAW AFI 10-701 Operations Security. Initial training will be approximately 1 hour and follow-on recurring annual training will be approximately 0.5 hours. The Government will provide the necessary Hill AFB specific training and or training materials to include, but not limited to, Control Access and OPSEC and area specific safety and security training. Contractor shall develop and maintain training and briefing records for all personnel attending Contractor and Government furnished training and briefings, and make records available to the COR upon request.

5.16.2 Personnel Identification Badge

For a CAC to be issued to the Contractor, an AFMC Form 496 Application for Identification Card/DEERS Enrollment shall be submitted to the individual Task Order Office of Primary Responsibility for processing. The Contractor shall be required to complete and submit an AFMC Form 496 for each of the contract employees who must have access to the installation. Ensure all personnel requiring CACs have such prior to start of Task Order performance period.

The Contractor Verification System Trusted Agent for the using activity will verify personnel security requirements are met prior to completing each Contractor employee’s application to be issued a Common Access Card ID. Payment of the contract may be delayed or denied if Contractor employees fail to properly return access credentials such as CAC, visitor passes, Installation Access Credentials, and AF Form 1199 (Air Force Entry Control Card).

5.16.3 Controlled Area Badge and Key Card

The using activity shall complete an “Unescorted Entry Authorization Certificate” (AF Form 2586) for each employee requiring entry into controlled areas. The request shall be submitted to Pass and Registration visitor center.

5.16.4 Physical Security

The Contractor shall be responsible for safeguarding all Government property provided for Contractor use. At the close of each work period, Government facilities, property, and materials shall be secured. Contractor personnel shall turn in keys/key cards upon expiration of the contract. The Contractor shall establish and implement methods of ensuring that all keys/key cards issued to the Contractor by the Government are not lost or misplaced and are not used by unauthorized persons.

The Contractor shall establish and implement methods of making sure all keys, vindicator cards, and building badges issued to the Contractor by the Government are not lost, misplaced, or used by unauthorized persons. The Contractor shall immediately report the occurrence of a lost key to the Government program manager. Contractor shall not duplicate any keys issued by the Government.

The Contractor shall prohibit the use of keys issued by the Government by any persons other than the Contractor’s employees. The Contractor shall prohibit the opening of locked areas by Contractor employees to permit entrance of persons other than Contractor employees engaged in the performance of assigned work in those areas, or personnel authorized entrance by Security Managers.

5.17 Conservation of Utilities

The Contractor shall instruct employees in utilities conservation practices. The Contractor shall be responsible for operating under conditions which prevent the waste of utilities which include the following:

Lights shall be used only in areas where and when work is actually being performed.

Mechanical equipment controls for heating, ventilation, and air conditioning systems shall not be adjusted by the Contractor or by Contractor employees unless authorized.

Water faucets or valves shall be turned off after the required use has been accomplished.

Government telephones shall be used only for official Government business.

5.18 Records

The Contractor shall be responsible for creating, maintaining, and disposing of only those Government required records that are specifically cited in this PWS. If requested by the Government, the Contractor shall provide the original record or a reproducible copy of any such record within five working days of receipt of the request.

The contractor shall provide a Transition Plan as part of the initial proposal. The Transition Plan shall address how the Contractor shall provide staffing to meet all requirements of an orderly stand up of new workload and continuous operation without negative impact on Government operations in the time frame required. The incoming Contractor is responsible for all efforts and material related to transition. This transition shall be accomplished in accordance with the Transition Plan, which is incorporated into the contract.

6.1.1 Contractor Responsibilities during Transition

The Contractor shall ensure all employees possess required training, qualifications, proficiency, and security clearances and satisfy all other access requirements prior to commencing Task Order performance following the transition period (e.g., day one of the Task Order period of performance [POP]). The Contractor shall have up to 30 days to complete the transition period or such time as otherwise agreed upon in writing (as defined at the Task Order level) from date of Task Order award to ensure an orderly transition from the incumbent or stand up manning for new workload. If recruiting includes employees not currently employed by the contractor, the plan shall support the intent to hire.

6.1.2 Transition Phase-In

Transition-in is defined as the time in days from Task Order award until the last date prior to the start of the specified start date in the Task Order POP. Task order POP is defined as the first day of hands-on labor performance and the day after the transition period ends.

6.2 Transition Phase-Out (CDRL A006)

The incumbent Contractor shall provide Contract Officer and COR a written comprehensive plan explaining actions required to complete the total transition effort within a sixty (60) calendar day transition period. The incumbent Contractor shall also provide familiarization to the gaining organization if there is a change in Contractor, or if the operation reverts to the Government. During the phase-out familiarization period, the incumbent shall be fully responsible for continuation of their current Task Orders. In the event the follow-on contract is awarded to other than the incumbent, the incumbent Contractor will cooperate to the extent required to permit an orderly change over to the successful Contractor.

Not less than 30 days before completion of the contract, the incumbent contractor is required to furnish to the Contracting Officer and COR a certified list of the names of all service employees working under the contract and its subcontracts at the time the list is submitted. The certified list must contain training and certification records and anniversary dates of employment of each service employee under the contract and subcontracts for services.

Appendices and Publications, Instructions and Reference Websites

Appendices A. Instructional Systems Development Activities B. Labor Resource Descriptions and Categories C. Safety, Fire Protection and Health Specification Industrial Safety Requirements (N/A) D. Acronyms & Abbreviations List E. FOUO/OPSEC Description

Publications and Instructions AFI 10-701, Operations Security, (8 Jun 2011) AFMAN 16-1405, Air Force Personnel Security Program, (1 Aug 2018) AFMAN 17-1203, Information Technology Asset Management, (18 May 2018) AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide AFH 36-2235 Volumes 1-13, Information for Designers of Instr Sys, (1 Nov 2002) AFI 36-2650 AFMCSUP, Maintenance Training, (10 Dec 2015)

Reference Websites AFMC ISD Courseware Resource Site: https://cs2.eis.af.mil/sites/21109/ISD/default.aspx Air Force Instruction, Publications and Forms: http://www.e-publishing.af.mil/ Contract Labor Hours, per PWS 5.12: http://www.ecmra.mil FAR, DFARS, AFFARS, AFMC MP: http://farsite.hill.af.mil/ Federal Acquisition Regulations (FAR): https://www.acquisition.gov/ OSHA: https://www.osha.gov Rehabilitation Act, Section 508, 36 CFR Part 1194: http://www.section508.gov Training Mgmt. Site (TSS/CMD): https://ooafmctss.hill.af.mil/tssportal/Default.aspx#TSSPortal VPP: http://www.osha.gov/dcsp/vpp/index.html WAWF: https://wawf.eb.mil/

*Note: Websites are Subject to Change

Appendix A: INSTRUCTIONAL SYSTEMS DEVELOPMENT ACTIVITIES In order to adhere to local ISD requirements, format, and content standards, the Contractor shall comply with the following subordinate paragraphs when developing courseware:

A.1 Analysis Phase Activities Perform analysis activities using AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide, planning PDS, and associated documentation to begin development of assigned courseware. Under the direction from the ISD Evaluation Reviewer or assigned AFMC OO-ALC/OBH program manager, establish precisely which topics should be included in the training based on interaction with applicable program managers, supervisors, subject matter experts, etc. The Contractor shall document findings, reports, and timelines in the Courseware Management Data Base at least weekly.

Activity 1 - Schedule a Course Development Kickoff Meeting

Before starting the courseware development project, coordinate with the Hill AFB Courseware Manager to schedule a meeting with the assigned ISD Evaluation Reviewer, Lead Subject Matter Expert(s), and appropriate Functional Training Managers, Program Managers, etc., to discuss the scope and schedule of the project, and to clearly define the roles and expectations of all participants. The Hill AFB Courseware Manager shall identify Government participants and send out the meeting request to ensure appropriate level of Government support. The Contractor shall annotate project analysis activities in the AFMC Courseware Management Database (CMD) to show the dates activities are started and completed.

Activity 2 - Establish an Analysis Project Activity in the AFMC Courseware Management Database

The Contractor shall use guidance from the planning phase PDS, ISD Evaluation Reviewer or AFMC OO-ALC/OBH Courseware Manager to establish an Analysis Project Activity in the AFMC CMD and enter or attach information about all Analysis Phase Activities throughout this phase in the project. Annotate Project Analysis Activities in the CMD to show the dates that this activity is started and completed.

Activity 3 - Conduct a Knowledge/Task Analysis

The Contractor shall conduct knowledge/task analysis using information from planning phase PDS, subject matter experts, and/or Program Managers. Obtain direction from the ISD Evaluation Reviewer or AFMC OO-ALC/OBH program manager for guidance. Determine precisely which knowledge and/or performance tasks should be included in the training based on discussions with applicable experts. Define what knowledge must be demonstrated and what tasks must be performed, the conditions under which they are to be demonstrated/performed, and the standards that must be achieved in the course. Review knowledge and task statements which can be used to (1) develop learning objectives for the modules and (2) sequence the training within the course. Annotate project analysis activities in the CMD to show the dates activities are started and completed.

Activity 4 - Conduct a Target Audience Analysis

The Contractor shall analyze the demographics of the target audience and guidance from the ISD Evaluation Reviewer or AFMC OO-ALC/OBH Program Manager. Recommend the most effective approaches to instruction and identify any student prerequisites needed for the course. Deliver target audience analysis documentation which describes the demographics of the target population, defines instructional approaches which will be most effective, and identifies any student prerequisites needed for the course. Annotate project analysis activities in the CMD to show the dates activities are started and completed.

Activity 5 - Conduct a Learning Analysis

The Contractor shall analyze the knowledge and tasks which will be covered in the course and direction from the ISD Evaluation Reviewer or AFMC OO-ALC/OBH program manager for guidance. Determine the types of learning involved and the proficiency levels of learning the customer organization expects the students to attain at the completion of the training. Deliver learning analysis documentation that defines the types and proficiency levels of learning to the ISD Evaluation Reviewer prior to the ISD Evaluation Reviewer Analysis Phase Review. Annotate project analysis activities in the CMD to show the dates activities are started and completed.

Activity 6 - Modify Instructional Strategy as Needed

The Contractor shall validate data from planning phase PDS, integrate information from Analysis Phase activities, and modify the plan for developing and delivering new or significantly revised courseware. Identify if changes to the courseware project will require any modification to the PDS.

Activity 7 - Participate in ISD Evaluation Review of Analysis Phase Activities

The Contractor shall arrange for Hill AFB ISD Evaluation review of Analysis Phase activities through the ISD Evaluation Reviewer before proceeding with Design Phase activities. Deliver task/knowledge, target audience, and learning analysis documentation along with ISD Evaluation Reviewer worksheet. Comply with any outstanding items identified in the review. Annotate project analysis activities in the CMD to show the dates activities are started and completed.

A.2 Design Phase Activities

The Contractor shall develop training material design which complies with the principles of Air Force ISD using guidance in AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide, the ISD Evaluation Reviewer, or the respective AFMC OO-ALC/OBH program manager. Comply with the most current Rehabilitation Act, Section 508, 36 CFR Part 1194 as defined on http://www.section508.gov. If self-paced, computer-based or Web-based interactive learning instruction is needed, training shall be Sharable Content Object Reference Model (SCORM) conformant to the most current version. Determine which design activities should be included in the training based on interaction with applicable program managers, supervisors, subject matter experts, and previous research. Document the findings, reports, and timelines in the CMD at least weekly.

Activity 8 - Establish a Design Project Activity in the AFMC Courseware Management Database

The Contractor shall use guidance from the ISD Evaluation Reviewer or AFMC OO-ALC/OBH Courseware Manager to establish a Design Project Activity in the AFMC CMD and enter or attach information about all Design Phase Activities throughout this phase in the project.

Activity 9 - Plan integration of Existing Materials

The Contractor shall determine how to incorporate any available content (e.g., directives, technical data, working aids, courseware, vendor instruction, etc.) which meets part of the defined instructional requirement into the course or learning aid being developed, if applicable. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 10 - Write Learning Objectives

The Contractor shall develop and write learning objectives for the course using direction from the ISD Evaluation Reviewer for guidance. Deliver a set of precise learning objective statements which contains the condition as to how training will be provided or will emulate actual conditions in the work environment, identifies and describes a single behavior the student is expected to either gain knowledge about or demonstrate to the level of proficiency set by the customer, and a standard of acceptable behavior which is criterion-referenced and closely relates to actual standards required in the work environment. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 11 - Design Test and Measurement Materials

Based on the results of the objectives developed and proficiency levels set, the Contractor shall select the methods of informal assessment (such as student exercises, progress checks, written tests which do not require a passing score, etc.) and formal evaluation (such as written or performance tests which students must pass to complete the course) which will be utilized. Use input from program managers, supervisors, and subject matter experts etc. to develop a draft set of test and measurement materials. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 12 - Design self-paced, computer-based or Web-based interactive learning

The Contractor shall finalize selection of content, media, instructional methods/tools, and student evaluation methods/tools which will be used. Create a detailed outline of the self-paced, computer-based or Web-based interactive learning course or learning aid using information from the ISD Evaluation Reviewer for guidance. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 13 - Design Non-Computer-Based Instruction

The Contractor shall finalize selection of the media, instructional methods/tools, and student evaluation methods/tools which will be used and create a detailed outline of the course or learning aid, using direction from the ISD Evaluation Reviewer for guidance. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 14 - Review Design of self-paced, computer-based or Web-based interactive learning

The Contractor shall coordinate with subject matter experts, subject area Program Managers, system OPRs, instructors, courseware developers, information technology experts, etc., to review the overall design of the computer-based instruction and the draft evaluation materials before the content is written for the entire course. Only minor changes to design of the self-paced, computer-based or Web-based interactive learning course or learning aid are permitted after closeout of this Activity. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 15 - Review Design of Non-Computer-Based Instruction

The Contractor shall coordinate with subject matter experts, subject area Program Managers, system OPRs, instructors, courseware developers, information technology experts, etc., to review the overall design of the training and the evaluation material before the instructional materials are prepared for final development and make revisions as required. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 16 - Write Content for Entire self-paced, computer-based or Web-based interactive learning Course

The Contractor shall create a draft of all course content for the self-paced, computer-based or Web-based interactive learning course or learning aid to be reviewed by customer for accuracy. Utilize story boards which include course sequencing, identification of instructional activities, media to be used, and evaluation materials. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 17 - Review Content for Entire self-paced, computer-based or Web-based interactive learning Course

The Contractor shall coordinate with subject matter experts, subject area Program Managers, system OPRs, instructors, courseware developers, information technology experts, etc. to review self-paced, computer-based or Web-based interactive learning sequence, appearance, content, and proposed functionality before production development, and make revisions as required. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 18 - Design and Review of Initial Segment for self-paced, computer-based or Web-based interactive learning Instruction

The Contractor shall create a representative segment of the actual instruction which shows how the screens will look, how the content will appear, how the navigational buttons will operate, how the narrator will sound, how the interactivity will work, etc. Have subject matter experts, subject area Program Managers, system OPRs, training managers, self-paced, computer-based or Web-based interactive learning experts and students from the target population review the functional representative segment of the actual instruction. Only minor corrections to content will be permitted after the review and changes are implemented. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 19 - Finalize Reusable Knowledge Object (RKO) Assessment

The Contractor shall determine the reusability of components being developed or revised.

Activity 20 - Finalize Sharable Content Object (SCO) Assessment

The Contractor shall determine the final SCO level needed for the self-paced, computer-based or Web-based interactive learning course based on planning initial estimation, designed components, and customer requirements. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

Activity 21 - Participate in ISD Evaluation Review of Design Phase Activities.

The Contractor shall arrange for Hill AFB ISD Evaluation review of Design Phase activities through the ISD Evaluation Reviewer before proceeding with Development Phase activities. Deliver designed materials documentation along with ISD Evaluation Reviewer worksheet. Comply with any outstanding items identified in the review. Annotate Project Design Activities in the CMD to show the dates activities are started and completed.

A.3 Development Phase Activities

Develop instructional materials which comply with the principles of Air Force ISD using guidance in AFMCMAN 36-301, AFMC Functional Courseware Development and Management Guide, the ISD Evaluation Reviewer, or the AFMC OO-ALC/OBH Program Manager. Comply with the most current Rehabilitation Act, Section 508, 36 CFR Part 1194 as defined on http://www.section508.gov. Self-paced, computer-based or Web-based interactive learning instruction will be Sharable Content Object Reference Model (SCORM) conformant to the most current version. Determine which development activities should be included in the training based on interaction with applicable program managers, supervisors, subject matter experts etc. and previous research. Document the development processes and timelines in the Courseware Management Data Base Project Activities.

Activity 22 - Revise Evaluation Materials as Needed

The Contractor shall finalize and update any evaluation materials prepared during the Design phase.