Att_1_to_SOW_FSI_Policies_and_Standards.pdf

02/25/2016 1

FSI Policies and Standards for

Curriculum Development and Training Evaluation

FSI structures and evaluates training programs to ensure quality, relevance, effectiveness, and impact so that the foreign affairs community has the knowledge, skills, and attitudes

(KSAs) needed to achieve U.S. foreign policy objectives.

Policy 1 INCORPORATE STAKEHOLDERS: FSI engages stakeholders as business partners during its training evaluation and curriculum cycle to ensure relevance and impact.

Standard 1.1 Identifying Stakeholders: Each School/Center will identify relevant stakeholders for its programs.

Standard 1.2 Collaborating with Stakeholders: Each School/Center will work with stakeholders in order to identify (1) goals, measures, and leading indicators of success; (2) critical performance behaviors required to meet goals; and (3) support mechanisms to nurture performance of critical behaviors.

Standard 1.3 Communicating with Stakeholders: Each School/Center will create and implement a plan for ongoing communication with stakeholders.

Policy 2 ANALYSIS: FSI identifies the business and organizational needs of the foreign affairs community that can be addressed through relevant training and educational programs.

Standard 2.1 Needs: Each School/Center will analyze and document needs for each course and program.

Standard 2.2 Resources: Each School/Center will identify resources (funds, time, personnel, etc.) necessary to support all phases of the instructional design process: analysis, design, development, implementation, and evaluation.

Policy 3 DESIGN: FSI designs each training course or program to ensure efficient and effective delivery.

02/25/2016 2

Standard 3.1 Documentation: Each School/Center will produce a design document for each course or program based on the course or program learning objectives derived from selected KSAs (Knowledge, Skills, and Attitudes).

Standard 3.2 Methodology: Each School/Center will determine the delivery mechanisms to maximize retention and application of knowledge and learned behaviors in the workplace.

Standard 3.3 Source: Each School/Center will determine whether to design and/or develop the course or program in-house or obtain the services of a contractor or external source.

Standard 3.4 Review: Each School/Center will review each course or program on a periodic basis of one, three, or five years, consistent with strategic criteria, to ensure that the course materials support the learning objectives as described in the design document.

Policy 4 DEVELOPMENT: FSI develops training based on the learning objectives in the design documents for courses and programs.

Standard 4.1 Activities and Materials: Each School/Center will develop instructional activities and course materials that support the achievement of the learning objectives.

Standard 4.2 Educational Technology: Each School/Center will consider appropriate integration of educational technology in courses and programs.

Policy 5 IMPLEMENTATION: FSI ensures that training is delivered effectively.

Standard 5.1 Implementation Plans: Each School/Center will ensure that all new and revised courses and programs have an implementation plan.

Standard 5.2 Performance Monitoring: Each School/Center will have a plan for monitoring and evaluating the performance of all members of the training team, based on the course design, development, and implementation.

02/25/2016 3

Policy 6 EVALUATE COMPREHENSIVELY: FSI assesses the relevance, impact, and value of training to the Department achieved through its training and professional development programs to inform curriculum and instruction.

Standard 6.1 Data: Each School/Center will use evaluation data to inform decisions that strengthen FSI training.

Standard 6.2 Strategies: Each School/Center will integrate measurement and evaluation strategies into the design, development, delivery, and implementation of courses and programs

Standard 6.3 Kirkpatrick New World Model (Levels 1–4): Evaluations will be based on the Kirkpatrick

New World Model, Levels 1 to 4:

Level 1: Reaction

Level 2: Learning

Level 3: Behavior

Level 4: Results

Standard 6.4 Level 1 Evaluation: Each School/Center will evaluate all courses at

Level 1 unless an exception, with rationale, is noted in their

Evaluation Plan.

Standard 6.5 Level 2 Evaluation: Each School/Center will evaluate all courses at

Level 2 (based on learning objectives) unless an exception, with rationale, is noted in their Evaluation Plan.

Standard 6.6 Level 3 and 4 Evaluation: Each School/Center, with FSI senior leadership and stakeholders, will develop an Evaluation Plan that articulates the strategic criteria used to select courses for Levels 3 and

4 evaluation. This Evaluation Plan will be submitted for approval annually to the Director or his/her designate.

Standard 6.7 Roles and Responsibilities: Each School/Center will identify an

Evaluation Point of Contact (POC) responsible for coordinating evaluation efforts across units and communicating results to

School/Center leadership.

02/25/2016 4

Policy 7 EVALUATE SYSTEMATICALLY: FSI systematically collects, analyzes, and reports evaluation data in order to support evidence-based decision making.

Standard 7.1 Planning and Reporting: Each School/Center will have an ongoing review and analysis process to identify patterns and trends within and across programs. Each School/Center will submit an Annual Report to FSI senior leadership.

Standard 7.2 Communication and Reporting: Each School/Center will implement and maintain a communication plan detailing how evaluation data will be shared with internal (School/Center management, instructional staff, etc.) and external stakeholders.

Standard 7.3 Evidence-based Decision Making: All formal reports will contain sufficient data and analysis of the key metrics and leading indicators and how they relate to the performance goals and learning objectives in order to substantiate conclusions and/or recommendations.

Standard 7.4 Institute-wide Comparability: To facilitate analysis of the performance results of training programs across FSI, each

School/Center will incorporate a set of core questions and/or protocols into their evaluation processes.

Standard 7.5 Document and Record Storage: FSI will create and maintain a central repository for evaluation survey data that enables FSI internal stakeholders to analyze data for Institute-wide decision making.