Performance Monitoring Plan_2-24.docx

Performance Monitoring Plan (PMP)

Instructions:

The Monitoring Data for ECA (MODE) Framework provides standard indicators and corresponding survey questions to ensure consistent measures across all ECA programs. The Performance Monitoring Plan (PMP) in this document includes ALL MODE objectives and indicators that were created to collect data from program participants. While ECA recommends the applicant use the format provided, this is not a requirement. However, any performance monitoring reference document the applicant submits should include the information in the column headers (Indicator Name, Definition, Target, Survey Question, etc.) in the table below at a minimum.

To provide a PMP that will meet the solicitation review criteria, the applicant should take the following steps:

Fill out the Applicant Name, FY and Program Title and Funding Opportunity # fields highlighted above Carefully review the solicitation document to identify the MODE indicators that were listed Review the additional (those not listed in the solicitation document) MODE Framework indicators listed in the table below to determine if they are relevant (meaning the applicant proposes that data should be collected for those indicators as part of this program) Those indicators that were NOT selected in steps 2 and 3 above can be deleted from the table below (to do this, click your mouse somewhere within the row you would like to delete, right-click, select “Delete Cells”, then “Delete Entire Row”. Repeat this process until the only MODE Framework indicators that remain are those identified during steps 1 and 2) Applicants may also design custom objectives and/or indicators that are specific to the proposed program and the proposed MODE Framework indicators are insufficient to cover all aspects of the program. Applicants should limit the number of these custom indicators, bearing in mind collection and reporting capacity, and prioritize additional measures identified in the solicitation.

For all indicators in the PMP that remain after steps 2-5 above, insert the target into the appropriate column. A target specifies a feasible and appropriate level of an output or outcome that is hoped for, expected, or intended.

Resources More resources and guidance documents on the MODE Framework and PMP are available online (https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and). PMP-specific resources include:

· MODE Framework Indicator Book (https://app.box.com/s/9gvvxzxlm6bmvzqengqu8uad40yz2doe ):

· MODE Performance Indicator Reference Sheets (https://app.box.com/s/r6x4elenw9pnicdtjyqv6rbyoczhp62t )

· PMP Creation Webinar (https://www.youtube.com/watch?v=WBHC1oLNZvI )

Definitions of PMP Columns

· Performance Indicator: An observable or measurable characteristic that indicates the extent to which a program objective is being achieved.

· Definition: Clarifies all terms necessary and provides details on how to calculate the data collected to measure the change expected.

· Disaggregation (“Disagg”): Lists how the data will be broken down into subgroups (such as: gender, age, state, country, etc.)

· Target: Specific, planned level of result to be achieved within an explicit timeframe

· Data Source and Required Survey Question: Specifies how the data will be obtained (such as a survey, observation, interview, etc.) and the mandatory question linked to the data source. Note that all MODE Framework survey questions are required (i.e. should be forced response); please see the Consent Language in the MODE Framework Indicator Book for an example of how to convey this to participants/survey respondents.

· When to Collect: Specifies when the indicator will be measured, for example: post-program, end of award, etc.

· A post-program collection should occur no later than 6 weeks after the participant has completed the program

· Award recipients are responsible for collecting indicator data on participant outputs and outcomes during the period of performance of the program itself. Note: The Bureau will measure outcomes of ECA participants at one, three, five, and 10 years after the program has ended to capture the long-term impact of ECA programming unless otherwise specified in the solicitation for which you are applying. In this instance, the recipient will be responsible for coordinating with ECA on any alumni surveys to de-duplicate questions and minimize potential survey fatigue.

Definitions of Key Terms Each indicator in the table below includes a list of relevant terms in the indicator column. While terms vary across indicators, there are a few key terms that apply to a high number of indicators. Those terms are listed below to save space in the table:

· Participant or Exchange Visitor - A person who has directly participated in an ECA-facilitated program (either ECA-funded or BridgeUSA) and been exposed to at least 10 hours of content or otherwise meets the requirements for entry into the Alumni Contact Engagement System (ACES). Participants do not include audiences who may watch, listen to, or otherwise interact with ECA program participants.

· Participants of American Spaces programming include any individual who attends a program conducted by an American Space, whether that program is located at an American Space or an outside location. Individuals who attend virtual (online) or blended (partially online, partially in-person) programs are also considered participants.

· “Exchange Visitors” on ECA’s Office of Private Sector Exchange (ECA/EC) programs are considered program participants.

· Host community - A community that sponsors, supports, or provides services for exchange programs and/or their participants. Host communities and institutions do not necessarily directly participate in a program. Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program. Host community members comprise two groups:

· Host families who welcomed exchange visitors into their homes;

· Host institutions or businesses who provided professional or academic experiences to exchange visitors.

· Virtual exchange - A sustained, multi-way interaction, that is 100% online, used to build networks and shared knowledge around policy priorities. For a program to be considered a virtual exchange, participants must engage with all content virtually. A series of virtual components can be considered an exchange if they are (1) originated as a unit with a collective start and end date and (2) are organized around a unifying theme. Examples of virtual elements include online skill-building workshops, virtual professional placements (internships), and virtual mentorships. A series of massive open online courses (MOOCs) would be considered an exchange if they are offered as a set (of say six classes) and are centered on a specific topic (for example, media literacy). Offering MOOCs as an online resource is not considered a virtual exchange program.

· Virtual element - Single, stand-alone components offered as either add-on enrichment to an in-person program or as general outreach by ECA. Examples of virtual elements include online skill-building workshops, virtual professional placements (internships), and virtual mentorships. Offering single MOOCs to the general public or virtual pre-departure orientation webinars are both considered virtual elements. Additionally, online spaces for participants to communicate (such as a program Facebook page) are considered virtual elements.

Demographic Questions

Home Country (Demographic)

What is your home country?

[Drop Down: List of program countries] – See Appendix C in the Indicator Book Post-Program

Home State (Demographic)

What is your home state?

[Drop Down: List of U.S. States] – See Appendix D in the Indicator Book Post-Program

Age (Demographic)

What is your age? Fill in the blank ________

[Validate answer numeric, with accepted answers ranging from 15 to 100]

-- OR--

Are you between the ages of 15 and 35?

· Yes

· No

Post-Program

Gender (Demographic)

Please check the option that best describes your gender:

· Male

· Female

· Non-binary

· I do not wish to respond

Post-Program

Race (Demographic)

What is your race or ethnicity? Select all that apply.

· American Indian or Alaskan Native

· Asian

· Black or African American

· Hispanic or Latino

· Native Hawaiian or Other Pacific Islander

· White

· Some Other Race

· I do not wish to respond Post-Program

(American participants only)

Award recipients will need to identify whether a participant is designated as 'Foreign', 'American', or 'Reciprocal' as part of the disaggregations. The assumption is that those who answer the "Home Country" question can be designated as a 'Foreign participant', those who answer "Home State" can be designated as an 'American participant', and those who answer the associated question with a "yes" can be designated as a 'Reciprocal participant'

Did you participate in a reciprocal exchange?

A reciprocal participant is an American who travels to an exchange participant's home country to assist the participant with their individual project

· Yes

· No Post- Program

This only applies if an exchange participant was based in one state for more than one month; for example, for IVLP participants, the placement state would not need to be reported.

In which U.S. State were you placed during your exchange?

[Drop Down: List of U.S. States] – See Appendix D in the Indicator Book Post-Program

ECA Objective 1: Advance participant and beneficiary cross-cultural competence and global perspective

ECA Sub-Objective 1.1: Promote cultural exchanges and enhance understanding between participants and their host communities

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Do you agree with the following statement?

My program offered opportunities for making cultural connections and sharing. For example: Conversations about each others’ countries, attending cultural events, etc.

· Yes

· No

Post-Program

E1.1.04: Percent of participants with more favorable opinions of the United States Government (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who select “much more favorable” OR “somewhat more favorable” on the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Did your views of the United States government change as a result of your program participation?

· Yes

· No

If YES:

How did your views of the United States government change? Are your views:

· Much less favorable

· Somewhat less favorable

· Somewhat more favorable

· Much more favorable Post-Program

E1.1.09: Percent of participants who traveled abroad for the first time because of their program (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Abroad – A country outside of one’s home country

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who answered “no” to the first question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Before this exchange program, had you traveled outside of your home country?

· Yes

· No

If YES:

Why did you travel outside of your home country? Select all that apply.

· Tourism

· Visit friends/family

· Participation in another U.S. Department of State exchange program (including U.S. Embassy-sponsored exchanges)

· Participation in a non-U.S. Department of State exchange

· Study

· Work

· Other: ______ [write-in] Post-Program

E1.1.10: Percent of foreign participants who traveled to the United States for the first time during their program (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once per reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “no” to the first question while denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Before this exchange program, had you traveled to the United States?

· Yes

· No

If YES:

Why did you travel to the United States? Select all that apply.

· Tourism

· Visit friends/family

· Participation in another U.S. Department of State exchange program (including U.S. embassy-sponsored exchange programs)

· Participation in a non-U.S. Department of State exchange

· Study

· Work

· Other: ______ [write-in]

Post-Program

Host country - The country in which the participant traveled to for their exchange program.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations Responses to each item should be scored in the following manner:

No change – 1 Minimal change – 2 Moderate change – 3 Substantial change – 4

The response scores for each item should be summed and divided by the number of items they responded to in order to give an average question score for each respondent.

To determine the percent value, the numerator is the number of respondents whose average question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Home state

· Race

· Participant type: American, reciprocal

How much did participation in the exchange program change your understanding or knowledge of the following topics?

· Host country political system

· Host country economy

· Foreign affairs of my host country

· Domestic affairs in my host country

· Host country values and culture

· Daily life in my host country

· Religious and ethnic diversity in my host country

· Freedom of speech and press in my host country

· Voluntary community service in my host country

[Scale: No change, Minimal change, Moderate change, Substantial change] Post-Program

Third-party country - A country that is not the participant/alumni’s home or host country. Generally, this refers to the home countries of fellow participants.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations Responses to each item should be scored in the following manner:

No change – 1 Minimal change – 2 Moderate change – 3 Substantial change – 4

The response scores for each item should be summed and divided by the number of items they responded to in order to give an average question score for each respondent.

To determine the percent value, numerator is number of respondents whose average question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Thinking about the participants you met from other countries (not your home country or the U.S.), how much did participation in the program change your understanding or knowledge of the following topics related to those countries?

· Political system

· Economy

· Foreign affairs

· Domestic affairs

· Values and culture

· Daily life

· Religious and ethnic diversity

· Freedom of speech and press

· Voluntary community service

[Scale: No change, Minimal change, Moderate change, Substantial change] Post-Program

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “much more likely” or “somewhat more likely” while denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Compared to before your program participation, how likely are you now to recommend the United States as a good place to study?

· Much more unlikely

· Somewhat more unlikely

· Somewhat more likely Much more likely Post-Program

Virtual exchange - See Definitions of Key Terms

Virtual element - See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once per reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants engaging with virtual program elements as part of a non-virtual program.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

In the future, are virtual exchanges likely to be your only way to interact with citizens from other countries?

· Yes

· No

· I don’t know Post-Program

E1.1.17: Percent of foreign participants with more favorable opinions of the American people (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “much more favorable” OR “somewhat more favorable” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Did your views of the American people change as a result of your program participation?

· Yes

· No

If YES:

How did your views of the American people change? Are your views:

· Much less favorable

· Somewhat less favorable

· Somewhat more favorable

· Much more favorable Post-Program

E1.1.18: Percent of foreign participants indicating an increase in understanding of United States culture and values (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations Responses to each item should be scored in the following manner:

No change – 1 Minimal change – 2 Moderate change – 3 Substantial change – 4

The response scores for each item should be summed and divided by the number of items they responded to in order to give a total question score for each respondent.

To determine the percent value, numerator is number of respondents whose total question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

How much did participation in the program change your understanding or knowledge of each of the following topics?

· United States democracy

· United States economy

· Foreign affairs of the United States

· Domestic affairs in the United States

· United States values and culture

· Daily life in the United States

· Religious and ethnic diversity in the United States

· Freedom of speech and press in the United States

· Voluntary community service in the United States

[Scale: No change, Minimal change, Moderate change, Substantial change] Post-Program

E1.1.19: Percent of participants agreeing with statements in support of democratic values (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Democratic values - The ideas or beliefs that make a society fair, including: democratic decision-making, freedom of speech, equality before the law, equality, social justice.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations Responses to each item should be scored in the following manner:

Strongly disagree – 1 Disagree – 2 Neither disagree nor agree – 3 Agree – 4 Strongly agree – 5 Don’t know/can’t ascertain – 0

To determine the percent value, numerator is the number of respondents whose average question score is greater than or equal to 4 on a 1-5 scale while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

To what extent do you agree or disagree with the statements below?

· Voting is important because real decisions are made in elections

· Free and fair elections are the cornerstone of democracy

· An independent media is important to the free flow of information

· All citizens in a country should have equal rights and protections under the law, regardless of circumstances

· The rule of law is fundamental to a functioning democracy

· Individuals have the right to free speech and to voice opposition

· Organizations have the right to free speech and to voice opposition

· Democratic principles enhance the workplace. Supervisors should incorporate democratic principles into their management practices

[Scale: Strongly disagree, Disagree, Neither disagree nor agree, Agree, Strongly agree, Don’t know/can’t ascertain] Post-Program

ECA Objective 2: Increase the impact that participants and alumni have on their communities / countries

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate the percentage, the numerator will be the number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Did you volunteer your time during your exchange?

· Yes

· No

· My program did not offer the opportunity to volunteer Post-Program

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in a reporting year following their program completion.

Calculations Participants will complete a survey question that will request the number of hours of time spent volunteering during their exchange program.

The total number of hours for all participants should be reported.

· Gender

· Age

· Country of origin

How many hours did you spend volunteering during your exchange program? (Please note that volunteer hours do not include time spent working as part of your professional placement.)

Fill in the blank: __________ [validate as numeric] Post-Program

ECA Sub-Objective 2.2: Foster participants’ belief that civic engagement benefits communities/countries

E2.2.01: Percent of participants who have more confidence in their ability to have an impact in their home country (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Home community - The community that the program participant originates from and will return to at the conclusion of the program.

Home country - The country in which the program participant resides prior to their program participation.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculation To determine the percent value, numerator is number of respondents that responded “more confident” to the statement about their ability to make a difference in the ‘community where I live’ and/or ‘country where I live’ while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

As a result of your program participation, how has your confidence in each of the following changed?

· I have the ability to make a difference in the community where I live

· I have the ability to make a difference in the country where I live

· I have the ability to make a difference in the global community

[Scale: I am less confident; No change in confidence, I am more confident] Post-Program

ECA Objective 3: Strengthen engagement among participants, alumni, beneficiaries, and institutions

E3.0.02: Percent of foreign participants who report increasing their network of Americans (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Network - An interconnected or interrelated group or system. In the context of MODE, this refers to an interconnected or interrelated group intentionally convened, sustained, or otherwise facilitated through ECA programming.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Are you still in contact with any Americans you met during your program?

· Yes

· No

If YES:

Are the contacts you maintain with Americans personal, professional, or both?

· Personal

· Professional

· Both personal and professional Post-Program

Network- An interconnected or interrelated group or system intentionally convened, sustained, or otherwise facilitated through ECA programming.

Third-country national - A third country stakeholder is defined as a person or institution who does not have the same nationality and is not from the country in which the exchange took place or from the country of a participant of the exchange.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

Are you still in contact with any individual not from the U.S. and not from your own country that you met during your program?

•Yes •No

If YES:

Are the contacts you maintain with these individuals personal, professional, or both?

•Personal •Professional •Both personal and professional Post-Program

E3.0.07: Percent of participants who identify as a Department of State program participant (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of participants who answered “yes” in response to the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Do you consider yourself a participant of a U.S. Department of State program?

· Yes

· No Post-Program

ECA Sub-Objective 3.1: Alumni subscribe to platforms for resources and information-sharing

E3.1.02: Percent of participants who learned about new resources

Participant or Exchange Visitor – See Definitions of Key Terms

Resource – Information that is new and potentially useful to the participant. Can include information guidance that is either personal or professional. Does not include persons. Can be information provided during any portion of the program process (pre-program, during the program, or immediately post-program – such as a Congress or concluding event).

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who select at least one of the survey question response options EXCEPT “None of the above” to the first question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Through your program experience, did you learn about any of the following Department of State-managed resources? Select all that apply.

• Small grants applications from the U.S. Government [Carry forward selection to next question]

• Alumni Engagement Innovation Fund (AEIF) applications [Carry forward selection to next question]

• Citizen Diplomacy Action Fund applications [ask of American alumni only] [Carry forward selection to next question]

• Project Development toolkits [Carry forward selection to next question]

• Supplies or equipment [Carry forward selection to next question]

• Information on workshops/events hosted by the U.S. Embassy in your home country [ask of Foreign Alumni only] [Carry forward selection to next question]

• Embassy network of experts and leaders [ask of Foreign Alumni only] [Carry forward selection to next question]

• American Spaces (either American Centers, American Corners, or Bi-National Centers) [ask of Foreign Alumni only] [Carry forward selection to next question]

• Career Connections [ask of American alumni only] [Carry forward selection to next question]

• None

For each category the respondent selects, ask:

Was this the first time you heard about this resource?

• Yes

• No Post-Program

E3.1.05: Percent of participants who are connected to ECA through a U.S. Department of State-managed platform

Participant or Exchange Visitor – See Definitions of Key Terms

Digital platform - A digital place, opportunity, or event for public discussion or interpersonal engagement intentionally convened, sustained, or otherwise facilitated through ECA programming.

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To calculate percentage, numerator will be number of respondents who select “yes” to at least one of the survey question response options while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Are you connected with the Department of State International Exchange Alumni Network on the following digital platforms?

• Registered on the alumni.state.gov website (https://alumni.state.gov)

• Follow @Exchangealumni on Twitter,

• Connected with Alumni Affairs on LinkedIn (https://www.linkedin.com/in/alumni-affairs-9b871b103)

[Scale: Yes/No/I don’t know] Post-Program

ECA Objective 4: Strengthen personal, professional, and technical abilities and aptitudes of participants and beneficiaries

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who reply “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

[NOTE: This question is also included in Indicators E4.0.03 and E4.0.05. If these are to be included in a survey, this question can be asked once, with up to two follow-up questions based on an affirmative response.]

Did you increase your personal and/or professional skills as a result of your participation in this program?

· Yes

· No Post-Program

Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each participant should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who select at least one answer option except for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.05. If at least two of those questions are to be included in a survey, question 1 can be asked once, with up to two follow-up questions based on an affirmative response.

Did you increase your personal and/or professional skills as a result of your participation in this program?

· Yes

· No

If YES:

Please select the personal skills you increased. Select all that apply.

· Leadership skills

· Communication skills

· Listening skills

· Self-awareness

· Self-initiative

· Self-confidence

· Resourcefulness

· Decision-making skills

· Problem-solving skills

· Other: ______ [write-in]

· None of the above skills Post-Program

Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who select at least one answer option EXCEPT for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.03. If at least two of these questions are to be included in a survey, question 1 can be asked once, with up to two follow-up questions based on an affirmative response.

Did you increase your personal and/or professional skills as a result of your participation in this program?

· Yes

· No

If YES:

Please select the professional skills you increased. Select all that apply.

· Project management skills

· Business management skills

· Entrepreneurship skills

· Journalism skills

· Teaching skills

· Science competence

· Technology competence

· Engineering competence

· Mathematics competence

· Other: ______ [write-in]

· None of the above skills Post-Program

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who answered yes in question 1, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

1. Did you improve your foreign language skills as a result of the program

· Yes

· No

If YES to question 1, ask questions 2 and 3:

2. Which of the following best described your ability to speak in that foreign language before your participation in the program?

· No ability at all

· Able to communicate only in a very limited capacity

· Able to satisfy basic survival needs and minimum courtesy requirements

· Able to satisfy routine social demands and limited work requirements

· Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

· Able to speak fluently and accurately in all situations

· Proficiency equivalent to that of a native speaker

[Use display logic to show those choices with abilities greater than the selection in question 2.]

3. Which of the following best describes your ability to speak in that foreign language after the program?

· Able to communicate only in a very limited capacity

· Able to satisfy basic survival needs and minimum courtesy requirements

· Able to satisfy routine social demands and limited work requirements

· Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

· Able to speak fluently and accurately in all situations

· Proficiency equivalent to that of a native speaker Post-Program

Digital skill/competencies – Digital skills are defined as a range of abilities to use digital devices, communication applications, and networks to access and manage information, and to participate in a virtual program. Skills include: knowledge about various low and high-tech technologies (such as the internet, digital video, software programs, etc.), knowledge of how various technologies can be used to communicate with others, knowledge required by teachers for integrating technology into their classrooms, and/or creating content for various technologies.

Virtual Exchange - See Definitions of Key Terms

Virtual Elements - See Definitions of Key Terms

Counting Frequency Each respondent should only be counted once in the reporting year following their program completion.

Calculations To determine the percent value, numerator is number of respondents who respond “yes” to the question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants ONLY engaging with virtual program elements.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

As a result of your participation in the exchange program, did you gain new digital skills/competencies?

· Yes

· No Post-Program

ECA Sub-Objective 4.1: Participants engage in language, academic, professional, and cultural programs

E4.1.01: Total number of participants (core indicator) Participant or Exchange Visitor – See Definitions of Key Terms

Counting Frequency Each participant should only be counted once per semi-annual reporting cycle following their program completion.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Annually

E4.1.02: Total number of program cohorts (core indicator) Program cohort - A group of participants hosted separately under a program umbrella and following a set course of activities and/or study. For instance:

· IVLP is a program – each individual IVLP project conducted in a year would be considered a separate cohort.

· PFP is a program – the two groups of participants PFP brings to the US each year are each considered separate cohorts.

· Arts Envoy is a program- each group of artists that travels is considered a separate cohort. A band or group of musicians would be considered a cohort but each individual should be counted separately as a participant.

Counting Frequency Each cohort should only be counted once per semi-annual reporting cycle following its completion.

Annually

Counting Frequency All scholarships should be counted even if more than one scholarship goes to the same individual. Scholarships should be counted once per semi-annual reporting cycle during which they were awarded.

· Amount: $0-5000; $5001- $10,000; $10,001+

· Participant type: American, foreign

Host institution - An institution that provides support to or benefits from the participation of program participants. Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program.

Professional development - The act of learning and/or improving skills in order to better meet professional goals. Professional development activities can include formal coursework, attending conferences, and informal learning opportunities situated in practice; i.e. informal peer-to-peer interaction and learning, or opportunities through knowledge sharing.

Counting Frequency Each placement should only be counted once the placement has been completed and only once per semi-annual reporting cycle. If a participant holds more than one placement during their exchange program, each placement should be counted.

Semi-Annually

Media literacy component- An educational portion of a program that focuses on the ability to identify different types of media and the messages they are sending. It includes activities such as a training, a talk or seminar on media literacy or how to teach media literacy, training for journalism, connecting participants with media experts or providing resources for media literacy.

Counting Frequency Each participant should only be counted once per semi-annual reporting cycle following their program completion.

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Semi-Annually

Counting Frequency Each participant should only be counted once per semi-annual reporting cycle following their program completion

· Gender

· Age

· Country of origin

· Home state

· Race

· Participant type: American, foreign, reciprocal

Semi-Annually

This indicator specifically measures “instruction methodology” related trainings.

Instruction methodology trainings – Those trainings related to furthering skills in teaching.

Counting Frequency Each training should only be counted once per semi-annual reporting cycle.

Semi-Annually