Performance Monitoring Plan_2-24.pdf

Last Updated: February 2024

PERFORMANCE MONITORING PLAN (PMP)

Applicant Name: Example Organization

Fiscal Year and Program Title: FY## Example Program

Funding Opportunity #: SFOP000XXXX

Instructions:

The Monitoring Data for ECA (MODE) Framework provides standard indicators and corresponding survey questions to ensure consistent measures across all ECA programs. The Performance Monitoring Plan (PMP) in this document includes ALL MODE objectives and indicators that were created to collect data from program participants. While ECA recommends the applicant use the format provided, this is not a requirement. However, any performance monitoring reference document the applicant submits should include the information in the column headers (Indicator Name, Definition, Target, Survey Question, etc.) in the table below at a minimum.

To provide a PMP that will meet the solicitation review criteria, the applicant should take the following steps:

1. Fill out the Applicant Name, FY and Program Title and Funding Opportunity # fields highlighted above

2. Carefully review the solicitation document to identify the MODE indicators that were listed

3. Review the additional (those not listed in the solicitation document) MODE Framework indicators listed in the table below to determine if they are relevant (meaning the applicant proposes that data should be collected for those indicators as part of this program)

4. Those indicators that were NOT selected in steps 2 and 3 above can be deleted from the table below (to do this, click your mouse somewhere within the row you would like to delete, right-click, select “Delete Cells”, then “Delete Entire Row”. Repeat this process until the only MODE Framework indicators that remain are those identified during steps 1 and 2)

5. Applicants may also design custom objectives and/or indicators that are specific to the proposed program and the proposed MODE

Framework indicators are insufficient to cover all aspects of the program. Applicants should limit the number of these custom indicators, bearing in mind collection and reporting capacity, and prioritize additional measures identified in the solicitation.

For all indicators in the PMP that remain after steps 2-5 above, insert the target into the appropriate column. A target specifies a feasible and appropriate level of an output or outcome that is hoped for, expected, or intended.

Resources

More resources and guidance documents on the MODE Framework and PMP are available online (https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and). PMP-specific resources include:

• MODE Framework Indicator Book (https://app.box.com/s/9gvvxzxlm6bmvzqengqu8uad40yz2doe ):

• MODE Performance Indicator Reference Sheets (https://app.box.com/s/r6x4elenw9pnicdtjyqv6rbyoczhp62t )

• PMP Creation Webinar (https://www.youtube.com/watch?v=WBHC1oLNZvI )

Definitions of PMP Columns

• Performance Indicator: An observable or measurable characteristic that indicates the extent to which a program objective is being achieved.

• Definition: Clarifies all terms necessary and provides details on how to calculate the data collected to measure the change expected.

• Disaggregation (“Disagg”): Lists how the data will be broken down into subgroups (such as: gender, age, state, country, etc.)

• Target: Specific, planned level of result to be achieved within an explicit timeframe

• Data Source and Required Survey Question: Specifies how the data will be obtained (such as a survey, observation, interview, etc.) and the mandatory question linked to the data source. Note that all MODE Framework survey questions are required (i.e. should be forced response); please see the Consent Language in the MODE Framework Indicator Book for an example of how to convey this to participants/survey respondents.

• When to Collect: Specifies when the indicator will be measured, for example: post-program, end of award, etc.

o A post-program collection should occur no later than 6 weeks after the participant has completed the program o Award recipients are responsible for collecting indicator data on participant outputs and outcomes during the period of performance of the program itself. Note: The Bureau will measure outcomes of ECA participants at one, three, five, and 10 years after the program has ended to capture the long-term impact of ECA programming unless otherwise specified in the solicitation for which you are applying. In this instance, the recipient will be responsible for coordinating with ECA on any alumni surveys to de-duplicate questions and minimize potential survey fatigue.

https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and https://app.box.com/s/9gvvxzxlm6bmvzqengqu8uad40yz2doe https://app.box.com/s/r6x4elenw9pnicdtjyqv6rbyoczhp62t https://www.youtube.com/watch?v=WBHC1oLNZvI

Definitions of Key Terms

Each indicator in the table below includes a list of relevant terms in the indicator column. While terms vary across indicators, there are a few key terms that apply to a high number of indicators. Those terms are listed below to save space in the table:

• Participant or Exchange Visitor - A person who has directly participated in an ECA-facilitated program (either ECA-funded or

BridgeUSA) and been exposed to at least 10 hours of content or otherwise meets the requirements for entry into the Alumni Contact

Engagement System (ACES). Participants do not include audiences who may watch, listen to, or otherwise interact with ECA program participants.

o Participants of American Spaces programming include any individual who attends a program conducted by an American Space, whether that program is located at an American Space or an outside location. Individuals who attend virtual (online) or blended

(partially online, partially in-person) programs are also considered participants.

o “Exchange Visitors” on ECA’s Office of Private Sector Exchange (ECA/EC) programs are considered program participants.

• Host community - A community that sponsors, supports, or provides services for exchange programs and/or their participants. Host communities and institutions do not necessarily directly participate in a program. Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program. Host community members comprise two groups:

o Host families who welcomed exchange visitors into their homes;

o Host institutions or businesses who provided professional or academic experiences to exchange visitors.

• Virtual exchange - A sustained, multi-way interaction, that is 100% online, used to build networks and shared knowledge around policy priorities. For a program to be considered a virtual exchange, participants must engage with all content virtually. A series of virtual components can be considered an exchange if they are (1) originated as a unit with a collective start and end date and (2) are organized around a unifying theme. Examples of virtual elements include online skill-building workshops, virtual professional placements

(internships), and virtual mentorships. A series of massive open online courses (MOOCs) would be considered an exchange if they are offered as a set (of say six classes) and are centered on a specific topic (for example, media literacy). Offering MOOCs as an online resource is not considered a virtual exchange program.

• Virtual element - Single, stand-alone components offered as either add-on enrichment to an in-person program or as general outreach by

ECA. Examples of virtual elements include online skill-building workshops, virtual professional placements (internships), and virtual mentorships. Offering single MOOCs to the general public or virtual pre-departure orientation webinars are both considered virtual elements. Additionally, online spaces for participants to communicate (such as a program Facebook page) are considered virtual elements.

Performance

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Demographic Questions

Home Country

(Demographic)

Used to identify subgroups for Country of Origin disaggregation. (Foreign participants only)

N/A N/A Survey (self-reported data)

What is your home country?

[Drop Down: List of program countries] – See Appendix C in the Indicator Book

Post-

Program

Home State

(Demographic)

Used to identify subgroups for Home State disaggregation.

(American participants only)

What is your home state?

[Drop Down: List of U.S.

States] – See Appendix D in the

Indicator Book

Post-

Program

Age

(Demographic)

Used to identify subgroups for Age disaggregation. N/A N/A Survey (self-reported data)

What is your age? Fill in the blank ________

[Validate answer numeric, with accepted answers ranging from

15 to 100]

-- OR--

Are you between the ages of 15 and 35?

• Yes

• No

Post-

Program

Gender

Used to identify subgroups for Gender disaggregation. N/A N/A Survey (self-reported data)

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Please check the option that best describes your gender:

• Male

• Female

• Non-binary

• I do not wish to respond

Race

Used to identify subgroups for Race disaggregation.

What is your race or ethnicity?

Select all that apply.

• American Indian or Alaskan

Native

• Asian

• Black or African American

• Hispanic or Latino

• Native Hawaiian or Other

Pacific Islander

• White

• Some Other Race

• I do not wish to respond

Post-

Program

Participant Type

(Demographic)

Used to identify the subgroup “Reciprocal” for Participant

Type disaggregation.

Award recipients will need to identify whether a participant is designated as 'Foreign', 'American', or 'Reciprocal' as part of the disaggregations. The assumption is that those who answer the "Home Country" question can be designated as a 'Foreign participant', those who answer

"Home State" can be designated as an 'American

Did you participate in a reciprocal exchange?

A reciprocal participant is an

American who travels to an exchange participant's home country to assist the participant with their individual project

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect participant', and those who answer the associated question with a "yes" can be designated as a 'Reciprocal participant'

• Yes

• No

Placement State

(Demographic)

Used to identify subgroups for Placement State disaggregation. (Foreign participants only)

This only applies if an exchange participant was based in one state for more than one month; for example, for IVLP participants, the placement state would not need to be reported.

In which U.S. State were you placed during your exchange?

[Drop Down: List of U.S.

States] – See Appendix D in the

Indicator Book

Post-

Program

ECA Objective 1: Advance participant and beneficiary cross-cultural competence and global perspective

ECA Sub-Objective 1.1: Promote cultural exchanges and enhance understanding between participants and their host communities

E1.1.01: Percent of participants reporting that their program experience offered opportunities to engage with other cultures

Participant or Exchange Visitor – See Definitions of Key

Terms

Counting Frequency

Each respondent should only be counted once in the reporting year following their program completion.

Calculations

To calculate percentage, numerator will be number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Survey (self-reported data)

Do you agree with the following statement?

My program offered opportunities for making cultural connections and sharing. For example:

Conversations about each others’ countries, attending cultural events, etc.

E1.1.04:

Percent of participants with more favorable opinions of the

• Gender

• Age

• Country of origin

• Home state

To be completed by the

Did your views of the United

States government change as a

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

United States

Government

(core indicator) respondents who select “much more favorable” OR

“somewhat more favorable” on the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Race

• Participant type:

American, foreign, reciprocal result of your program participation?

If YES:

How did your views of the

United States government change? Are your views:

• Much less favorable

• Somewhat less favorable

• Somewhat more favorable

• Much more favorable

E1.1.09:

Percent of participants who traveled abroad for the first time because of their program

(core indicator)

Abroad – A country outside of one’s home country respondents who answered “no” to the first question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Before this exchange program, had you traveled outside of your home country?

Why did you travel outside of your home country? Select all that apply.

• Tourism

• Visit friends/family

• Participation in another U.S.

Department of State

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect exchange program (including

U.S. Embassy-sponsored exchanges)

• Participation in a non-U.S.

Department of State exchange

• Study

• Work

• Other: ______ [write-in]

E1.1.10:

Percent of foreign participants who traveled to the

United States for the first time during their program

(core indicator)

Each respondent should only be counted once per reporting year following their program completion.

To determine the percent value, numerator is number of respondents who reply “no” to the first question while denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

To be completed by the

Before this exchange program, had you traveled to the United

States?

Why did you travel to the

United States? Select all that apply.

• Tourism

• Visit friends/family

• Participation in another U.S.

Department of State exchange program (including

U.S. embassy-sponsored exchange programs)

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Participation in a non-U.S.

Department of State exchange

• Study

• Work

• Other: ______ [write-in]

E1.1.11:

Percent of

American participants indicating a change in their understanding of their host country's culture and values

Host country - The country in which the participant traveled to for their exchange program.

Responses to each item should be scored in the following manner:

No change – 1

Minimal change – 2

Moderate change – 3

Substantial change – 4

The response scores for each item should be summed and divided by the number of items they responded to in order to give an average question score for each respondent.

• Age

• Home state

• Race

• Participant type:

American, reciprocal

To be completed by the

How much did participation in the exchange program change your understanding or knowledge of the following topics?

• Host country political system

• Host country economy

• Foreign affairs of my host country

• Domestic affairs in my host country

• Host country values and culture

• Daily life in my host country

• Religious and ethnic diversity in my host country

• Freedom of speech and press in my host country

• Voluntary community service in my host country

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

To determine the percent value, the numerator is the number of respondents whose average question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

[Scale: No change, Minimal change, Moderate change, Substantial change]

E1.1.12:

Percent of foreign participants indicating a change in understanding of third-party countries’ cultures and values

Third-party country - A country that is not the participant/alumni’s home or host country. Generally, this refers to the home countries of fellow participants.

Responses to each item should be scored in the following manner:

No change – 1

Minimal change – 2 to give an average question score for each respondent.

respondents whose average question score is 2 or greater while the denominator will be the total number of question

• Gender

• Age

• Country of origin

To be completed by the

Thinking about the participants you met from other countries

(not your home country or the

U.S.), how much did participation in the program change your understanding or knowledge of the following topics related to those countries?

• Political system

• Economy

• Foreign affairs

• Domestic affairs

• Values and culture

• Daily life

• Religious and ethnic diversity

• Freedom of speech and press service

[Scale: No change, Minimal change, Moderate change, Substantial change]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

E1.1.13: Percent of foreign participants who are more likely to recommend the United

States as a good place to study respondents who reply “much more likely” or “somewhat more likely” while denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

To be completed by the

Compared to before your program participation, how likely are you now to recommend the United States as a good place to study?

• Much more unlikely

• Somewhat more unlikely

• Somewhat more likely

Much more likely

Post-

Program

E1.1.16:

Percent of virtual exchange

(VE)

participants who report VE as their only likely way to interact with citizens from other countries in the future

Virtual exchange - See Definitions of Key Terms

Virtual element - See Definitions of Key Terms

Each respondent should only be counted once per reporting year following their program completion.

respondents who answered “yes” while the denominator will be the total number of question respondents. Divide

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

In the future, are virtual exchanges likely to be your only way to interact with citizens from other countries?

• Yes

• No

• I don’t know

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect the numerator by the denominator and then multiply by 100 for the percent value.

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants engaging with virtual program elements as part of a non-virtual program.

E1.1.17:

Percent of foreign participants with more favorable opinions of the

American people

(core indicator) respondents who reply “much more favorable” OR

“somewhat more favorable” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

To be completed by the

Did your views of the American people change as a result of your program participation?

How did your views of the

American people change? Are your views:

• Much less favorable

• Somewhat less favorable

• Somewhat more favorable

• Much more favorable

Post-

Program

E1.1.18:

Percent of foreign participants indicating an increase in understanding of

• Country of origin

To be completed by the

How much did participation in the program change your understanding or knowledge of each of the following topics?

• United States democracy

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

United States culture and values

(core indicator)

Calculations

Responses to each item should be scored in the following manner:

No change – 1

Minimal change – 2 to give a total question score for each respondent.

respondents whose total question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• United States economy

• Foreign affairs of the United

States

• Domestic affairs in the

United States

• United States values and culture

• Daily life in the United

States

• Religious and ethnic diversity in the United States

• Freedom of speech and press in the United States service in the United States

[Scale: No change, Minimal change, Moderate change, Substantial change]

E1.1.19:

Percent of participants agreeing with statements in support of democratic values

(core indicator)

Democratic values - The ideas or beliefs that make a society fair, including: democratic decision-making, freedom of speech, equality before the law, equality, social justice.

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

To what extent do you agree or disagree with the statements below?

• Voting is important because real decisions are made in elections

• Free and fair elections are the cornerstone of democracy

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Responses to each item should be scored in the following manner:

Strongly disagree – 1

Disagree – 2

Neither disagree nor agree – 3

Agree – 4

Strongly agree – 5

Don’t know/can’t ascertain – 0

To determine the percent value, numerator is the number of respondents whose average question score is greater than or equal to 4 on a 1-5 scale while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• An independent media is important to the free flow of information

• All citizens in a country should have equal rights and protections under the law, regardless of circumstances

• The rule of law is fundamental to a functioning democracy

• Individuals have the right to free speech and to voice opposition

• Organizations have the right to free speech and to voice opposition

• Democratic principles enhance the workplace.

Supervisors should incorporate democratic principles into their management practices

[Scale: Strongly disagree, Disagree, Neither disagree nor agree, Agree, Strongly agree, Don’t know/can’t ascertain]

ECA Objective 2: Increase the impact that participants and alumni have on their communities / countries

E2.0.01: Percent of foreign participants that

• Country of origin

To be completed

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect volunteer in their host communities

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

To calculate the percentage, the numerator will be the number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

by the applicant

Did you volunteer your time during your exchange?

• Yes

• No

• My program did not offer the opportunity to volunteer

E2.0.04:

Number of hours that foreign participants spend volunteering in their host communities

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

Each respondent should only be counted once in a

• Age

• Country of origin

To be completed by the

How many hours did you spend volunteering during your exchange program? (Please note that volunteer hours do not include time spent working as part of your professional placement.)

Fill in the blank: __________

[validate as numeric]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Participants will complete a survey question that will request the number of hours of time spent volunteering during their exchange program.

The total number of hours for all participants should be reported.

ECA Sub-Objective 2.2: Foster participants’ belief that civic engagement benefits communities/countries

E2.2.01:

Percent of participants who have more confidence in their ability to have an impact in their home country

(core indicator)

Home community - The community that the program participant originates from and will return to at the conclusion of the program.

Home country - The country in which the program participant resides prior to their program participation.

Calculation respondents that responded “more confident” to the statement about their ability to make a difference in the

‘community where I live’ and/or ‘country where I live’ while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

As a result of your program participation, how has your confidence in each of the following changed?

• I have the ability to make a difference in the community where I live

• I have the ability to make a difference in the country where I live

• I have the ability to make a difference in the global community

[Scale: I am less confident; No change in confidence, I am more confident]

Post-

ECA Objective 3: Strengthen engagement among participants, alumni, beneficiaries, and institutions

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

E3.0.02:

Percent of foreign participants who report increasing their network of

Americans

(core indicator)

Network - An interconnected or interrelated group or system. In the context of MODE, this refers to an interconnected or interrelated group intentionally convened, sustained, or otherwise facilitated through ECA programming.

respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

To be completed by the

Are you still in contact with any

Americans you met during your program?

Are the contacts you maintain with Americans personal, professional, or both?

• Personal

• Professional

• Both personal and professional

Post-

Program

E3.0.04:

Percent of foreign participants who report increasing their network of third country nationals

Network- An interconnected or interrelated group or system intentionally convened, sustained, or otherwise facilitated through ECA programming.

Third-country national - A third country stakeholder is defined as a person or institution who does not have the same nationality and is not from the country in which the exchange took place or from the country of a participant of the exchange.

• Country of origin

To be completed by the

Are you still in contact with any individual not from the U.S.

and not from your own country that you met during your program?

•Yes

•No

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Counting Frequency respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

Are the contacts you maintain with these individuals personal, professional, or both?

•Personal

•Professional

•Both personal and professional

E3.0.07:

Percent of participants who identify as a

Department of

State program participant

(core indicator) participants who answered “yes” in response to the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Do you consider yourself a participant of a U.S.

Department of State program?

• Yes

• No

Post-

Program

ECA Sub-Objective 3.1: Alumni subscribe to platforms for resources and information-sharing

E3.1.02: Percent of participants who learned about new resources

Resource – Information that is new and potentially useful to the participant. Can include information guidance that is either personal or professional. Does not include persons.

• Gender

• Age

• Country of origin

• Home state

• Race

To be completed by the

Through your program experience, did you learn about any of the following

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Can be information provided during any portion of the program process (pre-program, during the program, or immediately post-program – such as a Congress or concluding event).

respondents who select at least one of the survey question response options EXCEPT “None of the above” to the first question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Participant type:

American, foreign, reciprocal

Department of State-managed resources? Select all that apply.

• Small grants applications from the U.S. Government [Carry forward selection to next question]

• Alumni Engagement

Innovation Fund (AEIF) applications [Carry forward selection to next question]

• Citizen Diplomacy Action

Fund applications [ask of

American alumni only] [Carry forward selection to next question]

• Project Development toolkits

[Carry forward selection to next question]

• Supplies or equipment [Carry forward selection to next question]

• Information on workshops/events hosted by the

U.S. Embassy in your home country [ask of Foreign Alumni only] [Carry forward selection to next question]

• Embassy network of experts and leaders [ask of Foreign

Alumni only] [Carry forward selection to next question]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• American Spaces (either

American Centers, American

Corners, or Bi-National

Centers) [ask of Foreign

Alumni only] [Carry forward selection to next question]

• Career Connections [ask of

American alumni only] [Carry forward selection to next question]

• None

For each category the respondent selects, ask:

Was this the first time you heard about this resource?

• Yes

• No

E3.1.05: Percent of participants who are connected to

ECA through a

U.S. Department of State-managed platform

Digital platform - A digital place, opportunity, or event for public discussion or interpersonal engagement intentionally convened, sustained, or otherwise facilitated through ECA programming.

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Are you connected with the

Department of State

International Exchange Alumni

Network on the following digital platforms?

• Registered on the alumni.state.gov website

(https://alumni.state.gov)

• Follow @Exchangealumni on

Twitter,

• Connected with Alumni

Affairs on LinkedIn

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

To calculate percentage, numerator will be number of respondents who select “yes” to at least one of the survey question response options while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

(https://www.linkedin.com/in/al umni-affairs-9b871b103)

[Scale: Yes/No/I don’t know]

ECA Objective 4: Strengthen personal, professional, and technical abilities and aptitudes of participants and beneficiaries

E4.0.01: Percent of participants reporting increases in their job skills as a result of their program participation respondents who reply “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Survey (self-reported)

[NOTE: This question is also included in Indicators E4.0.03 and E4.0.05. If these are to be included in a survey, this question can be asked once, with up to two follow-up questions based on an affirmative response.]

Did you increase your personal and/or professional skills as a result of your participation in this program?

• Yes

• No

Post-

Program

E4.0.03: Percent of participants reporting an increase in soft skills as a result of their program participation

Soft skills - Qualities and behaviors an individual demonstrates to interact with others effectively. Examples include communication, listening, self-awareness, awareness of others, self-initiative, cognitive competence skills, self-confidence, resourcefulness/resilience, and decision-making and problem-solving skills.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.05. If at least two of those questions are to be included in a survey, question 1 can be asked once, with up to

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Each participant should only be counted once in the respondents who select at least one answer option except for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

two follow-up questions based on an affirmative response.

result of your participation in this program?

Please select the personal skills you increased. Select all that apply.

• Leadership skills

• Communication skills

• Listening skills

• Self-awareness

• Self-initiative

• Self-confidence

• Resourcefulness

• Decision-making skills

• Problem-solving skills

• Other: ______ [write-in]

• None of the above skills

E4.0.05: Percent of participants who report an increase in technical skills as a result of

Technical skills - Knowledge and ability to perform specific tasks. Examples of technical skills include project management, entrepreneurship, journalism, teaching instruction, science, technology, engineering and mathematics (STEM) competence.

• Country of origin

• Home state

• Race

To be completed by the

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.03. If at least two of these questions are to be included in a survey, question 1

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect their program participation respondents who select at least one answer option EXCEPT for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Participant type:

American, foreign, reciprocal can be asked once, with up to two follow-up questions based on an affirmative response.

result of your participation in this program?

Please select the professional skills you increased. Select all that apply.

• Project management skills

• Business management skills

• Entrepreneurship skills

• Journalism skills

• Teaching skills

• Science competence

• Technology competence

• Engineering competence

• Mathematics competence

• Other: ______ [write-in]

• None of the above skills

E4.0.09: Percent of participants reporting an increase in language skills as a result of reporting year following their program completion.

• Gender

• Age

• Country of origin

• Home state

• Race

To be completed by the

1. Did you improve your foreign language skills as a result of the program

• Yes

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect their program participation respondents who answered yes in question 1, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value

• Participant type:

American, foreign, reciprocal

If YES to question 1, ask questions 2 and 3:

2. Which of the following best described your ability to speak in that foreign language before your participation in the program?

• No ability at all

• Able to communicate only in a very limited capacity

• Able to satisfy basic survival needs and minimum courtesy requirements

• Able to satisfy routine social demands and limited work requirements

• Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

• Able to speak fluently and accurately in all situations

• Proficiency equivalent to that of a native speaker

[Use display logic to show those choices with abilities greater than the selection in question 2.]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

3. Which of the following best describes your ability to speak in that foreign language after the program?

• Able to communicate only in a very limited capacity

• Able to satisfy basic survival needs and minimum courtesy requirements

• Able to satisfy routine social demands and limited work requirements

• Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

• Able to speak fluently and accurately in all situations

• Proficiency equivalent to that of a native speaker

E4.0.14: Percent of participants reporting new digital skills/competenc ies gained from virtual exchange

(VE)

programming

Digital skill/competencies – Digital skills are defined as a range of abilities to use digital devices, communication applications, and networks to access and manage information, and to participate in a virtual program. Skills include: knowledge about various low and high-tech technologies (such as the internet, digital video, software programs, etc.), knowledge of how various technologies can be used to communicate with others, knowledge required by teachers for integrating technology into their

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

As a result of your participation in the exchange program, did you gain new digital skills/competencies?

• Yes

• No

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect classrooms, and/or creating content for various technologies.

Virtual Exchange - See Definitions of Key Terms

Virtual Elements - See Definitions of Key Terms respondents who respond “yes” to the question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants ONLY engaging with virtual program elements.

ECA Sub-Objective 4.1: Participants engage in language, academic, professional, and cultural programs

E4.1.01: Total number of participants

(core indicator)

Each participant should only be counted once per semi-annual reporting cycle following their program completion.

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award recipients - not collected from the participant surveys

Annually

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

E4.1.02: Total number of program cohorts

(core indicator)

Program cohort - A group of participants hosted separately under a program umbrella and following a set course of activities and/or study. For instance:

• IVLP is a program – each individual IVLP project conducted in a year would be considered a separate cohort.

• PFP is a program – the two groups of participants

PFP brings to the US each year are each considered separate cohorts.

• Arts Envoy is a program- each group of artists that travels is considered a separate cohort. A band or group of musicians would be considered a cohort but each individual should be counted separately as a participant.

Each cohort should only be counted once per semi-annual reporting cycle following its completion.

• Cohort type:

inbound, outbound, virtual

To be completed by the applicant

Administrative data from award

E4.1.03:

Number of

ECA-supported international scholarships provided

Scholarships - Monetary assistance provided by ECA for students and/or professionals to attend college or university abroad.

All scholarships should be counted even if more than one scholarship goes to the same individual. Scholarships should be counted once per semi-annual reporting cycle during which they were awarded.

• Amount: $0-5000;

$5001- $10,000;

$10,001+

• Participant type:

American, foreign

To be completed by the applicant

Administrative data from award recipients - not collected from the participant surveys

Semi-

Annually

E4.1.04:

Number of professional placements

Professional placement - A position placement a participant holds during their exchange program with a host institution for the purpose of professional development. These are most commonly internships, but can also include job shadowing, mentoring or a professional project as well.

• Host type: family, business/professio nal organization, academic institution, To be completed by the applicant

Administrative data from award

Semi-

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

Host institution - An institution that provides support to or benefits from the participation of program participants.

Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program.

Professional development - The act of learning and/or improving skills in order to better meet professional goals.

Professional development activities can include formal coursework, attending conferences, and informal learning opportunities situated in practice; i.e. informal peer-to-peer interaction and learning, or opportunities through knowledge sharing.

Each placement should only be counted once the placement has been completed and only once per semi-annual reporting cycle. If a participant holds more than one placement during their exchange program, each placement should be counted.

government agency

E4.1.05:

Number of participants in programs with a media literacy component

Media literacy component- An educational portion of a program that focuses on the ability to identify different types of media and the messages they are sending. It includes activities such as a training, a talk or seminar on media literacy or how to teach media literacy, training for journalism, connecting participants with media experts or providing resources for media literacy.

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Each participant should only be counted once per semi-annual reporting cycle following their program completion.

E4.1.06:

Number of participants in programs with formal, dedicated language learning activities annual reporting cycle following their program completion

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

E4.1.07:

Number of instruction methodology trainings implemented

Training - An organized activity that is designed and implemented to build capacity and has specific learning objectives – expected knowledge, skills and/or competencies to be gained by participants. Trainings of any length with this purpose should be counted. Building capacity means that recipients of training gain increased knowledge, skills, and/or competencies.

This indicator specifically measures “instruction methodology” related trainings.

Instruction methodology trainings – Those trainings related to furthering skills in teaching.

Each training should only be counted once per semi-annual reporting cycle.

N/A To be completed by the applicant

Administrative data from award

E4.1.08:

Number of language teaching fellows enrolled

Fellowship - A program that allows students and recent graduates to work with an institution on a specific project to be completed during a set period of time. Fellowships are explicitly designed to produce academic research and/or increase professional development of the fellow.

• Gender

• Age

• Home state

• Race

To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

Language teaching fellow - Through the English Language

Fellow (EL Fellow) and Virtual Educator Programs, highly qualified U.S. educators in the field of Teaching English to

Speakers of Other Languages (TESOL) participate in 10-month-long fellowships at academic institutions throughout the world.

The number of fellows enrolled in the current reporting year should be counted. Fellows are considered enrolled if they have started their program. Fellows should only be counted once per semi-annual reporting cycle even if they participate in multiple fellowships concurrently.

E4.1.11:

Number of

American reciprocal exchange participants

Reciprocal Exchange Participant - An American who travels to an exchange participant’s home country to assist the participant with their individual project.

annual reporting cycle following their program completion

• Gender

• Age

• Home state

• Race

To be completed by the applicant

Administrative data from award

E4.1.13:

Number of fellows completing language teaching fellowships

Fellowship - A fellowship is a program that allows students and recent graduates to work with an institution on a specific project to be completed during the fellowship period. Fellowships are explicitly designed to produce academic research and/or increase professional development of the fellow.

Language teaching fellow - Through the English Language

Fellow (EL Fellow) and Virtual Educator Programs, highly qualified U.S. educators in the field of Teaching English to

• Gender

• Age

• Home state

• Race

To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Speakers of Other Languages (TESOL) participate in 10-month-long fellowships at academic institutions throughout the world.

The number of fellows enrolled in the current reporting year should be counted. Fellows should only be counted once per semi-annual reporting cycle even if they participate in multiple fellowships concurrently

E4.1.14:

Number of virtual exchange

(VE) programs

Program - The overarching umbrella under which all activities take place. Or alternatively, it is the official name that is listed in ACPD’s comprehensive annual report on public diplomacy and international broadcasting

Program components - The individual program activities that cohorts participate in.

Counting frequency

Each program should only be counted once in the annual reporting cycle (by tasker

N/A To be completed by the applicant

Administrative data from award

E4.1.15:

Number of participants in virtual exchange

(VE) programs

Virtual elements - See Definitions of Key Terms

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants engaging with virtual program elements.

Each participant should only be counted once per semi-annual reporting cycle following their program completion

E4.1.16:

Number of audience members attending cultural events

Audience member - A person who attends an event and is not a program participant.

Cultural events - Can include events such as concerts or movie screenings; these can be hosted in the United States or abroad but must be done in conjunction with an ECA program.

Audience members should be counted following each event.

N/A To be completed by the applicant

Administrative data from award

Followin g each event

ECA Sub-Objective 4.2: Increase ability of participants to recognize and counter disinformation

E4.2.01: Percent of participants that report increased ability to counter disinformation

Disinformation - False or misleading information that is spread deliberately to deceive. Disinformation can include authentic information or true facts that are used in the wrong context to make false connections, or it can be outright false information or propaganda.

respondents that replied “Increased” for at least one question item while the denominator will be the total

• Gender

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

How would you rate your ability to do each of the following now compared to before program participation?

For each, please indicate if your ability increased, stayed the same, or decreased.

• Validate information I see in the media

• Identify accurate information

• Think critically about information I see online

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Evaluate everyday information I receive from multiple sources

•…