performance_monitoring_plan_mode_2.3_02.03.2025.pdf

Last Updated: February 2025

PERFORMANCE MONITORING PLAN (PMP)

Applicant Name: Example Organization

Fiscal Year and Program Title: FY## Example Program

Funding Opportunity #: SFOP000XXXX

Instructions:

The Monitoring Data for ECA (MODE) Framework provides standard indicators and corresponding survey questions to ensure consistent measures across all ECA programs. The Performance Monitoring Plan (PMP) in this document includes ALL MODE objectives and indicators that were created to collect data from program participants. While ECA recommends the applicant use the format provided, this is not a requirement. However, any performance monitoring reference document the applicant submits should include the information in the column headers (Indicator Name, Definition, Target, Survey Question, etc.) in the table below at a minimum.

To provide a PMP that will meet the solicitation review criteria, the applicant should take the following steps:

1. Fill out the Applicant Name, FY and Program Title and Funding Opportunity # fields highlighted above

2. Carefully review the solicitation document to identify the MODE indicators that were listed

3. Review the additional (those not listed in the solicitation document) MODE Framework indicators listed in the table below to determine if they are relevant (meaning the applicant proposes that data should be collected for those indicators as part of this program)

4. Those indicators that were NOT selected in steps 2 and 3 above can be deleted from the table below (to do this, click your mouse somewhere within the row you would like to delete, right-click, select “Delete Cells”, then “Delete Entire Row”. Repeat this process until the only MODE Framework indicators that remain are those identified during steps 1 and 2)

5. Applicants may also design custom objectives and/or indicators that are specific to the proposed program and the proposed MODE

Framework indicators are insufficient to cover all aspects of the program. Applicants should limit the number of these custom indicators, bearing in mind collection and reporting capacity, and prioritize additional measures identified in the solicitation.

For all indicators in the PMP that remain after steps 2-5 above, insert the target into the appropriate column. A target specifies a feasible and appropriate level of an output or outcome that is hoped for, expected, or intended.

Resources

More resources and guidance documents on the MODE Framework and PMP are available online (https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and). PMP-specific resources include:

• MODE Framework Indicator Book (https://app.box.com/s/9gvvxzxlm6bmvzqengqu8uad40yz2doe ):

• MODE Performance Indicator Reference Sheets (https://app.box.com/s/r6x4elenw9pnicdtjyqv6rbyoczhp62t )

• PMP Creation Webinar (https://www.youtube.com/watch?v=WBHC1oLNZvI )

Definitions of PMP Columns

• Performance Indicator: An observable or measurable characteristic that indicates the extent to which a program objective is being achieved.

• Definition: Clarifies all terms necessary and provides details on how to calculate the data collected to measure the change expected.

• Disaggregation (“Disagg”): Lists how the data will be broken down into subgroups (such as: sex, age, state, country, etc.)

• Target: Specific, planned level of result to be achieved within an explicit timeframe

• Data Source and Required Survey Question: Specifies how the data will be obtained (such as a survey, observation, interview, etc.) and the mandatory question linked to the data source. Note that all MODE Framework survey questions are required (i.e. should be forced response); please see the Consent Language in the MODE Framework Indicator Book for an example of how to convey this to participants/survey respondents.

• When to Collect: Specifies when the indicator will be measured, for example: post-program, end of award, etc.

o A post-program collection should occur no later than 6 weeks after the participant has completed the program o Award recipients are responsible for collecting indicator data on participant outputs and outcomes during the period of performance of the program itself. Note: The Bureau will measure outcomes of ECA participants at one, three, five, and 10 years after the program has ended to capture the long-term impact of ECA programming unless otherwise specified in the solicitation for which you are applying. In this instance, the recipient will be responsible for coordinating with ECA on any alumni surveys to de-duplicate questions and minimize potential survey fatigue.

https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and https://eca.state.gov/impact/eca-monitoring-evaluation-learning-and-innovation-meli-unit/mode-framework-eca-applicants-and https://app.box.com/s/9gvvxzxlm6bmvzqengqu8uad40yz2doe https://app.box.com/s/r6x4elenw9pnicdtjyqv6rbyoczhp62t https://www.youtube.com/watch?v=WBHC1oLNZvI

Definitions of Key Terms

Each indicator in the table below includes a list of relevant terms in the indicator column. While terms vary across indicators, there are a few key terms that apply to a high number of indicators. Those terms are listed below to save space in the table:

• Participant or Exchange Visitor - A person who has directly participated in an ECA-facilitated program (either ECA-funded or

BridgeUSA) and been exposed to at least 10 hours of content or otherwise meets the requirements for entry into the Alumni Contact

Engagement System (ACES). Participants do not include audiences who may watch, listen to, or otherwise interact with ECA program participants.

o Participants of American Spaces programming include any individual who attends a program conducted by an American Space, whether that program is located at an American Space or an outside location. Individuals who attend virtual (online) or blended

(partially online, partially in-person) programs are also considered participants.

o “Exchange Visitors” on ECA’s Office of Private Sector Exchange (ECA/EC) programs are considered program participants.

• Host community - A community that sponsors, supports, or provides services for exchange programs and/or their participants. Host communities and institutions do not necessarily directly participate in a program. Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program. Host community members comprise two groups:

o Host families who welcomed exchange visitors into their homes;

o Host institutions or businesses who provided professional or academic experiences to exchange visitors.

• Virtual exchange - A sustained, multi-way interaction, that is 100% online, used to build networks and shared knowledge around policy priorities. For a program to be considered a virtual exchange, participants must engage with all content virtually. A series of virtual components can be considered an exchange if they are (1) originated as a unit with a collective start and end date and (2) are organized around a unifying theme. Examples of virtual elements include online skill-building workshops, virtual professional placements

(internships), and virtual mentorships. A series of massive open online courses (MOOCs) would be considered an exchange if they are offered as a set (of say six classes) and are centered on a specific topic (for example, media literacy). Offering MOOCs as an online resource is not considered a virtual exchange program.

• Virtual element - Single, stand-alone components offered as either add-on enrichment to an in-person program or as general outreach by

ECA. Examples of virtual elements include online skill-building workshops, virtual professional placements (internships), and virtual mentorships. Offering single MOOCs to the general public or virtual pre-departure orientation webinars are both considered virtual elements. Additionally, online spaces for participants to communicate (such as a program Facebook page) are considered virtual elements.

Performance

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Demographic Questions

Home Country

(Demographic)

Used to identify subgroups for Country of Origin disaggregation. (Foreign participants only)

N/A N/A Survey (self-reported data)

What is your home country?

[Drop Down: List of program countries] – See Appendix C in the Indicator Book

Post-

Program

Home State

(Demographic)

Used to identify subgroups for Home State disaggregation.

(American participants only)

What is your home state?

[Drop Down: List of U.S.

States] – See Appendix D in the

Indicator Book

Post-

Program

Age

(Demographic)

Used to identify subgroups for Age disaggregation. N/A N/A Survey (self-reported data)

What is your age? Fill in the blank ________

[Validate answer numeric, with accepted answers ranging from

15 to 100]

-- OR--

Are you between the ages of 15 and 35?

• Yes

• No

Post-

Program

Sex

Used to identify subgroups for Sex disaggregation. N/A N/A Survey (self-reported data)

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Please select your biological sex classification:

• Female

• Male

Race

Used to identify subgroups for Race disaggregation.

What is your race or ethnicity?

Select all that apply.

• American Indian or Alaskan

Native

• Asian

• Black or African American

• Hispanic or Latino

• Native Hawaiian or Other

Pacific Islander

• White

• Some Other Race

• I do not wish to respond

Post-

Program

Participant Type

(Demographic)

Used to identify the subgroup “Reciprocal” for Participant

Type disaggregation.

Award recipients will need to identify whether a participant is designated as 'Foreign', 'American', or 'Reciprocal' as part of the disaggregations. The assumption is that those who answer the "Home Country" question can be designated as a 'Foreign participant', those who answer

"Home State" can be designated as an 'American participant', and those who answer the associated question with a "yes" can be designated as a 'Reciprocal participant'

Did you participate in a reciprocal exchange?

A reciprocal participant is an

American who travels to an exchange participant's home country to assist the participant with their individual project

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

ECA Objective 1: Advance participant and beneficiary cross-cultural competence and global perspective

ECA Sub-Objective 1.1: Promote cultural exchanges and enhance understanding between participants and their host communities

E1.1.01: Percent of participants reporting that their program experience offered opportunities to engage with other cultures

Participant or Exchange Visitor – See Definitions of Key

Terms

Counting Frequency

Each respondent should only be counted once in the reporting year following their program completion.

Calculations

To calculate percentage, numerator will be number of respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Survey (self-reported data)

Do you agree with the following statement?

My program offered opportunities for making cultural connections and sharing. For example:

Conversations about each others’ countries, attending cultural events, etc.

E1.1.04:

Percent of participants with more favorable opinions of the

United States

Government

(core indicator) respondents who select “much more favorable” OR

“somewhat more favorable” on the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Did your views of the United

States government change as a result of your program participation?

If YES:

How did your views of the

United States government change? Are your views:

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Much less favorable

• Somewhat less favorable

• Somewhat more favorable

• Much more favorable

E1.1.09:

Percent of participants who traveled abroad for the first time because of their program

(core indicator)

Abroad – A country outside of one’s home country respondents who answered “no” to the first question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Before this exchange program, had you traveled outside of your home country?

Why did you travel outside of your home country? Select all that apply.

• Tourism

• Visit friends/family

• Participation in another U.S.

Department of State exchange program (including

U.S. Embassy-sponsored exchanges)

• Participation in a non-U.S.

Department of State exchange

• Study

• Work

• Other: ______ [write-in]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

E1.1.10:

Percent of foreign participants who traveled to the

United States for the first time during their program

(core indicator)

Each respondent should only be counted once per reporting year following their program completion.

To determine the percent value, numerator is number of respondents who reply “no” to the first question while denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

To be completed by the

Before this exchange program, had you traveled to the United

States?

Why did you travel to the

United States? Select all that apply.

• Tourism

• Visit friends/family

• Participation in another U.S.

Department of State exchange program (including

U.S. Embassy-sponsored exchanges)

• Participation in a non-U.S.

Department of State exchange

• Study

• Work

• Other: ______ [write-in]

E1.1.11:

Percent of

American

• Sex

• Age

• Home state

To be completed

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect participants indicating a change in their understanding of their host country's culture and values

Host country - The country in which the participant traveled to for their exchange program.

Responses to each item should be scored in the following manner:

No Change – 1

Minimal Change – 2

Moderate Change – 3

Substantial Change – 4

The response scores for each item should be summed and divided by the number of items they responded to in order to give an average question score for each respondent.

To determine the percent value, the numerator is the number of respondents whose average question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Race

• Participant type:

American, reciprocal by the applicant

How much did participation in the exchange program change your understanding or knowledge of the following topics?

• Host country political system

• Host country economy

• Foreign affairs of my host country

• Domestic affairs in my host country

• Host country values and culture

• Daily life in my host country

• Freedom of speech and press in my host country

• Voluntary community service in my host country

[Scale: No Change, Minimal

Change, Moderate Change, Substantial Change]

E1.1.12:

Percent of foreign participants indicating a change in understanding of

Third-party country - A country that is not the participant/alumni’s home or host country. Generally, this refers to the home countries of fellow participants.

• Country of origin

To be completed by the

Thinking about the participants you met from other countries

(not your home country or the

U.S.), how much did participation in the program

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect third-party countries’ cultures and values

Counting Frequency manner:

No Change – 1

Minimal Change – 2 to give an average question score for each respondent.

respondents whose average question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

change your understanding or knowledge of the following topics related to those countries?

• Political system

• Economy

• Foreign affairs

• Domestic affairs

• Values and culture

• Daily life

• Freedom of speech and press

• Voluntary community service

Substantial Change]

E1.1.13: Percent of foreign participants who are more likely to recommend the United

States as a good place to study respondents who reply “much more likely” or “somewhat more likely” while denominator will be the total number of

• Sex

• Age

• Country of origin

To be completed by the

Compared to before your program participation, how likely are you now to recommend the United States as a good place to study?

• Much more unlikely

• Somewhat more unlikely

• Somewhat more likely

Much more likely

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

E1.1.16:

Percent of virtual exchange

(VE)

participants who report VE as their only likely way to interact with citizens from other countries in the future

Virtual exchange - See Definitions of Key Terms

Virtual element - See Definitions of Key Terms

Each respondent should only be counted once per reporting year following their program completion.

respondents who answered “yes” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

This indicator counts participants involved in virtual exchange programs (see definition above) and WILL NOT count participants engaging with virtual program elements as part of a non-virtual program.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

In the future, are virtual exchanges likely to be your only way to interact with citizens from other countries?

• Yes

• No

• I don’t know

Post-

Program

E1.1.17:

Percent of foreign participants with more favorable opinions of the reporting year following their program completion.

• Sex

• Age

• Country of origin

To be completed by the

Did your views of the American people change as a result of your program participation?

• Yes

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

American people

(core indicator) respondents who reply “much more favorable” OR

“somewhat more favorable” while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

How did your views of the

American people change? Are your views:

• Much less favorable

• Somewhat less favorable

• Somewhat more favorable

• Much more favorable

E1.1.18:

Percent of foreign participants indicating an increase in understanding of

United States culture and values

(core indicator) manner:

No Change – 1

Minimal Change – 2 to give a total question score for each respondent.

• Country of origin

To be completed by the

How much did participation in the program change your understanding or knowledge of each of the following topics?

• United States democracy

• United States economy

• Foreign affairs of the United

States

• Domestic affairs in the

United States

• United States values and culture

• Daily life in the United

States

• Freedom of speech and press in the United States

• Voluntary community service in the United States

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

To determine the percent value, numerator is number of respondents whose total question score is 2 or greater while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

Substantial Change]

E1.1.19:

Percent of participants agreeing with statements in support of democratic values

(core indicator)

Democratic values - The ideas or beliefs that make a society fair, including: democratic decision-making, freedom of speech, and equality before the law.

manner:

Strongly disagree – 1

Disagree – 2

Neither disagree nor agree – 3

Agree – 4

Strongly agree – 5

Don’t know/can’t ascertain – 0

To determine the percent value, numerator is the number of respondents whose average question score is greater than or equal to 4 on a 1-5 scale while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

To what extent do you agree or disagree with the statements below?

• Voting is important because real decisions are made in elections

• Free and fair elections are the cornerstone of democracy

• An independent media is important to the free flow of information

• All citizens in a country should have equal rights and protections under the law, regardless of circumstances

• The rule of law is fundamental to a functioning democracy

• Individuals have the right to free speech and to voice opposition

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Organizations have the right to free speech and to voice opposition

• Democratic principles enhance the workplace.

Supervisors should incorporate democratic principles into their management practices

[Scale: Strongly disagree, Disagree, Neither disagree nor agree, Agree, Strongly agree, Don’t know/can’t ascertain]

ECA Objective 2: Increase the impact that participants and alumni have on their communities / countries

E2.0.01: Percent of foreign participants that volunteer in their host communities

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

To calculate the percentage, the numerator will be the number of respondents who answered “yes” while the

• Sex

• Age

• Country of origin

To be completed by the

Did you volunteer your time during your exchange?

• Yes

• No

• My program did not offer the opportunity to volunteer

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

E2.0.04:

Number of hours that foreign participants spend volunteering in their host communities

Volunteer - To offer one’s time or services to an organization or community effort for free. Volunteering does not include time spent working as part of a professional placement.

Host community - See Definitions of Key Terms

Each respondent should only be counted once in a

Participants will complete a survey question that will request the number of hours of time spent volunteering during their exchange program.

The total number of hours for all participants should be reported.

• Sex

• Age

• Country of origin

To be completed by the

How many hours did you spend volunteering during your exchange program? (Please note that volunteer hours do not include time spent working as part of your professional placement.)

Fill in the blank: __________

[validate as numeric]

Post-

Program

ECA Sub-Objective 2.2: Foster participants’ belief that civic engagement benefits communities/countries

E2.2.01:

Percent of participants who have more confidence in their ability to have an impact

Home community - The community that the program participant originates from and will return to at the conclusion of the program.

• Country of origin

• Home state

• Race

To be completed by the

As a result of your program participation, how has your confidence in each of the following changed?

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect in their home country

(core indicator)

Home country - The country in which the program participant resides prior to their program participation.

Calculation respondents that responded “more confident” to the statement about their ability to make a difference in the

‘community where I live’ and/or ‘country where I live’ while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Participant type:

American, foreign, reciprocal

• I have the ability to make a difference in the community where I live

• I have the ability to make a difference in the country where I live

• I have the ability to make a difference in the global community

[Scale: I am less confident; No change in confidence, I am more confident]

ECA Objective 3: Strengthen engagement among participants, alumni, beneficiaries, and institutions

E3.0.02:

Percent of foreign participants who report increasing their network of

Americans

(core indicator)

Network - An interconnected or interrelated group or system. In the context of MODE, this refers to an interconnected or interrelated group intentionally convened, sustained, or otherwise facilitated through ECA programming.

• Age

• Country of origin

To be completed by the

Are you still in contact with any

Americans you met during your program?

Are the contacts you maintain with Americans personal, professional, or both?

• Personal

• Professional

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

To determine the percent value, numerator is number of respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Both personal and professional

E3.0.04:

Percent of foreign participants who report increasing their network of third country nationals

Network- An interconnected or interrelated group or system intentionally convened, sustained, or otherwise facilitated through ECA programming.

Third-country national - A third country stakeholder is defined as a person or institution who does not have the same nationality and is not from the country in which the exchange took place or from the country of a participant of the exchange.

respondents who reply “yes” to the first question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

To be completed by the

Are you still in contact with any individual not from the U.S.

and not from your own country that you met during your program?

•Yes

•No

Are the contacts you maintain with these individuals personal, professional, or both?

•Personal

•Professional

•Both personal and professional

Post-

Program

E3.0.07:

Percent of participants who identify as a

• Age

• Country of origin

To be completed by the

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Department of

State program participant

(core indicator) participants who answered “yes” in response to the survey question. The denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Home state

• Race

• Participant type:

American, foreign, reciprocal

Do you consider yourself a participant of a U.S.

Department of State program?

• Yes

• No

ECA Sub-Objective 3.1: Alumni subscribe to platforms for resources and information-sharing

E3.1.02: Percent of participants who learned about new resources

Resource – Information that is new and potentially useful to the participant. Can include information guidance that is either personal or professional. Does not include persons.

Can be information provided during any portion of the program process (pre-program, during the program, or immediately post-program – such as a Congress or concluding event).

respondents who select at least one of the survey question response options EXCEPT “None of the above” to the first

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Through your program experience, did you learn about any of the following

Department of State-managed resources? Select all that apply.

• Small grants applications from the U.S. Government [Carry forward selection to next question]

• Alumni Engagement

Innovation Fund (AEIF) applications [Carry forward selection to next question]

• Citizen Diplomacy Action

Fund applications [ask of

American alumni only] [Carry forward selection to next question]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Project Development toolkits

[Carry forward selection to next question]

• Supplies or equipment [Carry forward selection to next question]

• Information on workshops/events hosted by the

U.S. Embassy in your home country [ask of Foreign Alumni only] [Carry forward selection to next question]

• Embassy network of experts and leaders [ask of Foreign

Alumni only] [Carry forward selection to next question]

• American Spaces (either

American Centers, American

Corners, or Bi-National

Centers) [ask of Foreign

Alumni only] [Carry forward selection to next question]

• Career Connections [ask of

American alumni only] [Carry forward selection to next question]

• None

For each category the respondent selects, ask:

Was this the first time you heard about this resource?

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Yes

• No

E3.1.05: Percent of participants who are connected to

ECA through a

U.S. Department of State-managed platform

Digital platform - A digital place, opportunity, or event for public discussion or interpersonal engagement intentionally convened, sustained, or otherwise facilitated through ECA programming.

respondents who select “yes” to at least one of the survey question response options while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Are you connected with the

Department of State

International Exchange Alumni

Network on the following digital platforms?

• Registered on the alumni.state.gov website

(https://alumni.state.gov)

• Follow @Exchangealumni on

Twitter,

• Connected with Alumni

Affairs on LinkedIn

(https://www.linkedin.com/in/al umni-affairs-9b871b103)

[Scale: Yes/No/I don’t know]

Program

ECA Objective 4: Strengthen personal, professional, and technical abilities and aptitudes of participants and beneficiaries

E4.0.01: Percent of participants reporting increases in their job skills as a result of their program participation respondents who reply “yes” while the denominator will be

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

Survey (self-reported)

[NOTE: This question is also included in Indicators E4.0.03 and E4.0.05. If these are to be included in a survey, this question can be asked once, with up to two follow-up questions based on an affirmative response.]

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

Did you increase your personal and/or professional skills as a result of your participation in this program?

• Yes

• No

E4.0.03: Percent of participants reporting an increase in soft skills as a result of their program participation

Soft skills - Qualities and behaviors an individual demonstrates to interact with others effectively. Examples include communication, listening, self-awareness, awareness of others, self-initiative, cognitive competence skills, self-confidence, resourcefulness/resilience, and decision-making and problem-solving skills.

Each participant should only be counted once in the respondents who select at least one answer option except for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.05. If at least two of those questions are to be included in a survey, question 1 can be asked once, with up to two follow-up questions based on an affirmative response.

result of your participation in this program?

Please select the personal skills you increased. Select all that apply.

• Leadership skills

• Communication skills

• Listening skills

• Self-awareness

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Self-initiative

• Self-confidence

• Resourcefulness

• Decision-making skills

• Problem-solving skills

• Other: ______ [write-in]

• None of the above skills

E4.0.05: Percent of participants who report an increase in technical skills as a result of their program participation

Technical skills - Knowledge and ability to perform specific tasks. Examples of technical skills include project management, entrepreneurship, journalism, teaching instruction, science, technology, engineering and mathematics (STEM) competence.

respondents who select at least one answer option EXCEPT for “none of the above skills” in the second question while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

NOTE: Question 1 is also included in Indicator 4.0.01 and 4.0.03. If at least two of these questions are to be included in a survey, question 1 can be asked once, with up to two follow-up questions based on an affirmative response.

result of your participation in this program?

Please select the professional skills you increased. Select all that apply.

• Project management skills

• Business management skills

• Entrepreneurship skills

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Journalism skills

• Teaching skills

• Science competence

• Technology competence

• Engineering competence

• Mathematics competence

• Other: ______ [write-in]

• None of the above skills

E4.0.09: Percent of participants reporting an increase in language skills as a result of their program participation respondents who answered yes in question 1, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

1. Did you improve your language skills in a foreign language as a result of the program?

If YES to question 1, ask questions 2 and 3:

2. Which of the following best described your ability to speak in that foreign language before your participation in the program?

• No ability at all

• Able to communicate only in a very limited capacity

• Able to satisfy basic survival needs and minimum courtesy requirements

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Able to satisfy routine social demands and limited work requirements

• Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

• Able to speak fluently and accurately in all situations

• Proficiency equivalent to that of a native speaker

[Use display logic to show those choices with abilities greater than the selection in question 2.]

3. Which of the following best describes your ability to speak in that foreign language after the program?

• Able to communicate only in a very limited capacity

• Able to satisfy basic survival needs and minimum courtesy requirements

• Able to satisfy routine social demands and limited work requirements

• Able to speak with sufficient grammatical accuracy and vocabulary to discuss relevant professional areas

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

• Able to speak fluently and accurately in all situations

• Proficiency equivalent to that of a native speaker

E4.0.14: Percent of participants reporting new digital skills/competenc ies gained from virtual exchange

(VE)

programming

Digital skill/competencies – Digital skills are defined as a range of abilities to use digital devices, communication applications, and networks to access and manage information, and to participate in a virtual program. Skills include: knowledge about various low and high-tech technologies (such as the internet, digital video, software programs, etc.), knowledge of how various technologies can be used to communicate with others, knowledge required by teachers for integrating technology into their classrooms, and/or creating content for various technologies.

Virtual Exchange - See Definitions of Key Terms

Virtual Elements - See Definitions of Key Terms respondents who respond “yes” to the question, while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

As a result of your participation in the program, did you gain new digital skills/competencies?

• Yes

• No

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect exchange programs (see definition above) and WILL NOT count participants ONLY engaging with virtual program elements.

ECA Sub-Objective 4.1: Participants engage in language, academic, professional, and cultural programs

E4.1.01: Total number of participants

(core indicator)

Each participant should only be counted once per semi-annual reporting cycle following their program completion.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award recipients - not collected from the participant surveys

Annually

E4.1.02: Total number of program cohorts

(core indicator)

Program cohort - A group of participants hosted separately under a program umbrella and following a set course of activities and/or study. For instance:

• IVLP is a program – each individual IVLP project conducted in a year would be considered a separate cohort.

• PFP is a program – the two groups of participants

PFP brings to the US each year are each considered separate cohorts.

• Arts Envoy is a program- each group of artists that travels is considered a separate cohort. A band or group of musicians would be considered a cohort but each individual should be counted separately as a participant.

• Cohort type:

inbound, outbound, virtual

To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Each cohort should only be counted once per semi-annual reporting cycle following its completion.

E4.1.03:

Number of

ECA-supported international scholarships provided

Scholarships - Monetary assistance provided by ECA for students and/or professionals to attend college or university abroad.

All scholarships should be counted even if more than one scholarship goes to the same individual. Scholarships should be counted once per semi-annual reporting cycle during which they were awarded.

• Amount: $0-5000;

$5001- $10,000;

$10,001+

• Participant type:

American, foreign

To be completed by the applicant

Administrative data from award recipients - not collected from the participant surveys

Semi-

Annually

E4.1.04:

Number of professional placements

Professional placement - A position placement a participant holds during their exchange program with a host institution for the purpose of professional development. These are most commonly internships, but can also include job shadowing, mentoring or a professional project as well.

Host institution - An institution that provides support to or benefits from the participation of program participants.

Benefits to this group most often occur through interaction with the participants and/or alumni during or after the program.

Professional development - The act of learning and/or improving skills in order to better meet professional goals.

Professional development activities can include formal coursework, attending conferences, and informal learning opportunities situated in practice; i.e. informal peer-to-peer interaction and learning, or opportunities through knowledge sharing.

• Host type: family, business/professio nal organization, academic institution, government agency

To be completed by the applicant

Administrative data from award

Semi-

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Each placement should only be counted once the placement has been completed and only once per semi-annual reporting cycle. If a participant holds more than one placement during their exchange program, each placement should be counted.

E4.1.05:

Number of participants in programs with a media literacy component

Media literacy component- An educational portion of a program that focuses on the ability to identify different types of media and the messages they are sending. It includes activities such as a training, a talk or seminar on media literacy or how to teach media literacy, training for journalism, connecting participants with media experts or providing resources for media literacy.

annual reporting cycle following their program completion.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

E4.1.06:

Number of participants in programs with formal, dedicated language learning activities annual reporting cycle following their program completion

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

E4.1.07:

Number of instruction methodology

Training - An organized activity that is designed and implemented to build capacity and has specific learning objectives – expected knowledge, skills and/or competencies to be gained by participants. Trainings of any length with this purpose should be counted. Building

N/A To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect trainings implemented capacity means that recipients of training gain increased knowledge, skills, and/or competencies.

This indicator specifically measures “instruction methodology” related trainings.

Instruction methodology trainings – Those trainings related to furthering skills in teaching.

Each training should only be counted once per semi-annual reporting cycle.

E4.1.08:

Number of language teaching fellows enrolled

Fellowship - A program that allows students and recent graduates to work with an institution on a specific project to be completed during a set period of time. Fellowships are explicitly designed to produce academic research and/or increase professional development of the fellow.

Language teaching fellow - Through the English Language

Fellow (EL Fellow) and Virtual Educator Programs, highly qualified U.S. educators in the field of Teaching English to

Speakers of Other Languages (TESOL) participate in 10-month-long fellowships at academic institutions throughout the world.

The number of fellows enrolled in the current reporting year should be counted. Fellows are considered enrolled if they have started their program. Fellows should only be counted once per semi-annual reporting cycle even if they participate in multiple fellowships concurrently.

• Sex

• Age

• Home state

• Race

To be completed by the applicant

Administrative data from award

E4.1.11:

Number of

American

• Home state

To be completed

Administrative data from award recipients - not collected from

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect reciprocal exchange participants

Reciprocal Exchange Participant - An American who travels to an exchange participant’s home country to assist the participant with their individual project.

annual reporting cycle following their program completion

• Race by the

E4.1.13:

Number of fellows completing language teaching fellowships

Fellowship - A fellowship is a program that allows students and recent graduates to work with an institution on a specific project to be completed during the fellowship period. Fellowships are explicitly designed to produce academic research and/or increase professional development of the fellow.

Language teaching fellow - Through the English Language

Fellow (EL Fellow) and Virtual Educator Programs, highly qualified U.S. educators in the field of Teaching English to

Speakers of Other Languages (TESOL) participate in 10-month-long fellowships at academic institutions throughout the world.

The number of fellows enrolled in the current reporting year should be counted. Fellows should only be counted once per semi-annual reporting cycle even if they participate in multiple fellowships concurrently

• Sex

• Age

• Home state

• Race

To be completed by the applicant

Administrative data from award

E4.1.14:

Number of virtual exchange

(VE) programs

Program - The overarching umbrella under which all activities take place. Or alternatively, it is the official name that is listed in ACPD’s comprehensive annual report on public diplomacy and international broadcasting

N/A To be completed by the applicant

Administrative data from award

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

Program components - The individual program activities that cohorts participate in.

Counting frequency

Each program should only be counted once in the annual reporting cycle (by tasker

E4.1.15:

Number of participants in virtual exchange

(VE) programs

Virtual elements - See Definitions of Key Terms exchange programs (see definition above) and WILL NOT count participants engaging with virtual program elements.

Each participant should only be counted once per semi-annual reporting cycle following their program completion

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the applicant

Administrative data from award

E4.1.16:

Number of audience members attending cultural events

Audience member - A person who attends an event and is not a program participant.

Cultural events - Can include events such as concerts or movie screenings; these can be hosted in the United States or abroad but must be done in conjunction with an ECA program.

Audience members should be counted following each event.

N/A To be completed by the applicant

Administrative data from award

Followin g each event

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect

ECA Sub-Objective 4.2: Increase ability of participants to recognize and counter disinformation

E4.2.01: Percent of participants that report increased ability to counter disinformation

Disinformation - False or misleading information that is spread deliberately to deceive. Disinformation can include authentic information or true facts that are used in the wrong context to make false connections, or it can be outright false information or propaganda.

respondents that replied “Increased” for at least one question item while the denominator will be the total number of question respondents. Divide the numerator by the denominator and then multiply by 100 for the percent value.

• Sex

• Age

• Country of origin

• Home state

• Race

• Participant type:

American, foreign, reciprocal

To be completed by the

How would you rate your ability to do each of the following now compared to before program participation?

For each, please indicate if your ability increased, stayed the same, or decreased.

• Validate information I see in the media

• Identify accurate information

• Think critically about information I see online

• Evaluate everyday information I receive from multiple sources

• Identify false information

[Scale: Decreased, Stayed the same, Increased]

Post-

Program

ECA Objective 8: Enhance the quality and effectiveness of ECA programs by leveraging the Bureau’s resources, policy, and stakeholder relationships

E8.0.03:

Response rate for participant surveys

(core indicator)

Response rates will be calculated and reported semi-annually on surveys that closed (i.e. ceased allowing respondents to respond) in that six-month period, even if the survey opened in the previous six-month period. This may be a single survey or an aggregation, if more than one

N/A 60% Survey Records Post-

Indicator

Definition Disagg. Target Data Source and Required*

Survey Question

When to

Collect survey closed in that six-month period. Each survey invitation should be counted once, and each response (if received) should be counted once.

The response rate will be calculated by dividing the number of survey responses received by the number of survey invitations issued (sent by email or directly invited in some other way).

Note that “survey responses” will include cases in which any portion of a survey was returned (at…