ATTACHMENT_J_6_USAID_Jordan_General_Population_Survey_Design_Report.pdf

USAID/JORDAN MISSION PERFORMANCE HOUSEHOLD SURVEY

INTRODUCTION

USAID/Jordan will conduct a large-scale survey in order to collect mission project and activity performance data. The survey measures will cover several mission performance indicators across the Development Objectives and activity performance indicators. Survey data will be used to measure mission indicator data in the Jordanian population at-large, measure mission indicator data among a population of self-identified beneficiaries, provide implementing partners with comparison group samples of non-beneficiaries, cross-reference measures against a spatial and temporal mapping of mission inputs, and explore a learning agenda to better understand the determinants of indicator performance. This document outlines an initial mapping of survey items to mission and activity performance indicator, identifies learning agenda questions to explore, and presents a survey sampling plan.

MISSION PERFORMANCE INDICATORS

The following table identifies which mission indicators the survey will measure.

Development Objective / Indicator Indicator

DO 1: Broad-based, Inclusive, Economic Development Accelerated

- 1.2.a Number of individuals with new or better employment following completion of USG-assisted workforce development programs (EG.6-1)

DO 2: Democratic Accountability Strengthened

- 2.c Percent change in perceived government effectiveness

- 2.d Citizen confidence level in select government, public services and religious institutions

- 2.4.1.b Community ability to handle stressors

DO 3: Education and Youth

- Quality of education services

- 3.c Percent of targeted at risk youth reporting preparedness to enter higher education, vocational training and/or the

- 3.2.a Number of students re-entering formal education system (partial)

- 3.2.3.c Number of youth who report increased self-efficacy at the conclusion of USG supported training/program (cross-cutting youth

DO 4: Gender Equality and Female Empowerment Enhanced

- 4.b Percentage of participants reporting increased agreement with the concept that males and females should have equal access to social, economic, and political opportunities (F GNDR-4)

- 4.c Percentage of target population that views gender-based violence as less acceptable after participating in or being exposed to USG programming

- 4.1.a Percentage of participants with increased level of knowledge and understanding of gender equality principles and women’s rights as a result of USG interventions

Annex 1 offers additional detail on specific survey items measuring a given indicator, while Annex 2 provides the draft survey instrument.

Survey data will present overall frequencies of mission performance data. This will not be a measurement of USAID programming, but will merely give a sense of current attitudes and how they vary over space. In the event of repeated surveys, then there could also be examination of the variation in performance data across both time and space.

MISSION PERFORMANCE DATA AMONG SELF-IDENTIFIED BENEFICIARIES

For each development objective indicator measured, there will be survey items eliciting respondent exposure to USAID activities, or similar activities that are consistent with a mission activity’s development hypothesis and theory of change.

Mission Indicators Activity Exposure Indicator(s)

1.2.a Number of individuals with new or better employment following completion of USG-assisted workforce development programs (EG.6-1)

- Current employment status

- Quality of current employment against most recent prior employment

- Participated in any job skills training in previous two years

2.c Percent change in perceived government effectiveness

2.d Citizen confidence level in select government, public services and religious institutions

- Seen or heard of any development projects in area

- Attended meeting with municipality

4.b Percentage of participants reporting increased agreement with the concept that males and females should have equal access to social, economic, and political opportunities (F

GNDR-4)

4.c Percentage of target population that views gender-based violence as less acceptable after participating in or being exposed to USG programming

4.1.a Percentage of participants with increased level of knowledge and understanding of gender equality principles and women’s rights as a result of USG interventions

- Seen or heard about any activity or public communication re:

gender equality, female empowerment, or gender-based violence

- Participated in any meeting or activity re: gender equality, female empowerment, or gender-based violence

These exposure indicators will be evaluated as proxies for exposure to USAID programming. More generally, they may be used to test the generic development hypothesis and theory of change of a given mission activity, regardless of whether attribution to a specific USAID input may be feasible.

MISSION PERFORMANCE DATA AMONG COMPARISON GROUP POPULATIONS

Given that the survey will be among the general population, and that USAID implementing partners would most likely conduct surveys of beneficiary populations, another use of the general survey could be to provide USAID implementing partners with comparison group measurements for a given time and geographic area. Implementing partners could then use this information to investigate the feasibility of generating comparison group measurements, and the mission monitoring and evaluation support project could provide ongoing technical assistance in this effort.

Comparison group data would likely be created with three different conditions: respondent data without self-identified beneficiaries of USAID activities, respondent data without self-identified beneficiaries from any similar activity, or all data for a given time and geographic area.

MISSION PERFORMANCE DATA MAPPED AGAINST USAID INPUTS

USAID/Jordan is currently strengthening its Geographic Information Systems (GIS) capabilities. Working in conjunction with the Monitoring and Evaluation Support Project (MESP), implementing partner reporting and other data sources could be reviewed to produce a schedule of USAID activities for a given unit of time and within a given geographic area. This information could then be cross-referenced against survey data measures to look for co-movement between USAID inputs and survey measures of mission performance indicators. MESP would produce the first reviews of fiscal year 2017 performance reporting to test feasibility of this concept.

EXPLORING A LEARNING AGENDA TO UNDERSTAND DETERMINANTS OF PERFORMANCE

There are often questions arising out of the complex implementation environments facing USAID and its partners that may not bear directly on project or activity performance, but would help the mission and its partners better understand the environment it faces, adapt to fluid conditions on the ground, and design future activities more effectively. According to the Office of Management and Budget:

A learning agenda is a set of broad questions directly related to the work that an agency conducts that, when answered, enables the agency to work more effectively and efficiently, particularly pertaining to evaluation, evidence, and decision-making. Once the questions are identified, a learning agenda also prioritizes and establishes a plan to answer short- and long-term questions of the highest value across relevant program and policy areas.

The USAID Bureau of Program Planning and Learning (PPL) extends this definition to describe a learning agenda as 1) a set of questions, prioritized and often organized around thematic areas, 2) a set of learning activities such as research, evaluation, literature review, stocktaking sessions, etc., and 3) a set of learning products that review and synthesize the evidence. Learning products may be accompanied by targeted and pithy communications such as infographics to highlight specific findings.

The following table highlights illustrative Learning Agenda questions, their sectoral / thematic origin, and a brief narration of how each question may be addressed analytically. Each question is informed by USAID/Jordan Mission and activity indicators. The MESP team will cross-reference activity implementation data against the household survey to generate knowledge on the wider outcomes of the USAID portfolio.

https://usaidlearninglab.org/sites/default/files/resource/files/defining_a_learning_agenda.pdf https://usaidlearninglab.org/sites/default/files/resource/files/landscape_analysis_report_04_10_17.pdf

Sector / Development Objective / Thematic Area Economic Development and Energy

Question(s) What are the factors that help determine unemployment or entrepreneurship? What are the greatest impediments to Jordanians starting new businesses?

Analytical Approach and Output

The survey will query respondents about whether they have ever considered taking some action to advance their economic livelihoods such as starting a micro-enterprise, registering a formal business, or accessing finance. Follow-up questions will identify what impediments the respondents faced which may have resulted in a failure to follow-through. These measures will be disaggregated by youth, gender, municipality, and other covariates as demanded. If possible, the data will be cross-referenced against USG, other donor, and government investments in workforce / enterprise development over the previous 12 months to see if there is any correlation between investments and subsequent employment.

Sector / Development Objective / Thematic Area Democracy, Human Rights, and Governance

Question(s) What is the level of citizen awareness and knowledge of Jordan’s decentralization agenda? At what level of governance does subsidiarity [decentralization] most effectively reside—local councils, municipal councils, or governorate councils? What is the locus of control for all three levels of government?

Analytical Approach and Output

The survey will ask about how Jordanians view the responsiveness and effectiveness of elected councils at three levels of local governance – local, municipal, and governorate – as well as where Jordanians turn when they require assistance. This data will be disaggregated by youth, gender, municipality, and other covariates as demanded. Reflection on this data will include a comparison between the functions assigned to these councils by law and regulation, the functions actually executed by councils, and the actual preferences of citizens. If possible, the data will be cross-referenced against USG, other donor, and government investments in decentralization and local governance over the previous 12 months to see if there is any correlation between investments and citizen perception and preferences.

Question(s) What is the relationship between citizen engagement and citizen participation? Does stronger engagement and participation lead to improved government effectiveness and legitimacy?

Analytical Approach and Output

The survey will examine citizen engagement indicators such as political party / CSO membership and media consumption against participation measures such as attending meetings or contacting elected officials. These indicators could also be cross-referenced against voting behavior using election commission data. These measures may be disaggregated by youth, gender, municipality, and other covariates as demanded. If possible, the data will be cross-referenced against USG, other donor, and government investments in citizen engagement over the previous 12 months to see if there is any correlation between investments and subsequent citizen participation.

Sector / Development Objective / Thematic Area Fragility / Resilience

Question(s) Are migrant population flows disrupting local governance institutions and economic livelihoods? How are local institutions, such as mosques, local meeting groups, CSOs, adapting and responding to the pressures of migrant population flows?

Analytical Approach and Output

The survey will ask about local migration flows in the previous 12 months, as well as compare against independent data sources on migration flows, and cross-reference this information against measures pertaining to local government responsiveness and effectiveness, community cohesion and social capital, and economic livelihoods. This data may be disaggregated by youth, gender, municipality, and other covariates as demanded. If possible, the data will be cross-referenced against USG, other donor, and government investments in local resilience over the previous 12 months to see if there is any correlation between investments and subsequent resilience.

SURVEY SAMPLING PLAN

In order to gather sample sizes large enough to disaggregate by USAID activity and beneficiary populations of USAID activities, the recommended sample size is 8,000 – 12,000. The following scenario is based on a sample size of 12,000 across 57 municipalities or city districts in all of Jordan’s governorates.

Recommended sample sizes range from 90 – 1,000 in order to achieve confidence levels between 90 and 98 percent, and margins of error between two and five percent. The following table shows sample sizes, confidence level, and margin of error for each municipality or city district.

District Subdistrict Municipality Sample size

Confidence level

Margin of error

Amman capital Amman capital 1000 98.0% 5.0% Amireah 120 90.0% 5.0%

Jizah NA Jizah 130 90.0% 5.0% Na'oor NA Na'oor 140 90.0% 5.0%

Um Al-Rasas Um Al-Rasas 120 90.0% 5.0% Governorate: Amman 1510 98.0% 5.0%

Ain Albasha NA Ain Albasha 410 90.0% 5.0% Alshoneh Alwasta NA Alshoneh Alwasta 180 90.0% 5.0%

Fuhais NA Fuhais 120 90.0% 5.0% Mahes Mahes 120 90.0% 5.0% Swaimeh 120 90.0% 5.0%

Governorate: Balqa 950 98.0% 5.0% Jabal bne Hamedah Jabal bne Hamedah 140 90.0% 5.0%

NA NA Madaba Alkubrah 460 90.0% 5.0% Governorate: Madaba 600 95.0% 5.0%

Al Hashemiyah NA Al Hashemiyah 280 90.0% 5.0% Bierain Bierain 120 90.0% 5.0% El-Hallabat El-Hallabat 120 90.0% 5.0%

NA NA Zarqa 990 98.0% 5.0% Governorate: Zarqa 1510 98.0% 5.0% Region: Central 4570 98.0% 5.0%

NA NA Ajlun Alkubrah 300 90.0% 5.0% Janed NA Janed 170 90.0% 5.0% Shafa NA Shafa 130 90.0% 5.0%

Governorate: Ajloun 600 95.0% 5.0% Al Shoaleh Al Shoaleh 120 90.0% 5.0% Alyarmook Aljadedah Alyarmook Aljadedah 120 90.0% 5.0%

Dair Abi Sa'id Jadeda NA Dair Abi Sa'id Jadeda 120 90.0% 5.0%

NA NA Irbid Alkubrah 950 98.0% 5.0% Mazar Jadeda NA Mazar Jadeda 120 90.0% 5.0%

Rabeat Al Koorah NA Rabeat Al Koorah 120 90.0% 5.0% Sahel Horan NA Sahel Horan 200 90.0% 5.0% Tabaqat Fahl NA Tabaqat Fahl 120 90.0% 5.0% Wastiyyah NA Wastiyyah 120 90.0% 5.0%

Governorate: Irbid 1990 98.0% 5.0% Alm'arad NA Alm'arad 300 90.0% 5.0%

Bab Amman Bab Amman 170 90.0% 5.0% NA NA Jarash Alkubrah 130 90.0% 5.0%

Governorate: Jerash 600 95.0% 5.0%

Alza'tary & Almansheah Alza'tary & Almansheah 120 90.0% 5.0%

Aum Qutain & Makfieah Aum Qutain & Makfieah 120 90.0% 5.0%

Bani Hashem 120 90.0% 5.0% Dair Alkahf Aljadedah Dair Alkahf Aljadedah 120 90.0% 5.0% Khaldiyah Khaldiyah 210 90.0% 5.0% Manshiat Bane Hasan Manshiat Bane Hasan 120 90.0% 5.0%

Rhab Aljadedah NA Rhab Aljadedah 170 90.0% 5.0% Sabha & Defianeh NA Sabha & Defianeh 120 90.0% 5.0%

Serhan 140 90.0% 5.0% Governorate: Mafraq 1240 98.0% 5.0% Region: North 4430 98.0% 5.0%

Aqaba city Aqaba city 540 95.0% 5.0% Hud Aldisah Hud Aldisah 100 90.0% 5.0% Qatar & Rahmah 120 90.0% 5.0% Wadi Araba Wadi Araba 90 90.0% 10.0%

Governorate: Aqaba 850 95.0% 5.0% Abdulah Bin

Ruaha NA Abdulah Bin Ruaha 210 90.0% 5.0%

Hazman - Ay NA Hazman 130 90.0% 5.0% Mu'ab Aljadedah NA Mu'ab Aljadedah 370 90.0% 5.0%

Qatraneh NA Qatraneh 120 90.0% 5.0% Sultani 120 90.0% 5.0%

Governorate: Karak 950 98.0% 5.0% Al Jafer Al Jafer 120 90.0% 5.0% Alsharah Alsharah 130 90.0% 5.0% Iel Jadeda Iel Jadeda 150 90.0% 5.0%

Shobak Aljadedah NA Shobak Aljadedah 200 90.0% 5.0% Governorate: Maan 600 95.0% 5.0%

NA NA Al Tafeilah Alkubrah 300 90.0% 5.0% Qadesiah Qadesiah 300 90.0% 5.0%

Governorate: Tafela 600 95.0% 5.0%

Region: South 3000 98.0% 5.0% National sample 12000 98.0% 2.0%

Based on sampling clustered by municipality or city district, followed by selections of neighborhood clusters within municipality or city district, design effects are estimated to be 1.6, or an inflation factor of 60 percent relative to simple random sampling.

SURVEY ANALYTICAL PLAN

The analytical plan will first look at basic descriptive statistics of mission indicators that are weighted to account for a given respondent’s probability of selection and variance inflation due to clustered sampling.

Analytical models will regress a performance indicator upon an exposure variable to estimate a treatment effect of a USAID activity, or to generically test the development hypothesis if the exposure variable is not a sufficient proxy for exposure to a USAID activity. Explanatory variables to help isolate the relationship of interest will include a set of individual level demographic variables such as youth, gender, income, nationality, and level of education. There may also be a set of ecological variables describing conditions at the level of neighborhood, municipality, sub-district, district, or governorate. The analytical models will be multi-level, in that municipalities will be nested within governorates or regions.

ANNEX 1: ILLUSTRATIVE MAPPING OF ITEM TO INDICATOR

Learning agenda question Development Objective / Indicator Survey questions

What is the current composition of Jordan’s labor market, and how has it changed in the previous 12 months? Are Jordanians gaining new or better employment in general, and/or as a result of USG, other donor, or government assistance?

1.2.a Number of individuals with new or better employment following completion of USG-assisted workforce development programs (EG.6-1)

● Compared to your most recent prior employment, would you consider your current employment to be better than your most recent prior employment, worse than your most recent prior employment, or about the same as your most recent prior employment?

● In the past two years, have you participated in any training to improve your job skills?

● How helpful was this training in helping you gain your current employment?

● Think back now to the last five years.

In the last five years, have you ever thought about starting your own business?

● What were some of the reasons you decided not to pursue this idea?

What is the level of citizen awareness and knowledge of Jordan’s decentralization agenda? At what level of governance does subsidiarity [decentralization] most effectively reside—local councils, municipal councils, or governorate councils? What is the locus of control for all three levels of government?

2.c Percent change in perceived government effectiveness

● How satisfied are you with the quality of [Drinking water, health facilities, transportation, schools, electricity, social support, roads and bridges, public spaces, trash removal, sanitation ]____ in your community?

● Have these services improved or worsened in the previous year?

● Have you visited or contacted [offices relating to above services] ___ in the previous 12 months? If yes, please rate the quality of that experience.

● How responsive do you think your [Local council, local council head, municipal council, municipal council head, governorate council, governor] is/are to the needs of the local people in this area?

● How effective do you think your [See above] is/are in delivering services to the local people in this area?

2.d Citizen confidence level in select government, public services and religious institutions

● How much confidence do you have in [See above]? Is it no confidence at all, a little confidence, a moderate amount of confidence, or a great deal of confidence?

● How trustworthy do you find [See above]?

J.3-e Number of people gaining access to safely managed drinking water services as a result of USG assistance (HL8.1-2)

What is the relationship between citizen engagement and citizen participation?

● Organizational membership

● Meeting attendance

● Voting

Are migrant population flows disrupting local governance institutions and economic livelihoods? How are local institutions, such as mosques, local meeting groups, CSOs, adapting and responding to the pressures of migrant population flows?

● To what extent would you consider your municipality to be affected by the arrival of Syrians, Iraqis, or other migrant / refugees from the last several years?

● Would you say the effect of the arrival of Syrians, Iraqis, or other migrants / refugees in your municipality to be positive, neutral, or negative? Is that somewhat or very positive / negative?

● Would you say the effect of the arrival of Syrians, Iraqis, or other migrants / refugees in your municipality has been mainly on economic conditions, mainly on the quality of local governance, or both equally?

Does development programming, or socio-economic programming in general, improve attitudes about gender?

4.b Percentage of participants reporting increased agreement with the concept that males and females should have equal access to social, economic, and political opportunities (F GNDR-4)

● Women should have equal rights with men and receive the same treatment as men do

● Women and men should have equal opportunities in obtaining a job including senior managerial positions

● Women and men should be paid equally for work of similar value

● Women are entitled to inheritance, including land

● Women’s political and economic participation are essential for the development of society

4.c Percentage of target population that views gender-based violence as less acceptable after participating in or being exposed to USG programming

● The wife leaves the house without telling her husband

● The wife neglects her children

● The wife argues with her husband

● The wife burns the food she prepares

4.1.a Percentage of participants with increased level of knowledge and understanding of gender equality principles and women’s rights as a result of USG interventions

SURVEY INSTRUMENT FOR USAID/JORDAN HOUSEHOLD SURVEY

Contents Module A: Household identification

Module B: General conditions and public services

Module C: Education Reform

Module D: Citizen Participation

Module E: Women and society

Module F: Employment

Module G: Entrepreneurship

Module H: Respondent background

Kenana Text Box Annex 2: Draft Survey Instrument for Mission Performance Survey

• A01. Questionnaire number ……………….

• A01a.Questionnaire number again ……………….

• A10.Building Number

# Question Response # Question Response

A01b Unique cluster ID A02 Governorate Name

A03 District Name A04 Municipality

A05 Sub-district Name A06 Locality Name:

A07 Area Name: A08 Neighborhood Name

A09 Block Number:

Type of Building:

• To interviewer: What kind of building did you approach?

⬜ 1. Housing Unit

⬜ 2. Not a housing unit (Business, government office, other organizations, Institution) (Skip to I01:

Enumerator Name)

⬜ 3. Unknown if housing unit (Skip to I01: Enumerator Name)

⬜ 4. Unable to gain access to the building (Skip to I01: Enumerator Name)

• What is the type of housing unit that was selected?

⬜ 1. Bungalow/Villa (Skip to the introduction)

⬜ 0. Apartment building

• We will now need to randomly select an apartment. Starting from the top on the right, count the number of apartments in the building.

• All the Hotels or any buildings exclusive for students or labors will be excluded from the study

• How many apartments are in the building?

• The system will randomly choose the apartment: Please select apartment ………………………

• Were you able to reach an adult person at the housing unit?

⬜ 1. Yes

⬜ 2. No (Skip to I01: Enumerator Name)

• To interviewer: Read the following to the person who receives you at the door (i.e. the host): Hello, my name is _____________ from Mindset. We are a research company conducting a study on behalf of the United States

Agency for International Development (USAID). We are interested in your opinion or the opinions of other family members about a number of topics, such as social conditions, culture, education, local governance, and public services. All your answers will be treated with the utmost confidentiality. Your answers or those of a family member will help us form an accurate impression of the situation in your local community, so please answer as accurately as you can. It may be helpful for you to know that we have an official permit to conduct this survey.

TO INTERVIEWER: SHOW COPY OF PERMIT. Can we proceed?

⬜ 1. Household member who received the interviewer consented to the interview

⬜ 2. Household-level refusal (Skip to I01: Enumerator Name)

Randomizer:

• We need to randomly select an adult person from your household based on a random formula. How many adult males and females currently reside in your household?

- Randomizer / Household Roster: (looping questions for every household members (adult male and adult female). (Begin from the smaller member to the bigger)

• What is the name of household member (x)?

• How old is (name)?

• What is the gender of (name)?

The system will randomly choose the respondent: “Household member (x), [selected_name], has been randomly chosen.”

• To interviewer: Ask host: Is [selected_name] present?

⬜ 1. Yes, present (Skip to introduction)

⬜ 2. Respondent away or unavailable during field period

⬜ 3. Eligible respondent is physically or mentally unable/incompetent (based on host's report) (Skip to I01: Enumerator Name)

⬜ 4. Host refused to allow selected respondent to be interviewed (Household-level refusal) (Skip to I01: Enumerator Name)

• To interviewer: Do you think it will be possible to collect the phone number of (name of eligible respondent) to contact them later? We would like to return to him/her later and would need to make sure he/she is present in the house. (This question appears if respondent is away or unavailable during field visit)

⬜ 1. Yes – Phone number

⬜ 2. No – skip to I01

• Could you please give me the number of the selected respondent? (This question appears if respondent is away or unavailable during field visit)

• Could you please give me the number of the selected respondent again? (This question appears if respondent is away or unavailable during field visit)

• Respondent Gender (This question appears if respondent is away or unavailable during field visit)

• Did you call the selected respondent? (This question appears if respondent is away or unavailable during field visit)

⬜ 1. Yes – Skip to call status

⬜ 2. No – Skip to why you didn't call the respondent?

⬜ 3. No answer – skip to I01

• why you didn't call the respondent? (This question appears if respondent is away or unavailable during field visit)

• Call status: (This question appears if respondent is away or unavailable during field visit)

⬜ 1. The respondent accepted to participate – skip to when we can revisit the respondent?

⬜ 2. The respondent refused to participate – skip to why the respondent refused to participate?

• why he/she refused to participate?

• when we can revisit the respondent?

To interviewer: Read the following to [selected_name]:

• Thank you for agreeing to speak with us today.

• My name is ______________ From Mindset. We are a research company conducting a study on behalf of the

United States Agency for International Development (USAID).

• We are interested in your opinions about a number of topics, such as social conditions, culture, education, local governance, and public services

• There is no right or wrong answer – we are only interested in your opinions in general

• You may refuse to answer any question, and you may end the interview at any time

• All answers that you do provide are completely confidential

• Your answers will help us form an accurate impression of the situation in your local community, so please answer as accurately as you can.

• It may be helpful for you to know that we have an official permit to conduct this study. TO INTERVIEWER:

SHOW COPY OF PERMIT

• May we have your permission to proceed with the interview?

⬜ 1. Yes, let us proceed

⬜ 2. No, I do not want to be interviewed (Known respondent refusal) (Skip to I01: Enumerator Name)

⬜ 3. Eligible respondent is physically or mentally unable/incompetent to participate (based on interviewer observation) (Skip to I01: Enumerator Name)

⬜ 4. Respondent language problem (Skip to I01: Enumerator Name)

Module A: Household identification

# Question Response # Question Response

A11 Geo point A12 House number

A13 Household Location:

(Street name and closest landmark)

A14 Interview Date

(DD-MON-YEAR)

• A15. Nationality:

⬜ 1. Jordanian

⬜ 2. Palestinian

⬜ 3. Iraqi

⬜ 4. Syrian

⬜ 5. Other:

⬜ 98. Refused

• A16. May we have your permission to proceed with the interview?

⬜ 2. No (Skip to I01: Enumerator Name)

Module B: General conditions and public services Introduction: Now we will start with the first section, which covers the general living conditions and public services offered.

B1. Consider how things are going in [name the municipality] lately. Would you say that, generally speaking, things in [name the municipality] are going in the wrong direction or in the right direction?

⬜ 1. Wrong direction

⬜ 2. Right direction

⬜ 97. Neither right nor wrong direction (vol.)

⬜ 98. Refused (vol.)

⬜ 99. Don’t know (vol.)

B2. Looking back, would you say that things in [name the municipality] are better or worse compared to one year ago (June 2017)? Is that a little or a lot better / worse? (Show card)

⬜ 1. Things were a lot worse a year ago

⬜ 2. Things were a little bit worse a year ago

⬜ 3. Things are about the same compared to a year ago

⬜ 4. Things were a little bit better a year ago

⬜ 5. Things were a lot better a year ago

B3. We’d like to know your level of satisfaction with various government services. I will read a list of services.

For each service, please indicate whether you are satisfied or unsatisfied with the quality of that service in your community. Please also specify whether you are somewhat or very satisfied/unsatisfied.

Service Very unsatisfied Somewhat unsatisfied

Somewhat satisfied

Very satisfied

N/A Refused Don’t know

a. Drinking Water 1 2 3 4 97 98 99

b. Sanitation Services 1 2 3 4 97 98 99

c. Health Facilities and services 1 2 3 4 97 98 99

d. Public transportation 1 2 3 4 97 98 99

e. School facilities and services 1 2 3 4 97 98 99

f. Street lighting 1 2 3 4 97 98 99

g. Electricity 1 2 3 4 97 98 99

h. Roads and bridges 1 2 3 4 97 98 99

i. Public spaces 1 2 3 4 97 98 99

j. Trash removal 1 2 3 4 97 98 99

B4. Overall, do you think that services from the government in this area have improved, worsened, or not changed in the past year? Is that improved/worsened a lot or a little?

⬜ 1. Improved (a lot)

⬜ 2. Improved (a little)

⬜ 3. Not changed

⬜ 4. Worsened (a little)

⬜ 5. Worsened (a lot)

⬜ 99. Don’t Know (vol.)

B5. During times of normal supply, for how many days per week does the household have access to the public water (from the municipality)? (answer 99 if he don't Know)

Days per week:

B6. How much was your last public water bill (from the municipality)? (answer 99 if he don't Know) In JOD:

B7. Concerning water supply, during the past 12 months, are there any times when public water (from the municipality) was not available?

⬜ 1. Yes

⬜ 2. No → B9

⬜ 99. Don’t know → B9

B8. For how long the public water (from the municipality) was not available (on average)?

⬜ 1. 1 week

⬜ 2. 2 weeks

⬜ 3. 3 weeks

⬜ 4. Almost 1 month

⬜ 5. 2-3 months

⬜ 6. More than 3 months

B9. From where do you get your main water supply?

⬜ 1. Municipality / public water only

⬜ 2. Private (I supply my own water)

⬜ 3. Both public and private

B10. Thinking about all water saving methods, what are you currently doing in order to save water?

[Enumerator: Please read each response and check all that apply] a.

Installed water-saving shower heads and low-flow faucet aerators/use water saving devices

b. Collecting and using rain water

c. Placing a brick or a bottle in the toilet tank

d. Installed water efficient plumbing products

e. Bought/using only water efficient electrical appliances f.

Checking faucets and pipes regularly for any leaks/fixing any leakage or broken pipes immediately

g. Reuse of water

h. Using a bucket instead of a hose when cleaning or irrigating

i. Using a power spray attached to a hose

j. Turning off water while teeth brushing

k. Running full loads in washing machines and/or dish washers

l. Taking shorter showers

m. Washing vegetables in buckets instead of running water

n. Turn off water while washing dishes by hand

o. Planting plants that need less water irrigation

p. None of the above

q. Other (please specify):

B11. How much money did you spend on fuel (including the money you and your family spent on fuel for car and for household use) last month? (answer 99 if he don't Know)

B12. How much was your last electricity bill? (answer 99 if he don't Know)

B13. Have you visited or contacted ____________ in the previous 12 months? If yes, please rate the quality of that experience. We’d like to know your level of satisfaction with any direct interactions you’ve had with government offices or staff. I will read a list of services. For each service, please indicate whether you visited or contacted the office of that service or an employee of that service in the past year.

B14. If you had an interaction with the office or employee of that service, please indicate whether you were satisfied or unsatisfied with your interaction with the office or employee of that service. Please also specify whether you are somewhat or very satisfied/unsatisfied with the interaction.

Venue

B12. Visited or contacted office or employee?

1 = Yes 0 = No

98 = Refused

B13. Overall satisfaction with interaction 1 = Very unsatisfied

2 = Somewhat unsatisfied 3 = Somewhat satisfied

4 = Very satisfied 97 = Not asked 98 = Refused

a. Municipal office issuing permits

b. Public health clinic or hospital c.

Electricity utility (Jordan Electric Power Company and its Offices)

d. Water utility e.

School (Where respondent’s children attend)

f. Police station

g. Governorate court

B15. In the last year (previous 12 months), have you seen or heard about any projects to improve public services in your local area, or not?

a. 1. Yes

b. 2. No → B18

c. 98. Refused (vol.) → B18

d. 99. Don’t know (vol.) → B18

B16. What projects to improve public services have you seen or heard about in your municipality?

(Consult list and go through each item)

B17. Do you consider the project to be successful in helping provide services to the people in the municipality? (Consult list and answer only if B15 is Yes)

B16. What projects have you seen or heard about in your municipality?

B17. Do you consider the project successful?

Service Not asked Yes No Yes No

Not mentioned

a. Drinking water 97 1 2 1 2 97

b. Irrigation / water maintenance 97 1 2 1 2 97

c. Sanitation 97 1 2 1 2 97

d. Roads / bridges 97 1 2 1 2 97

e. Health facilities 97 1 2 1 2 97

f. Schools 97 1 2 1 2 97

g. Electricity 97 1 2 1 2 97

h. Other: (Specify) 97 1 2 1 2 97

i. Other: (Specify) 97 1 2 1 2 97

j. Other: (Specify) 97 1 2 1 2 97

B18. Now consider your local leaders from your municipality, district, or governorate. How responsive do you think your [Insert Item] is/are to the needs of the local people in this area? Is that somewhat or very responsive / unresponsive? By responsive we mean that local leaders try to take into account the views and needs of citizens when they make decisions, and that local leaders generally try their best to respond to citizen needs even if they are not able to fully solve local problems. (show card)

Very unrespo nsive

Somewhat unresponsive

Somewhat responsive

Very responsive

Ref (vol.)

DK

(vol.)

a.

Local council (the neighborhood level elected bodies. The head of each local council is a member of the municipal council)

1 2 3 4 98 99 b.

Municipal council / Commissioners

1 2 3 4 98 99

c. c Governorate council 1 2 3 4 98 99

B19. How effective (successful) do you think your [Insert Item] is/are in delivering services to the local people in this area? Is [insert item] not at all effective, a little effective, moderately effective, or extremely effective?

Not at all effective

A little effective

Moderately effective

Extremely effective

Ref (vol.)

DK

(vol.)

a.

Local council (the neighborhood level elected bodies. The head of each local council is a member of the municipal council) b.

Municipal council / Commissioners

c. Governorate council 1 2 3 4 98 99

B20. How much confidence do you have in [Insert item]? Is it no confidence at all, a little confidence, a moderate amount of confidence, or a great deal of confidence?

None at all

A little

Moderate amount

A great deal

Ref (vol.)

DK

(vol.)

a.

Local council (the neighborhood level elected bodies. The head of each local council is a member of the municipal council)

1 2 3 4 98 99 b.

Municipal council / Commissioners

c. Governorate council 1 2 3 4 98 99

B21. Do you agree or disagree with the following statement: People like me have no impact on the decisions of municipal councils. Is that somewhat or strongly agree/disagree?

⬜ 1. Strongly disagree

⬜ 2. Somewhat disagree

⬜ 3. Somewhat agree

⬜ 4. Strongly agree

B22. Let’s talk for a moment about the migration of Syrians or other refugees into Jordan. Since 2011, would you say the effect of the arrival of Syrians or other migrants / refugees in your municipality to be positive, neutral, or negative? Is that somewhat or very positive / negative? (show card)

⬜ 1. Very negative

⬜ 2. Somewhat negative

⬜ 3. About equal measure of positive or negative

⬜ 4. Somewhat positive

⬜ 5. Very positive

B23. Compared to one year ago, do you feel that the effect of the arrival of Syrians or other migrants / refugees in your municipality is currently improving, getting worse, or remains the same?

⬜ 1. Getting worse

⬜ 2. Remains the same

⬜ 3. Getting better

B24. To Interviewer: Do not read. This is the first break off point. If the respondent wants to discontinue the interview select "break off" and save the responses that have been collected up to this point.

⬜ 1. Continue

⬜ 2. Break off - Respondent does not want to continue (Skip to I01: Enumerator Name)

Module C: Education Reform

Introduction: We have completed the first section and now we will ask you a set of questions related to education.

C1. The Government of Jordan has recently launched a major initiative to improve reading for students in grades 1-3. Have you heard about this initiative?

⬜ 1. Yes

⬜ 2. No

C2. Are you a primary caregiver for a child of school age? (can make decisions regarding the future of this child / children)

⬜ 2. No (skip to D1)

C3. Do your children currently attend public or private schools?

⬜ 1. All my children attend public schools (includes UNRWA and military schools)

⬜ 2. All my children attend private schools

⬜ 3. My children attend both private and public schools

⬜ 4. My children do not attend school (includes Jordanians who attend informal schools) D1

⬜ 5. My children attend informal schools (For non-Jordanians)

C4. How often do you meet in person with teachers at your child’s school?

⬜ 1. Never

⬜ 2. 1-2 times per year

⬜ 3. 3-4 times per year

⬜ 4. Five or more times per year

⬜ 99. Don’t know

C5. Are there opportunities to volunteer at your child’s school?

⬜ 2. No → C7

⬜ 98. Refused (vol.) → C7

⬜ 99. Don’t know (vol.) → C7

C6. Over the last year, did you volunteer at your child’s / children’s school in any capacity?

C7. How often do you read with your child/children? (or did you read if there were older children now)

⬜ 1. Never

⬜ 2. About once every 2-3 months

⬜ 3. 2-3 times a month

⬜ 4. 2-3 times a week or more

⬜ 5. Almost every day or more

C8. Considering the schools in your area, how serious of an issue is violence occurring at school?

⬜ Not an issue at all- No incidents of violence happening at school

⬜ Not very serious

⬜ Somewhat serious

⬜ Very serious

C9. To what extent do you agree or disagree with the following statement: It is appropriate for teachers and other school authority figures to hit students when they misbehave, do not do their work, or get bad grades.

⬜ 1. Strongly disagree ⬜ 2. Somewhat disagree ⬜ 3. Somewhat agree ⬜ 4. Strongly agree

Module D: Citizen Participation Introduction: We will move on to questions related to citizen participation in making a change or difference in the community.

D1. Do you belong to any types of groups where people get together to discuss issues of common interest or to do certain activities together? Examples may include sports clubs, women’s groups, business associations, trade unions, farmer’s associations, development councils, International welfare organizations, or charities.

⬜ 1. Yes

⬜ 2. No → D3

⬜ 98. Refused (vol.) → D3

D2. Please identify which groups you belong to. [Enumerator, check all mentioned] a.

Youth group (A group of youths or young persons forming a part or a unit of an organized social, political, or religious institution)

b. Sports / recreation group

c. Social group (e.g.: college class, workplace, etc.)

d. Religious group

e. Tribal group f.

Professional association (e.g.: Labor union ,Jordan restaurant association, hotels association, engineer association, etc.)

g.

Advocacy organization (e.g.: Human Rights, environmental, women’s rights organizations, etc.)

h. Women’s group

i. Community group: A group of people who live in the same community

j. Social services organization

k. Charity

l. Other:

m. Other:

n. Refused (vol.)

o. Don’t know (vol.)

D3. How often do you engage with friends and family on social networking sites about social or political issues?

⬜ 1. Never (skip to D5)

⬜ 2. A few times (2-4 times per year)

⬜ 3. Several times (5-7 times per year)

⬜ 4. About once a month (8-12 times per year)

⬜ 5. About once a week (13-50 times per year)

⬜ 6. Daily (51+ times per year)

⬜ 98. Refused (vol.) (skip to D5)

⬜ 99. Don’t know (vol.) (skip to D5)

D4. What social networking sites do you use to engage friends and family about social or political issues?

(Check all that apply)

⬜ 1. Facebook

⬜ 2. Twitter

⬜ 3. Instagram

⬜ 4. WhatsApp

⬜ 5. SnapChat

⬜ 6. Other:

⬜ 7. Other:

⬜ 99 Don’t know (vol.)

D5. In the past year (previous 12 months), how often have you visited the website or social networking page for your municipality?

⬜ 1. Never (applies if there is no website or page)

⬜ 2. A few times (2-4 times per year)

⬜ 3. Several times (5-7 times per year)

⬜ 4. About once a month (8-12 times per year)

⬜ 5. About once a week (13-50 times per year)

⬜ 6. Daily (51+ times per year)

D6. In the past year (previous 12 months) , have you attended a public meeting with the local or municipal council?

⬜ 1. Yes

⬜ 2. No → D10

⬜ 98. Refused (vol.) → D10

D7. What type of meeting?

⬜ 1. Town hall or other public meeting

⬜ 2. Civil society organization meeting

⬜ 3. Tribal meeting

⬜ 4. Informal community meetings

⬜ 6. Other:

D8. About how many times have you attended a public meeting in the last year (previous 12 months)?

⬜ 1. 1-3 times

⬜ 2. 4-6 times

⬜ 3. At least 7 times

D9. Did you speak at any of the meetings you attended?

D10. In the past year (previous 12 months) , have you ever contacted or visited a public official at any level of government, in order to share your opinion or express a concern?

⬜ 1. Yes

D11. In the past year (previous 12 months), have you ever volunteered your time to address an immediate need facing your community? Examples could include helping people in need, or removing litter on the street.

⬜ 1. Yes

D12. Consider the current problems and challenges that face your community. To what extent is your community able to manage these challenges?

⬜ 1. To no extent

⬜ 2. To little extent

⬜ 3. To moderate extent

⬜ 4. To great extent

⬜ 5. Completely

D13. In the past year (previous 12 months), have you participated in any activity involving … [ Check all that apply ] a.

Leadership skills (they involve dealing with people in such a way as to motivate, enthuse and build respect)

b. Conflict resolution / mediation

c. Communication skills

d. Advocacy / networking e.

Management (the practice of understanding, developing and deploying people and their skills) f.

Civic engagement (citizens working together to make a change or difference in the community) g.

Civil society engagement (groups or organizations working in the interest of the citizens but operating outside of the governmental and for-profit sectors

h. Did not participate in any activity

D14. In 2015, the Government of Jordan passed two important new laws: the Decentralization Law and the Municipalities Law. Have you heard about either of these laws?

⬜ 1. Yes

⬜ 2. No

D15. We’d like to get a sense of your awareness of the responsibilities of your municipal government / Commissioners. I will read a list of functions. For each function, please indicate whether you think the primary responsibility for this function lies with your municipality or elsewhere in the government.

Government function Primary responsibility of municipality Primary responsibility of national ministries Don’t know a.

Maintenance of local assets (e.g.: schools, hospitals, parks, libraries)

1 2 99

b. Trash collection 1 2 99

c. Name streets 1 2 99

d. Providing electricity 1 2 99

e. Numbering buildings 1 2 99 f.

Drafting local development plans (e.g.:

housing, transport infrastructure, education)

1 2 99

g. Delivery of drinking water 1 2 99

h. Establishing public markets 1 2 99

i. Organize public transportation networks 1 2 99

j. Establishing public parks and gardens 1 2 99

D16. We’d like to get a sense of your awareness of the mandate your municipality / Commissioners has to raise revenues in order to deliver services. I will read a list of revenue sources. For each revenue source, please indicate whether you think the municipality has the legal authority to collect this revenue, or whether the legal authority to collect lies elsewhere in the government.

Revenue source Collected by municipality

Collected by national ministries

Don’t know

a. Income from municipal investment projects 1 2 99

b. Taxes and fees imposed by the municipality 1 2 99

c. Land and Building tax 1 2 99

d. Building and construction licensing 1 2 99

e. Permitting fees 1 2 99

f. Fuel tax 1 2 99

D17. Did you vote in the local elections of August 15, 2017?

⬜ 2. No

⬜ 3. Not eligible to vote due to age at the time of the elections

D18. When making your decision about who to vote for in the local election, to whom do you turn most often for information or guidance to help you decide?

[Enumerator: do not read selections. Respondent may name up to three.]

D19. To Interviewer: Do not read. This is the second break off point. If the respondent wants to discontinue the interview select "break off" and save the responses that have been collected up to this point.

a. Family

b. Friends

c. Media outlets

d. Candidates and elected officials

e. Religious leaders

f. Community organizations, nonprofits and charities

g. Tribal leaders

h. Teachers/educators

i. Parties

j. Other:

k. Other:

l. I don’t vote

Module E: Women and society Introduction: Now we will ask you questions related to women and society.

E1. We’d like to get your opinions about women’s participation in society. I will read a series of statements.

For each statement, please indicate whether you agree, disagree, or are indifferent. If you agree or disagree, please specify whether you somewhat or strongly agree or disagree. (show card)

Strongly disagree

Somewhat disagree

Indifferent Somewhat agree Strongly agree

DK / No answer (vol.)

a.

Women should have equal rights with men and receive the same treatment as men do

1 2 3 4 5 99 b.

Women and men should have equal opportunities in obtaining a job including senior managerial positions

1 2 3 4 5 99 c.

Women and men should be paid equally for work of similar value

1 2 3 4 5 99

d. Women are entitled to inheritance, including land 1 2 3 4 5 99 e.

On the whole, men make better political leaders than women and should be elected rather than women.

1 2 3 4 5 99 f.

When jobs are scarce, men should have more right to a job than women

1 2 3 4 5 99 g.

Women’s political and economic participation are essential for the development of society

1 2 3 4 5 99

h. W Women should have the right to choose how they dress in public

1 2 3 4 5 99

E2. In the past year (previous 12 months), have you heard about any activity in your community focused on gender equality, female empowerment, or gender-based violence? By empowerment, we mean citizens and institutions support and enable women to participate fully in social, political, and economic life across all sectors. By gender-based violence, we mean any act or threat by men or male dominated institutions that inflict physical, sexual, or psychological harm on a woman or girl because of their gender.

⬜ 2. No E4

E3. Could you describe the activity(ies) in a few words?

Keywords / Topic 1:

Keywords / Topic 2:

Keywords / Topic 3:

E4. In the past year (previous 12 months), have you seen or heard any public communication in your community raising the issue of gender equality, female empowerment, or gender-based violence?

⬜ 1. Yes

E5. In the past year (previous 12 months), have you attended any public meeting focused on gender equality, female empowerment, or gender-based violence?

⬜ 1. Yes

⬜ 2. No → E8

⬜ 98. Refused (vol.) → E8 E6. About how many times have you attended such a meeting?

⬜ 1. 1-3 times

⬜ 2. 4-6 times

⬜ 3. At least 7 times

⬜ 97. Not applicable

E7. Did you speak at any of the meetings you attended?

⬜ 2. No

⬜ 97. Not applicable

E8. In the past year, have you ever joined with other like-minded citizens to take some action in support of gender equality, female empowerment, or gender-based violence?

⬜ 1. Yes

⬜ 2. No → F1

⬜ 98. Refused (vol.) → F1

E9. How successful was the group action in addressing the issue?

⬜ 1. Not at all successful

⬜ 2. Somewhat successful

⬜ 3. Very successful

⬜ 4. Completely successful

Module F: Employment Introduction: Now we will move on to the employment section.

F1. What is your current employment status?

⬜ 1. Working, full-time (applies to home businesses)

⬜ 2. Working, part-time / daily contract work (applies to home businesses)

⬜ 3. Unemployed, looking for work → F9

i. Number of months unemployed, looking for work:

⬜ 4. Unemployed, not looking for work → F9

i. Number of months unemployed, not looking for work:

⬜ 5. Homemaker (not working outside of home) → F9

i. Would you prefer to be working? Yes / No

⬜ 6. Student / Apprentice → F9

⬜ 7. Retired / Disabled → F9

⬜ 98. Refused (vol.) → F9

⬜ 99. Don't know (vol.) → F9

F2. What field do you work in?

⬜ 1. Agriculture

⬜ 2. Construction

⬜ 3. Real estate

⬜ 4. Tourism

⬜ 5.