Attachment _Listening_ProgramDesign.pdf
PDF 598 KB Posted
- Solicitation number
- 72018224RFI00002
About this file
This document is a Listening Guide created to provide development practitioners with tools and methods for engaging local people early in the project design process. The guide outlines a step-by-step approach for planning, conducting, and following up on listening activities. Key elements include clarifying the purpose, assembling the listening team, selecting participants, developing tools like questionnaires and notetaking templates, addressing ethics and informed consent, facilitating the discussions, and analyzing and sharing the findings. The guide emphasizes the importance of listening to diverse local voices to inform sustainable development interventions.
The related federal contract opportunity is a Request for Information (RFI) issued by USAID/Albania. The RFI seeks information on the capabilities of Albanian organizations to support a listening tour within the framework of USAID's Local Works activity in the Lezhe region. The listening tour is intended to inform an upcoming USAID program to promote economic development and job creation through the agritourism sector in Lezhe. USAID is looking to identify existing networks, private sector entities, non-profits and other organizations that can lead this process and convene key stakeholders.
View the file
Other files
| File | Type | Posted |
|---|---|---|
| RFI_72018224RFI00002-amendment 1.pdf | ||
| USAID Albania - RFI- 72018224RFI00002.pdf |
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
© Local Systems Practice 2019
This material includes copyrighted and data proprietary to LINC LLC and not be duplicated, used, or disclosed – in whole or in part. This restriction does not limit the U.S. Government’s right to use information contained in this copyrighted material.
LISTENING FOR PROGRAM DESIGN
LOCAL SYSTEMS PRACTICE (LSP) ACTIVITY
Local Systems Practice (LSP)
Listening for Program Design
Prepared by: Millington Bergeson-Lockwood; Jenna White, LINC
Front cover: Local Systems Practice Listening Tour in Sto. Tomas, Philippines
Acknowledgements: The authors would like to acknowledge all of our LSP consortium partners for their input throughout the listening process, and the creation of this document.
About Local Systems Practice: Local Systems Practice is a USAID-funded activity that directly assists multiple USAID missions, partners, and constituents to design and adaptively manage systems-based programs in complex environments. The concept has been designed to aid
Missions and partners to overcome four specific challenges to effective Local Systems Practice through: a) Listening; b) Engagement; c) Discovery; and d) Adaptation. The Theory of Change underpinning the activity asserts that the application of systems tools to complex local challenges at multiple intervals throughout the program cycle will enhance the sustainability of programming, resulting in better-informed, measurable interventions that complement and reinforce the systems they seek to strengthen. The LSP team is composed of both development practitioners and research institutions to most effectively explore and implement systems thinking approaches with Missions, local partners and other local stakeholders. The activity is led by LINC LLC with five sub-implementers: ANSER, the University of Notre Dame, AVSI, the University of Missouri, and Practical Action.
For more information on LSP and additional resources, please visit:
www.localsystemspractice.org
For any questions or comments on the report, please contact:
Jenna White
Program Director, LINC LLC
+1 (202) 640 5462 jwhite@linclocal.org
This report is made possible by the generous support of the American people through the United
States Agency for International Development (USAID) under the terms of the award no. AID-
OAA-A-16-00077.
Disclaimer: The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government.
Table of Contents
I. INTRODUCTION 4
What is Listening? 5
Who Should Be Listened to (and Who Should Listen)? 7
When to Listen? 8
II. HOW TO LISTEN: STEP-BY-STEP GUIDE 9
Before: Planning 10
During: Listening 16
After: Analyzing and Sharing 19
III. APPENDICES 21
Appendix 1: Additional Resources 22
Appendix 2: Sample Questionnaire 24
Appendix 3: IRB Approval 27
Appendix 4: Sample Note-Taking Template 28
Appendix 5: Information Sheet Template 29
Appendix 6: Informed Consent Template 33
Appendix 7: Sample Introduction 34
Appendix 8: Listening Checklist 35
Appendix 9: Field Listening Guide Template 37
Appendix 10: Reflection Template 39
USAID Local Systems Practice 4 July 2019
“Listening is challenging. It takes time and energy, it demands attention and receptiveness, and it requires choices. Listening at both the interpersonal level and the broader, societal level is a discipline that involves setting aside expectations of what someone will say and opening up, instead, to the multiple levels at which humans communicate with each other.”
-Anderson, Brown, and Jean-Time to Listen1
I. INTRODUCTION
Local participation is fundamental to maximizing foreign assistance effectiveness. Recent assessments of efforts to expand local ownership demonstrate that local actors must influence and exert control over development interventions especially during strategy development and implementation.2 Development practitioners recognize increasingly the vital importance of including local voices and contributions as a cornerstone of the design of development projects.
Project leadership should consult, and ideally partner, with diverse local actors in setting priorities, identifying problems, and designing objectives and activities.3 This cannot happen without careful and equitable inclusion throughout all stages, but especially early on in program or activity design.
An important first step is taking the time to listen and appreciate the ideas and opinions of local people in development assisted countries. Foreign development practitioners cannot expect buy-in, local ownership, and long-term autonomous sustainability if their projects are not informed and designed based on the input of those in the best position to determine success. Listening to local development actors and potential recipients requires methods and tools to increase the likelihood that the process is valuable for all parties, produces useful information, and, most importantly, is grounded in mutual understanding, respect, and relationship building.
Supporting meaningful inclusive communication requires a certain skill set. The goal of this guide is to provide development leaders the tools and methods, as well as a framework and plan, for engaging local people early in the project design process. There are a variety of methods and tools available to project leadership to assist with data collection and facilitation. In order for true change to occur, listening must become a fundamental part of practitioners’ work and development project design.4
1 Mary B. Anderson, Dayna Brown, Isabella Jean, Time to Listen: Hearing People on the Receiving End of Aid
(CDA Collaborative Learning Projects, 2012), 7.
2 OxFam and Save the Children, “The Power of Ownership: Transforming US Foreign Assistance,” (Oxfam and
Save the Children, 2016), 18-19.
3 OxFam, “The Power of Ownership,” 26-27.
4 Thomas Carothers and Saskia Brechenmacher, “Accountability, Transparency, Participation, and Inclusion: A New
Development Consensus,” (Carnegie Endowment for International Peace, 2014), 1; See also Bill Cooke, “Rules of
Thumb for Participatory Change Agents,” in Samuel Hickey and Giles Mohan, eds., Participation: From Tyranny to
Transformation? (London: Zed Books, 2004).
USAID Local Systems Practice 5 July 2019
What is Listening?
“Listening” is an intentional, deliberative, and considerate process in which development practitioners and local people come together to discuss a common theme or question. It prioritizes the voices of participants and allows for unexpected responses and open-ended conversation. The activity requires limited resources and can be conducted over a short time period. Though it is open-ended and draws on the methods and tools of qualitative research, it has more structure than an informal conversation, and does not require the strict boundaries or rigor of a qualitative study or needs assessment. Listening is less a formal data gathering or research activity, but rather is a mutual scoping and sense-making exercise to help development organizations and programs5 hear from diverse voices and determine a path to explore for their investments.
The intent is to engage people in conversations on a particular theme and to learn and reflect together. The activity allows participants to be open to the world of possibilities and situations surrounding an issue and to work together to form mutual understandings of program context, facets of a problem, potential feasible and culturally acceptable solutions, existing constraints, available resources, and potential unintended consequences.
Listening is a fundamental first step in building relationships and trust with community actors before any sort of formal assessment or program begins. It requires participants to be keenly aware of their biases, how they communicate with others, and strives for mutual trust and respect. The purpose is to draw on local knowledge and experience to better understand problems and inform improved solutions that can be locally owned and sustained.
Listening Best Practices
While specific techniques can vary, abiding by several core best practices helps assure that data is collected with every reasonable effort made to advance local participation and inclusive engagement based on mutual respect and trust.
Do Your Research: Know what you are getting yourself into. Before talking to local people learn as much about local context as possible. Read or talk to local experts about the issues at stake, but most importantly any cultural concerns or pitfalls. Investigate prior development interventions; from both your organization and external actors. Use this basic knowledge to inform conversations with local counterparts, shape initial lines of inquiry, and determine the most appropriate approaches and methods.
Be Honest: Your presence in a community is likely to raise expectations. As such, it’s important to be clear about why you are in the community, and what the community can realistically expect from you and your organization in the future. Be honest about your limitations. Understand your own biases and how those might influence your reception of information. Be clear about the rationale behind your decisions and decision-making process.
Be prepared to share these understandings honestly with those you meet.
Dayna Brown (2018). Reflections on Working with USAID Missions on Listening. Unpublished Manuscript.
USAID Local Systems Practice 6 July 2019
Meet People Where They Are: Local counterparts should set the agenda and context for engagements. Interactions with local people should be as unobtrusive and convenient for participants as possible. Data collection should happen on terms set by the participants in a fashion and environment most accessible and comfortable for them. Activities should be in the language most comfortable for the local participants.
Be Present: Listening is a skill that requires focused attention. It requires the listener to be quiet long enough to let the participant talk. It also requires the listener to drop his or her expectations of what will be said.6 Technology including cell phones and laptops can create barriers as they may be perceived as distracting the user’s attention away from the conversation.
Treat Data with Respect: Information from local participants is their valuable property. It should be collected ethically with informed consent. It should be protected, and privacy or anonymity should be guaranteed. Communities have a right to know how their contributions are used and have the right to refuse to participate.
Listening Ethically
Listening session organizers and facilitators should abide by the principles set out in the Belmont
Report on respect of persons, beneficence, and justice.7 All efforts should be made to protect participants and their information. Pay special attention to any sensitive information that could place the speaker at personal, profession, or legal risk. Avoid questions that could expose such information.
At the start of all listening sessions you should explicitly:
• Explain the purpose and procedures of the listening session and how you plan on using the information.
• Allow all participants the opportunity to refuse to participate in the conversation. No one should be coerced (by you, or an interlocutor) to participate in a conversation.
• Inform participants that they are free to end the conversation at any time, without an explanation.
• Ask for permission to take notes or record proceedings. Honor requests not to record specific statements and destroy your notes if asked.
• Ask participants to keep what is said in the discussion among the members of the group, and not to share contents of the discussion with others. This includes no posting any content
(photos, quotes, etc.) on social media.
6 Mary B. Anderson, Dayna Brown, Isabella Jean, Time to Listen: Hearing People on the Receiving End of Aid
(CDA Collaborative Learning Projects, 2012), 7.
7Office for Human Research Protections, & Ohrp. (2018, January 15). Read the Belmont Report. Retrieved from https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/read-the-belmont-report/index.html#xbasic
USAID Local Systems Practice 7 July 2019
Vulnerable Populations
There are specific groups designated as
“vulnerable” who should be treated with extra care.
If you require input from a “vulnerable” population
(e.g. you are developing a program for them), it is best to look at protocols that exist both within your organization, and within the specific country you are working for guidance.
Illegal or Harmful Behaviors
If you are made aware of, or observe an illegal or harmful behavior, you MUST:
• Inform the participant that there are limits to confidentiality. You are ethically and legally obligated to disclose the identity of the participant to forestall imminent harm to self or others.
• Emphasize the right of the participant to withdraw from the conversation or to refuse to answer any question.
• Contact your organization’s legal representative immediately to discuss the protocol for disclosing information related to imminent harm or an imminent illegal act.
Who Should Be Listened to (and Who Should Listen)?
It is important to listen to a broad, yet relevant population. Consider carefully who will be present during the listening sessions, both as listeners and as participants. Who attends can influence the dynamics of the conversation, the topics discussed, and the reliability of the information shared. Recognize that everyone has bias that is hard to eliminate, but necessary to identify and mitigate.
Who Should be Listened To?
When choosing whom to listen to, consider the following:
• What groups of people are most connected to project’s central problem?
• Whose perspectives are important to capture?
• Do you have enough diversity of people and perspectives on the issue;
• Have you considered gender and cultural equity?
• Provide opportunities for participants to nominate others to be included, and then follow up.
• If relying on intermediaries, consider the potential bias of these individuals in picking participants.
Who Should Listen?
When choosing who should join the field listening team, consider the following:
• How will the community perceive the listeners?
• Impact of socio-economic differences
• Pros/Cons of using external foreign researchers vs. “locals”
• How experienced is the listening team?
Types of Vulnerable Populations
• Pregnant women
• Prisoners
• Children (under age 18)
• Cognitively impaired persons
• HIV/AIDS positive individuals
There are other “special” classes of people, with whom extra care must be taken, such as:
• Employees (recommended to not have conversations where employees are with their boss)
• Cultural or social minorities
• Economically and/or educationally disadvantaged
USAID Local Systems Practice 8 July 2019
• If the listening team includes individuals who are not experienced researchers, they must receive training prior to participating, including ethics and bias awareness
• Do the project leaders/designers need to hear from people directly, or can they rely on records of the meeting?
It is a best practice to communicate first with local officials so they know who will be in their community and why. As a result, you may find that it makes sense to pay a courtesy visit to a mayor’s or other local politician’s office. However, be aware of the dynamics that are created when speaking to community members in a municipal building.
When to Listen?
Although listening can be helpful in the early stage of all development programs it is especially well suited for situations when development practitioners are:
• Delving into a new subject or program area with which they are less familiar.
• Interested in working in a new geographic area or with a new population.
• Facing an intractable problem that prior interventions were unable to address.
Local voices should be engaged throughout the project design process. The following list presents listening opportunities throughout a typical project design cycle:
PRE-PROJECT DESIGN PLANNING
• Meet with local subject matter experts and community members about broad development issue or objective
• Conduct listening sessions around social/cultural context
PROJECT DESIGN PLANNING
• Engage local communities around project purpose
• Conduct listening activities as part of analyses
• Include local representatives on project design team
PROJECT DESIGN
• Engage local voices in defining a Theory of Change:
o Assessing Problems o Defining Solutions
• Use listening exercise to explore project context and potential local resources
• Hold conference to review analysis findings
• Engage with local voices during activity design
• Reference findings from previous listening activities to inform design
• Include local representatives on project design team
Pre-Project Design
Planning
Project Design Planning
Project Design
USAID Local Systems Practice 9 July 2019
II. HOW TO LISTEN: STEP-BY-STEP GUIDE
While every situation is different and the process should be kept flexible, there are several important steps to keep in mind before, during, and after a listening exercise to assure the listening sessions go smoothly and that all participants gain the most value for their time.
After: Analyzing and
Sharing During: Listening Before: Planning
• Clarify Your Purpose
• Assemble Your Team
• Pick Your Geography
• Identify Participants
• Develop Tools
• Organize, Schedule, and Budget
• Conduct a Pre-
Departure Orientation
• Finalize Plan with
Local Contact
• Address Ethics and
Informed Consent
• Set Ground Rules
• Lead Discussions
• Reflect and Debrief
• Reflect and Analyze
• Follow-Up
• Disseminate Findings
• Share Lessons Learned
USAID Local Systems Practice 10 July 2019
Before: Planning
Prior to visiting the field, listening session organizers should take the time to carefully plan the exercise.
The steps below should all be undertaken during the planning stage. They are presented in a sequential order for ease of navigation. However, some of the steps are dependent upon others and the process is more iterative than linear.
Clarify Your Purpose
The purpose of the listening exercise should be well understood by the entire team and it is important to have a clear objective. To begin, the listening team should develop an overarching question or theme that guides the exercise. This could be derived from a program strategy or development objective. It is important to keep the initial topic focused on your objective, but broad enough to solicit diverse feedback from diverse participants.
Before beginning the listening process, you should have a clear idea of how your findings from listening will be used, and by whom. Think about what materials will be useful for different audiences and decision-makers. You may need to create a combination of materials, ranging from detailed reports to a summary document with high-level descriptive statistics and representative quotes. However, given that listening is inherently a qualitative exercise, the focus should be on qualitative data analysis.
Before you embark on a listening exercise you should be able to answer the following questions:
• What am I trying to learn?
• What will the insights from this activity inform? (E.g. strategic, program, or budget decisions).
• With whom will I need to share the results of this activity? (E.g. decision-makers, program teams, etc.)
• What kinds of information will be most useful for these stakeholders?
• How do I envision sharing the information I gather? (I.e. What will the outputs or deliverables be?)
Assemble Your Team
Identify a Listening Lead: The listening lead oversees the entire listening process. They may be an organization employee or an external hire/consultant. This person should have the knowledge and experience necessary to define the teams, choose the most appropriate methods and tools, and
After: Analyzing and
During: Listening Before: Planning
USAID Local Systems Practice 11 July 2019 supervise the final data analysis and validation. The listening lead is also responsible for any necessary training and orientation of field team members.
Identify a Logistics Coordinator: The logistics coordinator serves as a bridge between the internal team and external contacts. The coordinator should work with local partner organizations, community leaders, and other local representatives to plan the listening process.
Areas of support that the coordinators may provide include, but are not limited to:
• Coordinating logistic arrangements (transportation, accommodations, schedules, selection of communities, etc.)
• Providing security briefings for listening teams when needed
• Booking facilities for listening sessions
• Coordinating the provision of materials for the group sessions (paper, pens, flipcharts, meals, etc.)
• Coordinating submission of individuals’ and teams’ notes and/or feedback on reports
• Supporting the dissemination of findings to participants, communities, and others
Identify Members of Listening Teams: Listening teams should include at least 2 and no more than 4 members, including:
• Conversation Lead (required), a relevant programmatic sector expert; responsible for introducing the meeting and leading the discussion.
• Notetaker (required), responsible for capturing the information through notes and other media such as photographs and recordings.
• Other Listeners (optional), other relevant team members who listen, but defer to the conversation lead to lead the discussion. Ask questions as appropriate and verify understanding of what was said with the notetaker and conversation lead.
• Translator (optional), responsible for providing real-time interpretation if necessary. Must be fluent and experienced in translating all relevant languages.
• Driver (required), responsible for transportation to and from listening session site and additional logistics if necessary. The driver should not sit in on listening sessions.
The team may also be joined by a local contact who acts as an intermediary with local groups.
Listening teams should not rely on the local contact, however, for translation or other formal service during the listening session. Additional observers, not directly participating in the session, are not recommended as they can be distracting to participants and may negatively impact the quality of discussion.
Other Considerations: When organizing your listening teams, there are several important things to consider:
• Language - When possible, the conversation lead and notetaker should be fluent in the local language/dialect. If this is not possible, a translator is required to conduct the session. The translator must be fluent in the relevant language and experienced in real-time word for word rather than summary translation. When using a translator, prepare in advance to understand expectations. Avoid common pitfalls such as speaking directly to the translator rather than the participant or engaging in side conversations during translation.
USAID Local Systems Practice 12 July 2019
• Gender - All listening session teams must uphold gender equity in discussions. If necessary, you may have to organize single gender teams. In some contexts, this may be more culturally appropriate and important to ensure that women are able to participate. Single gender teams can help to create an environment for persons to air gender-specific concerns or be more comfortable speaking honestly.
• Local Context and Dynamics - When assembling listening teams and hiring translators, it is important to understand what groups may have tensions with others and why. These could be rooted in ethnic, religious, or political differences, or in government or corporate interests that are in conflict with the communities being visited. It may be necessary to match the listening team, as much as possible, to the social profile of the community being visited.
If this is not possible, it may be advantageous to use staff from a totally different context to listen in these areas as they may be seen as more impartial. This can be one area where expatriates may have the advantage of being seen as less influenced by local politics or tensions. Discuss with local staff, partners or community members how to ensure that listening teams do not endanger or otherwise negatively impact the people whom they are engaging and if special measures need to be taken to mitigate potential negative consequences.
Assign Debriefing Lead: When working with multiple teams in a region, one team member should be tasked with coordination and facilitation of debriefs and analysis of conversations.
When geography and budgets allow, it is ideal for all teams to meet at the end of each day to discuss and compare what they heard. This way, participants from each team can share, analyze, reflect, and learn as they go. They can also engage community members in the analysis and identify special issues to follow up on in subsequent conversations based on what was learned from the teams’ conversations. The debriefing lead should help guide this process and should ensure that there is a record of what each team heard and the analysis. If each team does not have access to a computer to write up notes, this person may need to verbally debrief with each team, typing up the notes as they share what they heard.
Pick Your Geography
The listening lead, in consultation with local and project experts, should work to determine the regions and communities to be visited and key people in these communities to engage in conversations. It is important not just to go to easy-to-reach areas and to communities that are visited frequently. The learning process will be enriched by the inclusion of a broad range of locations and people in communities who have different perspectives, while also remaining relevant to the central research question. Planning sessions should include organizers who are knowledgeable about the local context and who can inform decisions about where to go and who to include.
Identify Participants (Who to Listen To)
Keeping the research purpose in mind, teams should listen to a diverse representation of community members and leaders, local authorities, and members of community-based organizations. They may also seek out the views of people in other aid agencies, civil society organizations, government, religious institutions, businesses, academia, media, and others. There
USAID Local Systems Practice 13 July 2019 should also be some intentional selection of other community members or stakeholders to ensure that teams are not hearing from the “usual suspects.” This can be accomplished by asking participants to nominate others with whom the group should speak. Since many aid efforts target the most vulnerable or marginalized, it is helpful to discuss how to identify these persons with local partners and staff.
Develop Tools
Design Your Questionnaire/Discussion Guide: One of the most important and necessary parts of planning for a listening excursion is the careful design of the topics to cover and general questions to ask during a session. While the questions should be broad enough to allow for independent thought and varied opinions of the participants, you will want to fit questions around a common theme related to the proposed project goals or problem to solve. Refer back to your stated purpose as you develop your discussion guide.
You should develop a few guiding questions to serve as prompts. Developing a discussion guide is a good starting point as it provides enough direction to keep the conversation focused on relevant topics and leaves enough space for respondents to introduce unexpected related concepts or information. A sample discussion guide can be found in Appendix 2.
Consider how different audiences will react to and understand questions. Make sure your questions are simple and easy to understand. You might consider vetting your questions and practicing with “in house” local participants in your organization. This is also a good opportunity to practice facilitation and note-taking skills.
Once you have completed your questionnaire, you should consider if IRB approval is necessary and submit it to any relevant offices for review. See Appendix 3 for additional information on
IRB approval.
Develop a Notetaking Template: You will also need to develop a template and specific guidance for the notetaker in each conversation to ensure consistency across conversations, and a record that is rich enough to analyze. Be sure to update the template to capture specific pieces of information that will be important to have recorded for any analysis you plan to do. For example, if you need to ensure gender balance in your listening activity, ensure that your notetaker is capturing the number of men and women in the room. Or, if you envision a report with exemplary quotations for each main finding, ensure you are requiring notetakers to capture direct quotes. An example note-taking template is provided in Appendix 4. Note that this is not a universal design, but rather a helpful starting point for developing your own template.
Creating a Discussion Guide Prior to a listening activity, prepare a written guide for conversation leads.
• Keep it simple; ask short and easy to answer questions in words that participants understand
• Focus on topics participants are familiar with
• Maintain a logical flow and structure
• Limit to one to two pages.
• Cover no more than 5 sub-topics.
Source: Source: Skovdal and Cornish, Qualitative
Research for Development, 66.
USAID Local Systems Practice 14 July 2019
Organize, Schedule, and Budget
Consider Details of Logistics: Once you have defined the scope and geography for your listening exercise, it is time to plan logistics. The more logistics planning you do beforehand, the less likely you are to run into problems with meals or accommodation once in the field. Begin by answering the following questions:
• How will you travel to each site?
• Where will you stay?
• Where will you take your meals?
• Will you provide refreshments for participants during the day?
• Will you be expected to provide allowances and/or travel costs for participants?
Once you have answered these questions, check your budget to confirm you can cover your costs plus some extra for any unexpected expenses.
Create a Flexible Schedule: Listening requires a flexible schedule. A listening exercise can take anywhere from one day to one week or longer, depending on the objectives, resources, available staff time, and schedule of potential participants. Conversations could occur in several regions/locations concurrently, or teams could visit different locations consecutively.
Participating staff could also facilitate listening sessions on previously scheduled visits to communities spread across a set timeframe (i.e. quarterly) as part of another ongoing development activity. Regardless of the model, for the listening process to be most effective, organizations need to commit dedicated and uninterrupted time to listen and engage with local community members.
Pre-Departure Orientation
Prior to departure, make sure everyone involved in the listening exercise understands the objectives, as well as defined policies and protocols. You should hold preparatory trainings and/or orientations to make sure all team members have the necessary knowledge and skills to participate meaningfully. In addition to covering logistics, you should review the questionnaire, and notetaking template and guidance with team members. Last-minute participants who wish to
“just observe” the process should be advised not to participate.
All attempts should be made to be generally consistent during the sessions, with space allowed for flexibility as the conversations evolve. Everyone should have a field guide with the itinerary, list of participants, local contact information, and facilitation materials.
If community-based members, local staff or volunteers are joining the listening effort but cannot attend the pre-departure orientation, plan to provide a brief orientation and include any translators as well once you arrive.
Refreshments and Compensation for
Participants
• It is appropriate and welcomed to provide simple refreshments for listening session participants (tea, soft drinks, water, small snacks, etc.)
• You may be asked to provide some financial compensation or reimbursement of travel costs. In this case, consider how compensation may influence the motivations of participants and distort responses. Also check with your organization for relevant policies.
USAID Local Systems Practice 15 July 2019
Planning Toolkit: Included in the appendices are sample tools and resources including:
• Appendix 2: Sample Questionnaire
• Appendix 3: IRB Approval
• Appendix 4: Sample Note-Taking Template
USAID Local Systems Practice 16 July 2019
During: Listening
Listening is about more than the conversations you have. Ensure success of your listening endeavor by coordinating with a local contact, and carefully capturing and reflecting on what you hear.
Finalize Plan with Local Contact
Meeting with Local Contact upon Arrival: You should take time to meet with the local contact representative from the listening group. This person may be a local leader or one of the participants. Reiterate the purpose of your visit and ask if there are any issues the team should be aware of such as impactful recent events, cultural concerns, etc. You may also ask the contact to review your questions to make sure they are acceptable.
Introduce your team members and their roles to the local contact. In addition to your role within the organization, let your contact know who will be leading each discussion, who will be the primary notetaker, and any other roles that team members will be taking on during the discussions. This will relieve the local contact of the pressure of trying to induce all of your team members to speak or offering to take notes on your behalf (which should be gently declined if offered).
Courtesy Meetings: Work with your local contact to ensure any appropriate courtesy meetings are arranged. It is always a good idea to contact a local government representative in advance of the activity to obtain buy-in for the activity. Aim to have a brief courtesy visit prior to beginning listening activities in his/her community. Time permitting, you may also offer an outbrief meeting at the conclusion of your visit to share anonymous findings. However, hosting conversations at municipal offices should be avoided. Also, bringing representatives from local government along on the listening tour will have an impact on your conversations. Determine in advance how to best respond to offers to host meetings at government sites, or to have government officials participate as part of the listening team.
Address Ethics and Informed Consent
Introductions: When you arrive, allow time for the local contact to speak and introduce the listening team. Thank all participants for their time. Introduce yourselves and give all participants the opportunity to do so. Introduce your organization and explain its main mission.
Explain the purpose of the listening activity and your objectives. Be as general as possible to manage expectations, while also addressing the core questions. Do not make any promises of remedies or future programming.
After: Analyzing and
USAID Local Systems Practice 17 July 2019
Informed Consent: Take the time to address privacy and informed consent issues. Give the participants an opportunity to refuse to participate. Explain that they are free to leave and end the conversation at any point or refuse to answer any question. Ask for permission to take notes or record the discussion.
It is a best practice to have all participants sign a photo release and/or an informed consent document
(See Appendix 5).
Set Ground Rules
Prior to beginning the discussion, explain the format and establish ground rules for the conversation. This might include any instructions about engagement activities and statements about decorum. Assure participants that all ideas and opinions are welcome. Encourage thoughtful and respectful disagreement. If possible, encourage participants to eschew adherence to systemic hierarchies in order to ensure free space and honest answers.
Your team must be mindful that you cannot control whether or not members of a group discussion share information they have learned with others after the discussion. Do not directly ask questions that may put participants at risk.
Appendix 7 contains a listening checklist that can be used by teams to ensure that they are prepared for useful, ethical discussion.
Lead the Discussion
Rather than diving into your questions, begin with a warm-up or ice breaker questions.
Sometimes sharing information about yourself first can encourage others to do so. Appendix 8 contains an illustrative field guide that can be used as a reference by the facilitator.
There are multiple methods and tools available to facilitators. Links to some of these tools and methods are included in the list of additional resources in Appendix 1. Regardless of your facilitation strategy, begin with an open-ended, and strength-based question. Questions such as, “What has been your biggest success in the last year?” can help get the conversation started in a positive direction. Avoid initial questions that focus on what you perceive to be weaknesses about the community, organization, or social intervention, etc. of interest.
Things to Keep in Mind During
Discussion
• Avoid raising expectations and discussing potential projects.
• Be in the moment; avoid multi-tasking or distraction (e.g. using phone).
• Do not refer to your activity as an
“interview” or refer to participants as
‘subjects’ or ‘respondents.’
• Be aware of certain people dominating the conversation and encourage everyone to speak.
• Ask questions one at a time and give the group time to discuss.
Technology and Note Taking
• Live notetaking and immediate reflection are best practices as a recording device can be distracting and encourage facilitators to pay less attention during the session.
• Consider cultural mores, any privacy concerns, or topic sensitivity.
• If you must use a recording device, make sure it is tested and suitable for the environment.
USAID Local Systems Practice 18 July 2019
Press participants on their answers to understand why they said what they did.
When possible, push participants to respond to one another. Be attentive to conversational equity and make sure that everyone has a chance to speak. Pay special attention to the participation of women and any marginalized participants and make sure their voices are heard and validated. Give the participants the opportunity to ask you questions.
Provide Contact and Follow Up Information:
At the conclusion of the conversation, thank all participants and if appropriate, commend their role in the community (e.g. important role as parents and teachers). Explain your next steps and how you plan on using the information the participants have shared with you. Provide all participants with contact information (telephone and email) so they may follow up with you if they like. If your organization allows, you might consider setting up a separate phone number or email account for such communication.
Reflect and Debrief
Reflect Individually: As soon after the conclusion of the listening session as possible, the conversation lead should independently document the experience and his/her reflections. This may be done using a free-writing journal exercise or a template (see Appendix 9). It is important that the most significant moments, statements, or reflections are captured.
Debrief Together: Once reflections are captured independently, debrief together and add any additional details about the session. These reflections along with your notes will form the basis of your analysis
Types of Things to Say:
• Introductory: “Can you tell me about…(be concrete)
• Follow-up: “mmm…; nod; repeat key words; build of a specific interesting statement.”
• Probing: “Can you say a little more?; Why do you think…?”
• Specifying: “Can you give me an example?”
• Direct (best for later in session): “When you mention…are you thinking about…or…?”
• Indirect: “How do you think other people view…?”
• Structuring: “Thank you for that. Let’s move on to another topic…”
• Interpreting: “So what I have gathered is…”
• Silence: [Leave time for participants to break silence or elaborate]
Source: Skovdal and Cornish, Qualitative Research for
Development, 70.
Listening Toolkit: Included in the appendices are sample tools and templates including:
• Appendix 5: Information Sheet Template
• Appendix 6: Informed Consent Template
• Appendix 7: Sample Introduction
• Appendix 8: Listening Checklist
• Appendix 9: Field Listening Guide Template
• Appendix 10: Reflection Template
USAID Local Systems Practice 19 July 2019
After: Analyzing and Sharing
In order to be useful, your findings must be analyzed, summarized, and shared.
Reflect and Analyze
Organize Joint Analysis and Reflection Sessions: Once back at the home office, all listening team members should participate in a final group analysis and reflection session involving all listening teams. Drawing from each notetakers’ official notes, individual notes, and immediate post-listening reflections, this is an opportunity to discuss and analyze what people said, compare notes, identify key issues and trends, and reflect on what is important to share with colleagues, partners, other stakeholders, and also with those they engaged in conversations.
Further Analyze Data: Task someone with qualitative analytical capabilities on the team to read and analyze all of the notes, or reflection templates as well as the notes from the joint analysis and reflection sessions. Ensure that all materials are captured in one place for future reference.
Someone with analytical capabilities should at a minimum review all of the notes or templates to ensure that key themes are captured systematically. In the majority of cases this analysis can be done simply with a spreadsheet and simple coding. This analyst should highlight any discrepancies between his/her analysis of source documents and the takeaways from the joint analysis and reflection sessions. If there are discrepancies, an additional joint reflection session should be held to resolve any conflicting findings or takeaways.
Follow Up
Follow Up with Session Participants: It is crucial that the findings from the sessions be presented to the participants themselves for feedback and validation. If possible, you may want to reconvene all participants of the listening sessions in a central location. This allows the listening team to share a high-level summary of what they heard, and for community members to provide additional feedback and validation of conclusions. It also continues the significant trust, transparency, and relationship building. If this cannot be done in-person, consider a webinar or conference call if contextually feasible and appropriate.
If a formal central meeting is not feasible, ensure that you have a plan for sharing summary information back with the community. This may be done via return visits to particular communities. Alternatively, your local contacts may share a summary document with community members and allow for participants to follow up with feedback or express concerns.
After: Analyzing and
USAID Local Systems Practice 20 July 2019
Disseminate Findings
The Listening Lead should oversee written documentation of the listening exercises that summarize the issues and the analysis, including stories, examples and quotes (using pseudonyms). If the Listening Lead is unable, another person should be designated to draft the documentation, get feedback from other listeners and finalize materials. If possible, the documentation (report, presentation, etc.) should be translated and shared broadly with people engaged in the conversations as well as with those working in similar areas or focusing on similar issues. This might include government agencies, UN agencies, international and local organizations and networks, other donors, researchers, academics, and other interested parties.
The most important thing is that the data and findings are made as public as possible considering local privacy and security issues.
Share Lessons Learned
Participating staff and organizations should reflect on the lessons learned from the listening process and share with other groups who are interested in or planning to engage in their own listening activities. If possible, reflections should include not only the staff who organized and led the sessions, but also a sample of people who were participants in the conversations.
USAID Local Systems Practice 21 July 2019
III. APPENDICES
General
1. Additional Resources
Before: Planning
2. Sample Questionnaire
3. IRB Approval
4. Sample Note-Taking Template
During: Listening
5. Information Sheet Template
6. Informed Consent Template
7. Sample Introduction
8. Listening Checklist
9. Field Listening Guide Template
10. Reflection Template
USAID Local Systems Practice 22 July 2019
Appendix 1: Additional Resources
General Listening and Development
• USAID, Suggested Approaches for Integrating Inclusive Development Across the Program
Cycle and in Mission Operations: Additional Help for ADS 201 (July 2018).
• Mary B. Anderson, Dayna Brown, Isabella Jean, Time to Listen: Hearing People on the
Receiving End of Aid (CDA Collaborative Learning Projects, 2012)
• Morten Skoval and Flora Cornish, Qualitative Research for Development: A Guide for
Practitioners (2015)
Engagement Tools
While engaging with local participants, it is sometimes helpful to use certain tools or methods to encourage participation and critical thinking. You will need to carefully assess your situation and local feedback to determine which technique may be right for you. There are many to choose from, but here are some favorites:
Method Description Reference
World Café The world café method is a way to manage dialogue among a large group of people.
http://www.theworldcafe.com/key-concepts-resources/world-cafe-method/
Drawing and
Discussion
This method is especially effective with groups with a strong visual culture or social hierarchy that may limit verbal participation. It can be used to assess how individuals perceive a situation or as tool for group analysis.
VSO, Participatory Approaches:
A Facilitator’s Guide, 80.
Echo/Cascade
Workshops
This method requires a full day but is effective for empowering and including local people in the listening process.
VSO, Participatory Approaches:
A Facilitator’s Guide, 82-83
Facilitation and Engagement Strategies
General Strategies and Guides
• Natasha Mack, Cynthia Woodsong, Kathleen M. Macqueen, Greg Guest, and Emily Namey, Qualitative Research Methods: A Data Collectors Field Guide (FHI360, 2011)
• Book 3: The Engagement Toolkit, (Melbourne: Victorian Government Department of
Sustainability and Environment, 2005).
• USAID, Best Practices for Stakeholder Engagement in Biodiversity Programming, (Sept.
2018).
• VSO, Participatory Approaches: A Facilitator’s Guide
• Morten Skovdal and Flora Cornish, Qualitative Research for Development: A Guide for
Practitioners (Rugby, UK: Practical Action Publishing, 2015)
Focus Groups
• “Focus Groups,” (BetterEvaluation.org)
USAID Local Systems Practice 23 July 2019
• “Technical Note: Focus Group Interviews,” (USAID, 2013).
Interviews
• “Interviews,” BetterEvaluation.org:
• Bronwen McDonald and Patricia Rogers, “Interviewing,” Methodological Briefs Impact
Evaluation No. 12 (UNICEF, 2014).
Developing Questionnaires
• Bradburn, Norman M., et al. Asking Questions: the Definitive Guide to Questionnaire
Design-- for Market Research, Political Polls, and Social and Health Questionnaires.
Jossey-Bass, 2004.
USAID Local Systems Practice 24 July 2019
Appendix 2: Sample Questionnaire
*Adapted from: USAID/Philippines Local Works Listening Tour
Areas of Inquiry and Potential Framing Questions for Conversations
These illustrative questions are by no means exhaustive, and the Listening Teams are encouraged to try them and to identify other effective questions and approaches to enable meaningful dialogue and discussions.
Potential Icebreaker Questions
• “Tell me about yourself”
• What do you like to do for fun [or in your free time or what is your hobby]?
• What is your city/community known or famous for?
• What is the best thing about your community? Why?
• What are you most proud of? (personally and/or based on their role in the community)
What is happening in this community? What is life like here (for the participant)?
• How do you feel about the services and access to services in your community?
• What is the main source of income for most people here? Why?
• What is your job (or how do you earn a living)?
• I know many families in this area survived [recent event]—were you one of the affected families? What did you do to get through it and recover?
• What cultural/community practices influence your life?
What is working well in the community?
• What are the strengths of your community?
• What positive changes have you seen in your life or in the community over the last few years?
• What brings people together here?
• What is happening here now that is helpful or beneficial for you?
• What are the best projects or activities in your community? What makes them so good?
• What has helped you achieve your goals? (for the individual, family and/or community)?
What are the assets and resources in the community?
• What have you done to help your neighbor and the community?
• What do the youth contribute in the community?
• What do the elderly contribute in the community?
• What do the women contribute in the community?
• What activities or events bring people in your community together?
• What motivates you to participate in community activities?
• What institutions, organizations or groups provide support to people here?
• What institutions or organizations provide the services you need most?
• Who are the real heroes in your community? Why?
• Who in your community do you trust most? Why?
USAID Local Systems Practice 25 July 2019
• What institution or organization has…
This is the start of the file's text. The full file is on GovTribe.
File details come from the government source that posted it. Updated .