Attachment_3_FA_2_SAMPLE_TO_SOW_3.docx

Attachment 3: FA 2 Sample TO SOW Solicitation 140D0422R0016

Functional Area (FA) 2: Civilian Security, Democracy, Human Rights, and Stability Task Order (TO) SAMPLE Statement of Work (SOW) Outcome Evaluation of Media Programs

1. SCOPE AND PURPOSE

The U.S. Department of State (DOS) anticipates awarding a TO to work with DOM to conduct an outcome evaluation of media programs administered by DOM’s Office of Global Programs (DOM/GP). As the climate for misinformation, censorship, and closing space for independent media organizations remain pervasive in emerging democracies, DOM/GP media programs have focused on preserving institutions and actors that cultivate vibrant democratic practices, particularly the fundamental freedoms of expression and press. Advancing media programs contributes to increased transparency and accountability, which are also essential in fostering good governance and promoting human rights. The objectives of this evaluation include: (i) understanding the extent to which approaches led to expected changes, and whether any positive or negative unexpected changes occurred; and (ii) exploring whether approaches led to sustainable effects. The findings of this outcome evaluation are expected to cultivate learning for DOM/GP and project implementers and to inform strategy and funding decisions.

2. BACKGROUND

DOM’s mission is to advance human rights, democratic institutions, and fundamental freedoms with the aim of ensuring a more peaceful, prosperous and stable world. Through its media programming, DOM/GP aims to achieve two overarching goals, and associated Mission Objectives, within its Functional Bureau Strategy, including:

· Democracy: Enhance global stability by promoting the further growth of representative democratic governments around the world and supporting democratic transitions.

· Objective 1.1: Strengthen constituent- and rights-based democratic institutions, such as political parties, civic voter education, independent judiciary, and monitoring groups, to support democratic institutions in countries where they are under assault or formation.

· Human Rights: Increase respect for internationally-accepted human rights standards and norms for all.

· Objective 1.1: Individual human rights defenders and NGOs under threat are supported and are able to carry out their work.

· Objective 1.2: The United States develops further policy, diplomatic initiatives, programming, and partnerships with non-State actors that successfully advance and expand freedom of expression, offline and online, the freedom of association and assembly, and equality for all, including ethnic and religious minorities, women, persons with disabilities, and LGBTI+ persons.

To achieve these objectives, DOM awards grants and cooperative agreements to nongovernmental organizations to implement programs that support freedom and democracy and protect human rights around the world. These awards are supported through Congressional appropriations, for necessary expenses to carry out the provisions of the Foreign Assistance Act of 1961.

In alignment with our Mission Objectives and the Foreign Assistance Standardized Program Structure and Definitions, DOM-funded activities and approaches have sought to contribute to (i) improving technical and operational capacities of media institutions, (ii) strengthening the professionalism and accuracy of journalism from professional journalists, citizen journalists, and other media actors. Activities and approaches have primarily focused on the supply side of these objectives, ensuring that journalists and media organization staff are able to conduct their work, including investigative journalism, and publish content free of censorship and government interference in traditional and new media. Project participants and beneficiaries of these initiatives generally include media organizations, civil society organizations, and journalists. These groups may have heightened scrutiny and surveillance from the government. Secondarily, DOM has also focused on the demand side of these objectives, working with civil society organizations and community-based groups that encourage citizens to thoughtfully engage and debate content published in print and online.

Since 2011, DOM has allocated $173 million to support approximately 92 projects focusing on media around the world. Projects have occurred in every region; however, due to the sensitive nature of the portfolio, specific countries are not named in this SOW. As these projects are administered by various regional and thematic teams, this evaluation will be global in nature and seeks to support the entire DOM/GP office and implementing partners. These grants have ranged in size from approximately $200K – $27 million (median: $971K), with time-frames ranging from one to five years (median: 2.5 years).

Illustrative approaches within this portfolio of projects include:

· Fostering the growth of investigative journalist networks to promote greater government accountability and transparency;

· Increasing story production and quality of stories that expose corruption;

· Expanding the number of citizens in the region accessing and engaging with the stories to create more balanced news in the media and encourage public discussion;

· Building journalists’ and human rights defenders’ capacity on digital, physical and psychosocial safety, and access to legal services;

· Engaging local-level civil society and media activists through a combination of technical monitoring and advocacy skills training

DOM will oversee administration of this evaluation and will be the primary point of contact for this TO. DOS will have sole ownership of all materials and data gathered by the contractor.

3. SCOPE OF WORK

This evaluation should cover the OECD DAC evaluation criteria of relevance, effectiveness, efficiency, impact and sustainability; however, the primary foci are relevance, impact and sustainability. The objectives of this outcome evaluation include: (i) understanding the extent to which approaches led to expected changes, and whether any positive or negative unexpected changes occurred; and (ii) exploring whether approaches led to sustainable effects.

Specific projects for data collection and potential fieldwork will be identified collaboratively between DOM, its implementing partners, and the Contractor. Country case selection will focus on areas where multiple projects occurred over a number of years, as well as those that fit within an evaluability assessment checklist (to be provided to the Contractor by DOM). The desk review for this assignment will include a majority of the approximately 84 media programs administered by DOM. Data collection will primarily be conducted virtually. This should include methods to collect data virtually, such as through digitally secure virtual interviews with grantees, stakeholders and beneficiaries and include virtual review of media products from project beneficiaries. The Contractor should demonstrate how they will virtually collect data and how they will collaborate with an in-country researcher if necessary as travel to many of the selected regions will be limited. Data collection may include travel to up to two relevant regions, (South and Central Asia, Europe/Eurasia and the Near East), if there is an identified opportunity and need for in person data collection. As a contingency, travel costs have been included.

To assist the bidder in their drafting process, DOM has included an illustrative list of a few DOM projects for this evaluation.

Objectives:

· Identify topics for journalism investigation upon which society is ready to act;

· Increase the number of journalists and civil activists capable of being involved in investigative journalism;

· Uncover facts of corruption and disseminate obtained information as widely as possible; and

· Disseminate information about tools that will enable communities to act against corruption.

Europe/Eurasia

Goal: Building the capacity of independent regional media to deliver to the rural population objective, unbiased and reliable information on the complex democratic development issues of the country.

Objectives:

· Boosting the role of regional media as promoter of democratic development of the country by delivering objective and easily understandable information;

· Advance transparency and facilitate platforms of public debate/dialogue between citizens and authorities;

· Raising young people’s capacity from targeted regions to contribute to democratic development locally and nationally and hold local governance accountable.

09/2014 - 12/2018 $734,993

Near East Asia

Goal: To empower media professionals, activists, and civil society actors with basic skills, protections, and tools so that they can practice their Freedom of Expression to work for a more peaceful, stable, and democratic [country].

Objectives:

· To enable media professionals, civil society organizations, and activists – specifically women human rights defenders – to better prevent and respond to security threats and incidents.

· Facilitate regular reporting, mapping, and analysis of incidents that impact media freedoms or [Freedom of expression].

· Equip CSO partners to develop evidence-based advocacy and outreach strategies that address the root causes of [Freedom of Expression] violations and support accountability.

a. Evaluation Questions: The following list includes a set of illustrative evaluation questions. However, it is anticipated that the Contractor will collaborate with stakeholders to further refine this list.

Relevance:

· To what extent were approaches relevant to the needs of project participants and communities?

1. Did participants value activities and approaches, and how they were implemented? Did they feel that improvements could have been made?

2. In what ways, if at all, did the operating environments or contexts influence the relevance of the activities and approaches?

· To what extent were DOM-funded activities and approaches complementary or duplicative to other funded initiatives?

Impact:

· To what extent did project activities and approaches contribute to strengthening the ability of journalists and media actors to better meet standards of journalism (including responsible, objective, inclusive and investigative journalism)?

1. Which methods of support to journalists and media actors were the most used by journalists and media actors?

2. Which methods or approaches were most successful in producing outcomes?

· To what extent did project activities and approaches contribute to (i) improving the operational capacity of media organizations?

1. Which approaches led to expected effects? Is there evidence of positive or negative unexpected effects; and, if so, what were these outcomes?

Sustainability:

· Did project approaches lead to supported media outlets better maintaining their operations beyond the project end dates?

1. If so, what factors most influenced the achievement of sustainable results.

2. Did media outlets supported through DOM-funded projects have the support they needed to continue operations?

b. Evaluation Tasks: The following tasks have been outlined to assist the bidder with planning and logistics.The time-frame and processes are illustrative and can be modified within the proposal, or in consultation with DOM after the award has been signed. The bidder may also propose alternative processes, based on their experience and expertise.

Evaluation Design:

· Within two weeks after signing the award, the Contractor will meet with DOM for an initial kick-off meeting and handover of materials. Two months after this initial meeting, the evaluation questions should be further refined and a draft work plan of the evaluation should be submitted. The work plan should contain the following: evaluation design and methodology; evaluation questions; an overall theory of change for the portfolio of projects; information to be analyzed and the respective information sources; work plan and timetable for data collection; and conditions and capacities necessary for data collection, analysis and communication of findings. The evaluation design phase may also be conducted collaboratively with DOM, implementing partners, and other funders and stakeholders.

· The Contractor shall provide all evaluation instruments (e.g., survey questions, interview protocol, focus group protocol, list of stakeholders to be interviewed, etc.) and documentation (e.g., correspondence, contact letters, data collections instruments, fieldwork reports, etc.) to DOM for review and clearance prior to disseminating to participants and key stakeholders. When forming a work plan and time table, please account for a 2-week feedback period.

· The Contractor shall provide a complete data visualization workplan that will include report design, custom color palette and font choices, an original photography sourcing and integration plan for reports and other products. This will also include a plan for graphics, custom charts, images, infographics and data placemats that promote the understanding of key messages and themes.

· It is the Contractor’s responsibility to identify and describe data collection mechanisms based on the Contractor’s experience and expertise, keeping in mind security and confidentiality issues. This assignment will require virtual / remote data collection; thus, the Contractor should be familiar with secure digital tools for interviews, focus groups, surveys, etc.

· Data collection methods may include document review, surveys, structured and semi-structured interviews and focus groups, observation, and any other appropriate methods. As much of this evaluation is retrospective, the Contractor may propose alternative methodologies (e.g. outcome mapping, process tracing, causal-comparative study, comparative case studies) that are capable of understanding how process and context affected the results of interventions. Data collection, at a minimum, should include relevant DOM staff, implementing partners, and project participants and beneficiaries.

· Other funders and stakeholders not formally associated with these projects should also be included as a means of providing context and determining how these projects fits within the larger framework of rule of law funding. DOM will facilitate contacts with other funders over the course of the consultation phase. The Contractor shall inform DOM when data collection has been completed.

Data Collection, Analysis and Reporting:

· Most of the projects being evaluated are highly sensitive in nature. A fundamental principle of DOM’s operations with these projects is “Do no harm.” Given this high degree of sensitivity, it is vital for the Contractor to work very closely with DOM to determine how to gather accurate and reliable data from participants and key stakeholders in a manner that does not damage trust or jeopardize the safety and security of implementing partners, beneficiaries and communities, data, or the projects themselves. Additional time should be incorporated into the timeline to address this concern in the evaluation design and data collection phases. If the Contractor will be using laptops or other computer equipment to process information specific to this effort, all laptops will need to be encrypted in accordance with current DOS policy

· Desk review: The Contractor shall conduct a desk review for a majority of projects within this portfolio of approximately 92 awards. At a minimum, this review will include a review of available solicitations (requests for proposals), grant proposals, grant agreements, quarterly progress reports, final project reports and project evaluations. This may include trip reports and internal grant reviews conducted by DOM Program Officers. The desk review should also include other materials that provide information on global trends related to rule of law programming.

· Preparation: Activities will include interviews in Washington, D.C. and remote interviews to prepare for data collection with grantees and beneficiaries. Washington, D.C. interviews: Time should be allotted for meetings with relevant offices, agencies and organizations in Washington, D.C., including DOM, implementing partners, and others to gain a greater understanding of DOM and other democracy and human rights funders. Remote interviews with key stakeholders: project participants and beneficiaries, implementing partners and their stakeholders, and other funders and experts not affiliated with these projects. Interviews can be conducted in person, over the phone or virtually. DOM can make introductions to DOM implementing partners, relevant Embassy staff, and other stakeholders (funders, non-profits) abroad, if necessary. The Contractor is responsible for handling logistics for data collection and travel. Additionally, the Contractor is responsible for forming research partnerships with local firms or consultants, if necessary.

· Virtual Data Collection: The Contractor will be expected to conduct data collection primarily through virtual and remote methods. Specific countries and projects of focus will be identified collaboratively between DOM, its implementing partners, and the Contractor. Country case selection will focus on areas where multiple projects occurred over a number of years, as well as those that fit within an evaluability assessment checklist (to be provided to the Contractor by DOM). For planning purposes, data collection will primarily focus on two to three regions among the following: South/Central Asia, Near East Asia, and Europe/Eurasia. Based on the nature of the projects, data collection may include virtual interviews or focus group discussions, remote surveys or other appropriate methods with those in country. Security protocols for virtual data collection should be determined collaboratively between DOM, its implementing partners and the Contractor. DOM expects the Contractor to include information gathered from project beneficiaries, grantee local staff, grantee local partners, and key stakeholders where feasible. Where interview subjects have relocated, DOM or grantees can assist in locating these subjects and making the introduction for further data collection. DOM can make introductions to implementing partners and relevant staff, but the contractor is responsible for handling data collection logistics. Virtual data collection should also include review of media products produced by beneficiaries as many of these products are either accessible digitally or can be shared virtually. Contractor may need to collaborate with grantees to access these products. Given the context-specific nature of media projects, the Contractor is encouraged to collaborate with an in-country consultant to assist with data collection, analysis and validation. Contractors may need to include linguistic interpretation for Urdu, Arabic and Russian among others.

· In-Country fieldwork: Given the nature of the regions of focus and the sensitivity of the projects involved, travel to relevant regions will likely be limited. However, the Contractor may plan for up two field trips to the relevant regions (South/Central Asia, Near East Asia, and Europe/Eurasia) if there is a determined need and opportunity to conduct in-person fieldwork with grantees and beneficiaries. Alternatively, the Contractor may collaborate with an in-country consultant to conduct local data collection fieldwork may include interviews, focus group discussions, and other appropriate methods. When in the field, a 6-day work week with no premium pay is authorized. DOM can make introductions to implementing partners and relevant staff at the Embassy, but the contractor is responsible for handling data collection logistics and travel logistics. This includes arranging for security detail, where necessary. The Contractor is also responsible for making arrangements for translation and security detail, where necessary.

· Data Analysis: Once all data has been collected, data analysis should be completed within two months. The presentation of preliminary findings should take place in Washington, D.C. or virtually with DOM, and then with implementing partners, within a month of completing the analysis.

· Reporting: Within one month of the presentation of the preliminary findings, the initial draft report / deliverable should be submitted to DOM. For each draft, approximately two weeks should be planned for feedback from DOM, implementing partners, and other stakeholders. The Contractor shall plan on approximately two draft versions of the report / deliverable for feedback. Draft versions should be free of errors: grammatical, typographical, and analytical. DOM will undertake a final review of all changes to the reports before the Contractor makes multiple final hard copies. The Assistant Secretary for DOM has authority for final approval and release of all final reports. DOM must approve of the final report before final payment can be made. The Contractor shall draft three deliverables that conform to the data visualization plan submitted and approved at project launch:

1. Evaluation summary of no more than ten pages, which summarizes: the purpose of the evaluation; evaluation questions; evaluation design and methodology; and, findings. At the time of completion, the evaluation summary should be ready for publication; thus, it should not include sensitive information or disclose the names of implementing partners, beneficiaries, or other stakeholders.

2. Internal evaluation report or other deliverable (e.g. slide deck) of no more than 40 pages (not including appendices) that presents findings and draws conclusions based on the analysis of evidence.

3. External evaluation report or other deliverable (e.g. slide deck) of no more than 40 pages (not including appendices) that presents findings and draws conclusions based on the analysis of evidence. This version of the report may be posted on the DOS evaluation clearinghouse if it is not deemed sensitive; thus, it should not include sensitive information or disclose the names of implementing partners, project titles, beneficiaries or participants, or stakeholders. Included in the report should be a toolkit or other deliverable that proposes a strategic framework and measures or indicators that can be standardized for the portfolio.

· The Contractor should be available to conduct one to two oral briefings on the content of the evaluation report / deliverable, accompanied by a presentation.

· The overall evaluation should last no more than 12 months. The Contractor may wish to adjust the time-table, in consultation with and the approval of DOM.

4. DELIVERABLES

Work on this evaluation will begin no later than 14 days after the TO is signed.

Within the first 10 days of each month, the Contractor will submit a written progress report to DOM. The Contractor will also hold weekly phone calls with DOM, as needed. The agenda of the call will be set by the Contractor prior to the meeting. The Contractor may cancel calls if they feel that work is progressing and there are no items to discuss with DOM.

Within approximately 60 days from the kickoff meeting, the contractor will present to DOM a draft work plan for the evaluation. Implementing partners shall be provided an opportunity to review the draft plan and propose evaluation activities or processes.

Within approximately 180 days after the completion of the work plan, the data collection will be completed.

Within approximately 8 weeks from the completion of data collection, data analysis will be completed.

Within approximately 6 weeks after the completion of the aforementioned data analysis, the Contractor will submit a draft report / deliverable. Upon return of the draft evaluation report with comments and edits, the Contractor will provide an oral briefing to review the draft evaluation report with DOM and partners. Virtual presentations with organizations outside Washington, D.C. are also encouraged.

The contractor will submit the final report within 21 days of the in-person presentation.

5. DOM EXPECTATIONS

A. DOM will work with the Contractor to provide key information, documentation, and strategic guidance and to develop questions to be used in surveys, interviews, focus groups, or other evaluation methods. The Contractor will propose an initial evaluation design. The Contractor will work in consultation with DOM to shape the final evaluation design.

B. The Contractor shall be responsive to DOM’s needs throughout the project, and demonstrate ability to present information according to DOM’s requests.

C. At minimum, the Contractor shall hold bi-weekly calls and provide a monthly written update (by the 10th day of each month, for the preceding month) to DOM, detailing the progress to date and explaining any delays or challenges to maintaining the proposed work plan. The Contractor should also use these updates to identify any expectations for DOM, including requests for feedback, consultation or assistance with travel planning.

D. The Contractor shall not contact any grantee organization or program partners in reference to this SOW before the contract has been awarded, or without specific DOM permission.

E. The Contractor shall provide all evaluation documentation (e.g., correspondence, contact letters, data collections instruments, reports, etc.) to DOM for review and clearance prior to disseminating to participants, key stakeholders, or any other evaluation subjects. Please provide two weeks for feedback periods. If urgent feedback is needed, please provide this notice as a written request.

F. The Contractor shall forward all project deliverables to DOM in a timely manner, pending unforeseen delays. If extensions are needed, please provide this notice as a written request.

G. The Contractor and its in-country sub-contractors shall maintain the strict confidentiality of all data collected for this evaluation. The Contractor and its in-country sub-contractors shall assume primary responsibility for securing/verifying data that is collected. Security of this information is of the utmost importance given the sensitive nature of these projects. In addition, the contractor will detail its data retention policies, placing particular emphasis on how information gathered over the course of this TO will be used, transmitted, or stored during and upon completion of the TO.

6. EVALUATION TEAM REQUIREMENTS

The Contractor shall form an expert team consisting of one senior evaluation expert and one mid-level evaluation expert, as well as one project manager and one junior support staff, and relevant local consultants. However, there is flexibility to propose an alternative staffing structure with proper justification, if the Contractor feels it is more appropriate. The following includes illustrative profiles of background and experience DOM seeks from the Contractor.

1. Evaluation team with knowledge of and expertise in the evaluation of foreign assistance projects, especially projects focusing on democracy, human rights and media issues. The team must demonstrate strong and prior experience evaluating U.S. government or other donor programs addressing rule of law and human rights issues. Evaluators can be based abroad and the team should include strong local knowledge in the selected contexts. The evaluation team should demonstrate language skills in Arabic, Urdu and Russian.

2. Capability with methods for virtual data collection that allow for secure communication and data storage.

3. Experience with a variety of evaluation methodologies appropriate for this assignment, particularly outcome evaluations. The ability to analyze, synthesize and draw conclusions and lessons learned from various sources of data and findings.

4. One program manager / senior evaluator (Evaluation Methods/Implementation Specialist – Senior): will be responsible for managing the overall evaluation effort, to ensure that all deliverables are provided in a timely manner and are of sound quality. The senior evaluator will be responsible for preparing the evaluation design, proposed methodology, and data collection instruments. They will be responsible for overseeing the work of the mid-level evaluator(s), including: desk review; data collection, such as key informant interviews; and, data analysis. If necessary, the senior evaluator may accompany the mid-term evaluator(s) with data collection. The senior evaluator will also be responsible for preparing and managing the drafting of interim and final reports / deliverables; and, preparing briefings to be provided to DOM and partners. The senior evaluator must be comfortable working in close coordination with DOM, implementing partners, government officials and other donors, and project participants and beneficiaries; and, must possess exceptional organizational and communication skills. The senior level expert should have relevant experience designing and implementing evaluation research, including experience leading an evaluation team. The senior level should have a demonstrated ability of evaluating foreign assistance programs addressing democracy and human rights issues. Strong preference is given to individuals with experience conducting evaluations in restrictive settings and with marginalized populations. The level of effort for the senior level experts should be no more than 62.75 person days.

5. Two to three mid-level evaluators (Evaluation Methods/Implementation Specialist – Mid): will be responsible, with the senior evaluator, for conducting and coordinating the overall evaluation effort, including the preparation of the evaluation design and methodology and data collection instruments. The mid-level evaluators will be primarily responsible for conducting the desk review, key informant interviews (KIIs) or other data collection, conducting data collection, data analysis, writing the draft and final reports, and assisting in the preparation of the briefings to be provided to DOM and partners. The mid-term evaluators must be comfortable working in close coordination with DOM, implementing partners, government officials and other donors, project participants, and beneficiaries. The mid-level evaluators should have relevant experience in monitoring and evaluation (M&E). Preference is given to candidates that have shown a demonstrated ability to design and evaluate foreign assistance evaluations addressing democracy and human rights issues, including experience working in restrictive settings and with marginalized populations. Must possess exceptional organizational and communication skills. The level of effort for the mid-level evaluators should be no more than 203.75 person days.

6. One Project Coordinator (Administrative Support – Junior): The project coordinator will be responsible for providing overall administrative and logistics support to the evaluation team during each stage of the evaluation. The level of effort for the project coordinator should be no more than 22.25 days.

7. One Communication Specialist – Mid or Junior: The Contractor will employ a data visualization specialist / graphic designer for this assignment. This expert will provide guidance to ensure all deliverables promote the key messages and themes through the use of custom color palettes and font, integration of original photography, development of graphics, charts, infographics and data placemats. Deliverables will be appropriate for each audience and visually appealing. The level of effort for the communications specialist should be no more than 28 days.

8. Local Consultants: The local consultants may either be subject matter experts or evaluation researchers. They should understand local language(s) and English, foreign assistance to support human rights issues, and, if an evaluator, social science research methodology. The local consultants must be able to safely and securely travel within their country/region to conduct the necessary fieldwork and data collection. The Contractor should detail how these local consultants will be involved within the evaluation team. The individuals should be involved with the data collection process. The local consultants may also participate in evaluation design and the validation of findings. They may work with the Contractor to arrange meetings and site visits, translate communications, assist with data collection and analysis, and conduct follow-up work required after the senior or mid-level consultants have returned to the United States. These individuals must have deep knowledge of the country and culture, the civil society community, and foreign assistance. The level of effort for each local consultant should be no more than 30.5 person days.

7. PLACE OF PERFORMANCE

With the exception of data collection and briefings to DOM, project activity is anticipated to take place at the Contractor’s place of work.

8. RESPONSIBILITY OF ALL COSTS

The Contractor shall assume responsibility for all costs associated with the project as detailed in the proposal. These costs include, but are not limited to: staff salaries; indirect costs; fee of any airfare and per diem for all contractor and sub-contractor staff domestic and international travel; security costs; securing and/or verifying contact information; data collection and data verification; lodging and per diem for interview or focus group participants (if necessary); simultaneous interpretation and document translation services; lunch/dinner and incentive costs for interview and focus group participants; meeting room rentals for interviews and focus groups and other representational costs; telephone calls; mail and postage costs; and document reproduction.

NOTE: Contractors are asked to base travel budget on economy class tickets. Contractors should not under-estimate the work time in foreign countries and the financial costs associated with overseas travel (i.e., per diem, security costs and airfare). All travel shall be in accordance with federal travel regulations, including “Preference for U.S.-Flag Air Carriers” (January 1997), and DOS will only fund the equivalent of economy class tickets.

9. PERIOD OF PERFORMANCE

The period of performance for the evaluation shall not exceed 12 months. The TO expires when the final payment has been made by DOS. The project will commence within two weeks after TO award.

10. TIMETABLE

The following list includes an illustrative time table; however, the Contractor may propose alternatives, with proper justification. The contractor shall provide the following deliverables to DOM:

1. Monthly reports: Within the first 10 days of each month, the Contractor will submit a written progress report to DOM. The Contractor will also hold weekly phone calls with DOM, as needed. The agenda of the call will be set by the Contractor prior to the meeting. The Contractor and DOM may cancel calls if the work is progressing and there are no items to discuss.

The Contractor shall maintain open, timely, and effective communications with the COR (to be determined), resulting in a relationship that proactively addresses potential problems with flexible, workable solutions. If delays or extensions are needed, please provide this notice as a written request. All correspondence of this nature, and any correspondence seeking acceptance of deliverables, should include the COR for this project.

2. An inception report, including detailed work plan and evaluation design: Within approximately 60 days from the kickoff meeting, the contractor will present to DOM an inception report for the evaluation. This document will include a work plan and time table, evaluation design and methodology, and portfolio-level theory of change. DOM, implementing partners and other stakeholders shall be provided an opportunity to review the draft plan and propose evaluation activities or processes; please account for drafts and feedback within this time-frame.

Within approximately 60 days of the approval of the inception report, the desk review will be completed. Desk review may begin as the Contractor drafts the inception report.

3. Data collection and instrument design: Within approximately 120 days after the completion of the desk review, the data collection will be completed.

At a minimum, drafts of data collection instruments should be provided to DOM. If drafting data collection instruments for beneficiaries, the Contractor may seek feedback from implementing partners and other stakeholders, to ensure constructs are valid. Please account for drafts and feedback within this time-frame. The drafting of data collection instruments, as well as travel planning, may begin while the Contractor is drafting and finalizing the inception report.

4. Draft evaluation report and deliverables: Within approximately 8 weeks from the completion of data collection, data analysis will be completed.

Within approximately 6 weeks after the completion of the aforementioned data analysis, the Contractor will submit a draft report / deliverable (see 5. Final evaluation report, for deliverables). The Contractor will provide an oral briefing to review the draft evaluation report with DOM and partners. Virtual presentations with organizations outside Washington, D.C. are also encouraged.

5. Final evaluation report and deliverables: The contractor will submit the final report within 21 days of the oral briefing. All deliverables will conform with the data visualization plan proposed at project launch.

· Internal evaluation summary of no more than three pages. This document serves as a brief for senior managers and policymakers. It provides a brief description of the portfolio evaluated, data collection methods, key findings and recommendations (if provided).

· Internal evaluation report of no more than 40 pages (not including appendices) that presents findings and draws conclusions based on the analysis of evidence. The report should be clear, concise, and empirically grounded.

· External evaluation report or other deliverable (e.g. slide deck) of no more than 25 pages (not including appendices) that presents findings and draws conclusions based on the analysis of evidence. The report should be clear, concise, and empirically grounded. This version of the report may be posted on the DOS evaluation clearinghouse if it is not deemed sensitive. Thus, it should be ready for publication upon receipt, and should not include sensitive information or disclose the names of implementing partners, project titles, beneficiaries or participants, or stakeholders.

· External summary of no more than three pages. This document provides highlights from the evaluation report, and may be composed of a visual summary or infographic. This version of the report will be posted on the DOS evaluation clearinghouse; thus, it should not include sensitive information or disclose the names of implementing partners, project titles, beneficiaries or participants, or stakeholders.

6. Handover of materials: Upon completion, all materials generated from this assignment—e.g. inception report, data collection instruments, field notes, raw data, analyzed and coded data, draft and final reports—shall be electronically packaged and delivered to DOM.