J.1. Position Description ODEA.pdf

Millennium Challenge Corporation Position Description

Personal Service Contractor

Classification: Open Data Evidence Analyst, PSC- 301-4B

Position Number: PSC- DPE-42

Introduction:

The Millennium Challenge Corporation (MCC) is committed to delivering sustainable economic growth and poverty reduction throughout the entire lifecycle of its investments. MCC’s mission is to provide grant assistance to support economic growth and poverty reduction in select developing countries with a demonstrated commitment to just and democratic governance, economic f reedom, and investments in their citizenry. MCC’s partner countries enter into a f ive-year agreement (Compact) with MCC that includes a plan for achieving shared development objectives and the responsibilities of each country in achieving those objectives, regular benchmarks to measure progress, multi-year f inancial plan, and a plan to ensure accountability for the use of MCA assistance.

This model is def ined by core principles of selectivity, country ownership, transparency, and a focus on results. MCC’s values define how we behave daily, both as individuals and as an institution, in pursuit of our mission. Our values identify who we are and what is important to us. They guide how we make decisions, set priorities, address challenges, manage tradeoffs, recruit and develop staff, and work together with our country partners and stakeholders. Our Values are CLEAR: Embrace Collaboration, Always Learn, Practice Excellence, Be Accountable and Respect individuals and ideas.

The position is located within the Department of Policy and Evaluation (DPE) Front Office (FO), Millennium Challenge Corporation (MCC). The DPE FO is responsible for overseeing MCC efforts to produce evidence through its investments in independent evaluation, as well as ef forts to share evidence on the MCC Evidence Platform and use evidence to inform future cost-benefit analysis models. The Analyst will play a critical role (i) publishing, (ii) monitoring and reporting, and (iii) maximizing use and analysis of evidence to inform MCC’s investment decision-making.

Major Duties and Responsibilities:

The Personal Services Contractor (PSC) is expected to:

Publish and Share Evidence

Support MCC’s commitments to evidence-sharing and transparency for accountability and learning: the ODEA will support ongoing evidence supply efforts by MCC to make its data and documentation transparent and accessible on the MCC Evidence Platform. In addition, this workstream will ensure evidence generated by MCC data activities contributes to the broader development effectiveness evidence-base. This includes the following responsibilities:

Lead support to MCC staf f and contractors on MCC’s data Disclosure Review Board (DRB) process, including (i) identifying data package review dates; (ii) receiving, and organizing data packages for initial Technical Review; (iii) preparing the briefing packet for full DRB review; (iv) documenting DRB meetings (in DRB Minutes and DRB Review Tracker),and (v) communicating results of DRB reviews to MCC staff and contractors. This task requires an average of 8 hours per data package and an average of 10 data packages per year.

Conduct initial Technical Review of data packages prior to full DRB review, including assessing for completeness, ensuring completion of the Technical Review Template, and review of the Transparency Statement, De-Identification Worksheets, and Codebooks for alignment and adherence to proposed de-identification ef forts for protection of respondent confidentiality. This task is expected to average 3 hours per data package and 10 data packages per year.

https://data.mcc.gov/evaluations/index.php/catalog

Provide quality assurance review of all data and documentation files uploaded into the MCC Manager for the MCC Evidence Platform prior to publication or submission to MCC’s data steward.

Support communication and tasks between MCC and the data steward. Tracking of pipeline of materials (in internal tracking database) and publication of materials (on external MCC Evidence Platform) to ensure timely connection between MCC Clearance, internal documentation, and publication.

Support capacity building efforts for MCC staff and contractors on guidance, templates, tools, and the MCC Manager. Support MCC staff in the event of unauthorized data disclosure and necessary risk assessment and response. Support MCC efforts to identify appropriate conferences, workshops to share MCC evidence.

Monitor and Report on Evidence

Support a consistent feedback loop back into the agency for a broader, shared understanding of evidence generated by MCC data activities. The ODEA will identify and monitor how various internal and external stakeholders – including country partners, researchers, students, policy makers, OMB, and congressional staf f – make use of the data and documentation published to the MCC Evidence Platform. This workstream will identify additional learning products – such as graduate thesis papers, peer-reviewed journal articles, other development agency white papers – that describe evidence of MCC investments that extend and complement the original MCC-commissioned evaluation analysis reports and ensure these products are shared with the relevant MCC staff.

Track use of MCC’s Evidence Platform and shared data and documentation through google analytics and other user experience statistics provided by the data steward. Support MCC staff’s efforts to establish a feedback loop regarding how to improve and strengthen open data guidance and tools – such as the MCC Evidence Platform – to broaden use of MCC data. Support MCC’s ongoing ef forts to identify and track external publications associated with MCC-funded data activities and assess their quality and usefulness for informing MCC evidence demand efforts.

Update Evidence

To support MCC’s commitments to evidence-based decision-making, the ODEA will provide centralized support that responds to the agency’s use of evidence to inform investments. This may include research support and analysis efforts that maximize use and understanding of MCC project-related evidence (from independent evaluations), primary analysis of MCC-funded data, and relevant external literature as well as research assistance on the broader relevant evidence-base outside MCC project-related evidence.

Performs other related duties as assigned.

Factor 1 - Knowledge Required by the Position Strong capability for attention to detail and project management, particularly for administrative tasks involving senior management

Strong capability with Microsoft Teams, Word, Excel, PowerPoint

Experience conducting statistical regression analysis in Stata or similar statistical packages, including work to understand program effects on outcomes of interest.

Strong understanding of statistics, particularly related to multiple hypothesis testing and requirements for meta-analysis and systematic reviews.

Understanding of direct and indirect personal identifying information, protection of confidentiality for human subjects, and data de-identification methods to protect confidentiality

Excellent written and oral communication skills

Factor 2 - Supervisory Controls

The supervisor and/or higher graded staff assign specific projects in terms of issues, organizations, functions, or work processes to be studied and sets deadlines for completing the work. The supervisor or higher-graded staff provide on-going assistance/guidance on issues or assignments for which precedent studies are not available. The employee plans, coordinates, and carries out the successive steps in fact f inding and analysis of issues in accordance with accepted office policies, applicable precedents, organizational concepts, management theory, and occupational training. Work is reviewed in-progress and upon completion for conformance with overall requirements, contribution to the study objectives, consistency of facts and figures, choice of analytical methods, and practicality of recommendations.

Factor 3 - Guidelines

Guidelines consist of procedures, policies, and manuals covering the application of analytical methods and techniques, and reference material, instructions, and regulations covering the subjects involved. The guidelines are not completely applicable to the work or have gaps in specificity, requiring the employee to use judgment in choosing, interpreting, and adapting guidelines to specific issues or subjects studied.

Factor 4 - Complexity

The work principally involves dealing with problems and relationships of a procedural nature. Projects usually take place within organizations with related functions and objectives, although organization and work procedures differ from one assignment to the next. Findings and recommendations are based upon analysis of work observations, review of production records or similar documentation, research of precedent studies, and application of standard administrative guidelines.

Factor 5 - Scope and Effect

The purpose of the work is to identify, analyze, and make recommendations to resolve conventional program or organizational issues, problems, or situations. The employee is assigned portions of broader studies or participates in the evaluation of program effectiveness at the operating or local level.

Completed reports and recommendations influence decisions by higher-graded specialists or managers concerning administrative or program operations.

Factor 6/7 - Personal Contacts/Purpose of Contacts

Personal contacts are with MCC employees, supervisors, and managers, as well as employees and representatives of private concerns in moderately structured settings. The purpose of contacts is to provide advice and assistance on non-controversial organization or program-related issues and concerns. Contacts typically involve such matters as identification of options and alternatives; evaluation of progress in meeting program or organizational goals; or recommendations for resolving administrative problems.

Factor 8 - Physical Demands

The work is primarily sedentary, although some walking, bending, or carrying of light items may be involved.

Factor 9 - Work Environment

Work is performed in an office setting.

Position Sensitivity: Non-Sensitive Low Risk Tier 1