Project SUPPORTT_RFI Draft.pdf

DEPARTMENT OF HEALTH & HUMAN SERVICES

Administration for Children Families

GOVERNMENT CONTRACTING SERVICES

Performance Work Statement ACF-GCS-TMP-2023-35 (Sept 2023)

PERFORMANCE WORK STATEMENT

Administration for Children and Families

Office of Planning, Research, and Evaluation

Performance Work Statement for

Project SUPPORTT – Supporting Pilot Program Outcomes, Research, and Technical Assistance in TANF

April 2024

DRAFT

GOVERNMENT CONTRACTING SERVICES

Performance Work Statement ACF-GCS-TMP-2023-35 (Sept 2023)

Table of Contents

0.0 General

0.1 Introduction

0.2 Objective

0.3 Scope of Work

0.4 Background

0.5 Type of Contract Contemplated

0.6 Period of Performance

0.7 Place of Performance

0.8 Recognized Holidays

0.9 Applicable Documents

Specific Requirements/Tasks - Separate Nonseverable Services Components

1.0 Services Component 1

2.0 Services Component 2

3.0 Optional Services Component 3

4.0 Optional Services Component 4

5.0 Optional Services Component 5

6.0 Optional Services Component 6

7.0 Optional Services Components 7, 8, 9

8.0 Optional Services Component 10

9.0 Optional Services Components 11, 12, 13, 14

10.0 Contractor Quality Assurance

11.0 Delivery or Deliverables

12.0 Convenings

13.0 Required Travel and Other Direct Costs (ODCs)

14.0 Special Instructions

15.0 Government Furnished Property/Equipment/Information

16.0 Glossary of Abbreviations and Acronyms

GOVERNMENT CONTRACTING SERVICES

Performance Work Statement ACF-GCS-TMP-2023-35 (Sept 2023)

Performance Work Statement (PWS) for

Project SUPPORTT – Supporting Pilot Program Outcomes, Research, and Technical Assistance in TANF

0.0 General

0.1 Introduction

The mission of the U.S. Department of Health and Human Services (HHS) Administration for Children and Families’ (ACF) Office of Planning, Research, and Evaluation (OPRE) is to study ACF programs and the children and families they serve through rigorous research and evaluation projects. The Fiscal Responsibility Act of 2023 (FRA) requires HHS to carry out a pilot program under which it may select up to five states to negotiate Temporary Assistance for Needy Families (TANF) performance benchmarks for work and family outcomes instead of the Work Participation Rate (WPR).1 This acquisition, “Supporting Pilot Program Outcomes, Research, and Technical Assistance in TANF,” also known as “Project SUPPORTT” will provide research, evaluation, and data-related technical assistance to the states participating in the pilot program, and will design and carry out implementation and outcome studies of the pilot programs. Additionally, this acquisition will support the establishment of peer learning communities and other mechanisms to facilitate the sharing of lessons learned, findings, and resources from the research and technical assistance activities among pilot and non-pilot states and other TANF jurisdictions.

0.2 Objective

The objective of this acquisition is to provide the selected states with research, evaluation, and data-related technical assistance to support their participation in the pilot program, and to design and carry out implementation and outcome studies of the pilot programs. Additionally, this acquisition will support the establishment of peer learning communities and other mechanisms to facilitate the sharing of lessons learned, findings, and resources from the research and technical assistance activities among pilot and non-pilot states and other TANF jurisdictions. This effort may ultimately help build the knowledge base around new ways of operating and measuring the performance of TANF programs that lead to better outcomes for children and their families that participate in the TANF program.

0.3 Scope of Work

The scope of the work includes, but is not limited to, the following activities: design and carry out implementation and outcome studies of the pilot programs; provide tailored research, evaluation, and data-related technical assistance (TA) to each pilot state and potentially other states or TANF jurisdictions, coordinating closely with any relevant ACF-funded programmatic TA efforts; establish peer learning communities to facilitate the sharing of lessons learned, findings, and resources from the research and technical assistance activities among pilot and non-pilot states and other TANF

1 Fiscal Responsibility Act of 2023, https://docs.house.gov/billsthisweek/20230529/BILLS-118hrPIH-fiscalresponsibility.pdf jurisdictions; draft and disseminate study findings; facilitate active engagement with program practitioners, decision makers, and TANF participants, and potentially other interested parties, to inform tasks at all key stages of the project; and develop universal research, evaluation, and data-related tools and resources to support TANF pilot program states and other non-pilot states.

0.4 Background

OPRE’s Division of Economic Independence (DEI) has primary responsibility for welfare and family self-sufficiency research and evaluation. As such, DEI closely coordinates with ACF’s Office of Family Assistance (OFA), which administers the federal TANF block grant program. TANF aims to help families with low incomes achieve economic self-sufficiency. DEI and OFA partner to carry out research, evaluation, technical assistance, and related learning activities in order to produce and apply knowledge about how TANF and other safety net programs can best support the economic well-being of children and families.

Since TANF was enacted under the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996, the WPR has been the primary measure of program performance.2 The WPR has remained mostly unchanged, but there have been increasing calls for alternative methods of measuring state TANF performance.3 The FRA provides an opportunity for selected states to pilot alternatives to the WPR.

Section 302 of the FRA authorizes a pilot program in which HHS may select up to five states to implement and test new performance benchmarks for work and family outcomes for state TANF program participants.4 The benchmarks outlined by the FRA focus on job entry, job retention, and family stability and well-being. Specifically, the following benchmarks will be used to measure state TANF program performance in lieu of the WPR for states participating in the pilot program:

1) The percentage of individuals who were work-eligible individuals as of the time of exit from the program, who are in unsubsidized employment during the second quarter after the exit.

2) The percentage of individuals who were work-eligible individuals who were in unsubsidized employment in the second quarter after the exit, who are also in unsubsidized employment during the fourth quarter after the exit.

3) Other indicators of family stability and well-being as established by the Secretary.

The legislation specifies that the pilot program will commence on October 1, 2024, and will be in effect for six fiscal years, with one year to establish benchmark data and targets, and five years to measure performance against the targets. The legislation also requires a final comprehensive report on outcomes be submitted to Congress no later than one year after the pilot programs have ended.

2 https://www.congress.gov/bill/104th-congress/house-bill/3734/text 3 https://www.acf.hhs.gov/opre/report/measuring-employment-outcomes-tanf 4 Fiscal Responsibility Act of 2023, https://docs.house.gov/billsthisweek/20230529/BILLS-118hrPIH-fiscalresponsibility.pdf

As the federal office that administers the TANF program, OFA will oversee the implementation of the new FRA pilot programs which includes identifying performance benchmarks and the associated targets, as well as monitoring program performance .5 In close coordination with OFA, OPRE will oversee the research and evaluation activities, including the associated research, evaluation, and data-related technical assistance. As such, it is also expected that the contractor selected under this requirement will coordinate closely with any similar or related efforts funded by OFA.

In support of the pilot program authorized under the FRA, this effort will provide support to states in operationalizing the new work and family stability and well-being benchmarks as well as establishing processes and tools for collecting benchmark data and measuring and reporting progress toward established benchmarks. This effort will also be expected to conduct research on the pilot program implementation and outcomes, and to establish peer learning communities and other mechanisms to facilitate the sharing of lessons learned, findings, and resources from the research and technical assistance activities among pilot and non-pilot states and other TANF jurisdictions. Additionally, this requirement will contribute to an initial report and final report to Congress, as legislated under Section 302 of the FRA of 2023.

OPRE is committed to advancing equity through research. Through its Racial Equity Action Plan (see also, https://www.acf.hhs.gov/opre/opres-racial-equity-actionplan-public-commitments), OPRE aims to build evidence that will ultimately help ACF to understand how its programs and policies, including TANF, affect historically marginalized and underserved populations.

OPRE’s research on race and equity reflect five overarching themes:

• Identifying barriers to program enrollment and access;

• Identifying disparities in enrollment, access, services, and outcomes;

• Assessing policies, program implementation, and practices that may (1) contribute to disparities or (2) reduce disparities;

• Disaggregating data by key demographic variables; and

• Engaging community members and other interested parties.

This requirement is expected to build on OPRE’s work in advancing racial equity, specifically through supporting the pilot program implementation and conducting research on its implementation and outcomes. This includes identifying factors and data points that are important for avoiding disparate impacts in the implementation of the work and family well-being measures of the pilot.

Principles of OPRE Work ACF's Evaluation Policy demonstrates ACF’s commitment to conducting rigorous, relevant evaluations and to using evidence from evaluations to inform policy and practice. The five principles of ACF’s Evaluation Policy are: rigor, relevance, transparency, independence, and ethics. It is expected that the work described above will be carried out in accordance with the following principles.

5 Request for Information: Temporary Assistance for Needy Families (TANF) Implementation of Sections 302 and 304 of the Fiscal Responsibility Act of 2023: https://www.federalregister.gov/documents/2023/11/27/2023-26100/request-for-information-temporary-assistance-for-needy-families-tanf-implementation-of-sections-302

Rigor. ACF is committed to using the most rigorous methods that are feasible and appropriate to both the evaluation questions and the populations, circumstances, and settings that are the focus of study.

Rigor requires ensuring that inferences about cause and effect are well founded (internal validity);

requires clarity about the populations, settings, or circumstances to which results can be generalized (external validity); and requires the use of measures that accurately capture the intended information (measurement reliability and validity). When conclusions about program efficacy or effectiveness are examined, studies should use methods that isolate to the greatest extent possible the impacts of the programs or services from other influences, such as trends over time, geographic variation, or pre-existing differences between participants and non-participants. For such causal questions, experimental approaches are preferred. When experimental approaches are not feasible, high-quality quasi-experiments offer an alternative. ACF will develop and use methods that are appropriate for understanding diverse populations, taking into account historical, contextual, and cultural factors. Where possible, evaluations will design data collections to allow disaggregation of data and analyses of sub-groups to support understanding of equity.

Relevance. It is ACF’s policy to integrate both use of existing evidence and opportunities for further learning into all activities. As demonstrated by this requirement, where an evidence base is lacking, ACF is committed to building evidence through strong evaluations. To be most relevant, prioritization of issues and approaches to be addressed under this requirement should reflect the interests and needs of ACF and OPRE staff and leadership; ACF partners such as states, territories, tribes, and local grant recipients; the populations served; researchers; and other groups and individuals. Further, evaluations designed and measurement used under this requirement should represent the diverse populations served by ACF. Finally, findings must be disseminated in ways that are accessible and useful to policymakers, service providers, the communities that ACF services, and other groups and individuals.

Transparency, Data Archiving, and External Communication. ACF values transparency in research and evaluation and is committed to making information about planned, ongoing, and completed evaluations easily accessible. As appropriate, this should include registering study plans prior to initiating data collection and planning for data archiving.

Further, ACF is interested in ensuring that its research and evaluation work is communicated to a range of relevant audiences throughout the course of project activities. Ongoing and continuous activities are considered essential to a strong communication approach. Audiences that may be appropriate include, but are not limited to: policy-makers, intermediaries, researchers, advocates and opinion leaders, program administrators, training and technical assistance providers, practitioners, and the communities that ACF services. ACF will require contractors to meaningfully engage groups and individuals from the programs and communities involved in studies to improve clarity of presentations, accuracy of interpretations, and effectiveness of external communications activities. ACF is particularly interested in the creation of project external communication plans that identify specific audiences and approaches and products to communicate to those audiences. ACF is also interested in communication plans that use new and emerging media, as well as innovative approaches to communication products that are compatible with the ACF website and other communications platforms.

Independence and Active Engagement. ACF’s evaluation policy upholds the idea that independence and objectivity are core principles of evaluation. Agency and program leadership, program staff, service providers, populations and communities studied, and others participate actively in setting evaluation priorities, identifying evaluation questions, and assessing the implications of findings to help ensure the relevance of the work. While active engagement of groups and individuals who are invested in the outcomes of evaluation can support relevance as well as the accuracy of program implementation details, it is important to insulate evaluation functions from undue influence and from both the appearance and the reality of bias. To promote objectivity, ACF protects independence in the design, execution, analysis, and reporting of evaluations, as outlined in the evaluation policy.

To prevent the appearance or reality of conflicts of interest and protect the independence of the evaluation, pilot states, partners,6 and technical assistance providers shall not be a contractor or subcontractor for this evaluation. The credibility of the evaluation depends on ensuring that researchers are independent from service provision. Grant recipients, partners, and technical assistance providers may inform the evaluation in other ways (refer to active engagement tasks below).

ACF aims to be informed by the practice and empirical knowledge available to inform such topics as measurement choices, technical assistance, training and site support, and the contextualizing of findings.

Meaningful involvement of groups and individuals in the evaluation may increase the rigor of the activities of the requirement itself as well as understanding, acceptance, and utilization of evaluation findings. Groups and individuals who are invested in the outcomes of research or evaluation include agency and federal, state or local program leadership, program staff (both at ACF and at the grant recipient or other programs being evaluated), service providers, developers of innovations or practices, participants in the programs, and the communities where programs occur. As appropriate, groups and individuals should have the opportunity for input at multiple phases of a project, but this input must be accomplished in a transparent way while safeguarding the objectivity and independence of the study.

Ethics and Data Safety. ACF-sponsored evaluations are conducted in an ethical and equitable manner;

safeguard the dignity, rights, safety and privacy of participants; and comply with both the spirit and the letter of relevant requirements such as regulations governing research involving human subjects. ACF expects contractors to meaningfully engage groups and individuals from the programs and communities involved in studies to ensure programmatic, cultural, linguistic and historical nuances are accurately and respectfully addressed from the initial study design through execution, analyses and reporting.

ACF is committed to ensuring that data collected as part of this contract are maintained and stored securely. A detailed data security plan (DSP) will establish procedures for protecting any and all personally identifiable information (PII) and other controlled unclassified information (CUI) collected under this requirement, and describe processes for reporting incidents involving that information to ACF. For the purposes of this section:

• CUI is defined as information that requires safeguarding or dissemination controls pursuant to and consistent with law, regulations, and Government-wide policies, excluding information that

6 Partners may include entities that receive grant funds or that partner with grant recipients in other ways related to service provision.

is classified under Executive Order 13526 of December 29, 2009, or the Atomic Energy Act, as amended.

• PII is defined as information that can be used to distinguish or trace an individual’s identity, such as their name, social security number, biometric records, alone or when combined with other personal or identifying information, which is linked or linkable to a specific individual, such as date and place of birth, mother’s maiden name, and so on.

0.5 Type of Contract Contemplated

The contract type will be cost-plus-fixed-fee.

0.6 Period of Performance

The period of performance for this contract will include two services components and twelve optional services components for a total estimate of 99 months (from July 1, 2024 to September 30, 2032). The estimated component periods are shown below.

Component Potential Period of Performance Tentative Exercise Date Services Component 1 7/1/24-9/30/25 July 2024 Services Component 2 7/1/24-12/30/25 July 2024

Optional Services Component 3 9/30/25-9/30/30 September 2025 Optional Services Component 4 9/30/26-9/30/31 September 2026 Optional Services Component 5 9/30/27-9/30/32 September 2027 Optional Services Component 6 9/30/29-9/30/32 September 2029 Optional Services Component 7 9/30/25-9/30/27 September 2025 Optional Services Component 8 9/30/27-9/30/29 September 2027 Optional Services Component 9 9/30/29-9/30/31 September 2029 Optional Services Component 10 9/30/30-9/30/31 September 2030 Optional Services Component 11 9/30/25-9/30/27 September 2025 Optional Services Component 12 9/30/26-9/30-28 September 2026 Optional Services Component 13 9/30/27-9/30/29 September 2027 Optional Services Component 14 9/30/28-9/30/30 September 2028

0.7 Place of Performance

Work will be performed at the contractor’s facility.

0.8 Recognized Holidays

New Year’s Day Labor Day Martin Luther King Jr.’s Birthday Columbus Day President’s Day Veteran’s Day

Memorial Day Juneteenth Thanksgiving Day Independence Day Christmas Day

In addition to designated federal holidays, the Government observes the following days:

• Any other day designated by Federal Statute

• Any other day designated by Executive Order

• Presidential Inauguration Day

• Any other day designated by the President’s Proclamation

The Contractor is not required to perform requirements of this effort on these days.

0.9 Applicable Documents

• Attachment A: ACF Evaluation Policy

• Attachment B: OPRE Clear Communications Checklist

• Attachment C: Plain Language Checklist

Specific Requirements/Tasks - Separate Nonseverable Services Components

The Contractor shall furnish the necessary qualified personnel, equipment, materials, supplies, non-personal services, facilities, and otherwise do all that is necessary for, or incidental to, the performance of the work set forth below. Respondents to this PWS may propose alternative approaches in addition to addressing the tasks as proposed by the government; justification for alternatives (e.g., cost efficiency, etc.) must be provided with any alternatives proposed. Respondents are expected to draw on their own expertise to propose the most effective approach to addressing the tasks. The Contractor is expected to work with the Contracting Officer’s Representative (COR) to refine the activities and proposed plans once contract is awarded.

The Government anticipates the following with regards to this performance work statement but reserves the right to make adjustments, as necessary to meet program requirements:

• The Government anticipates that public-facing deliverables will require at least 4 rounds of federal review before acceptance/publication (i.e., first draft, second draft, third draft, and final). The Contractor shall be responsible for ensuring public-facing deliverables are 508-compliant, as certified by OPRE, prior to publication.

• The Government anticipates that internal deliverables will require at least 2 rounds of federal review before acceptance (i.e., draft and final). Internal-facing deliverables do not need to be made 508-compliant prior to acceptance.

• Unless otherwise specified, the Government anticipates that written deliverables will be internal-facing documents for federal staff.

• The Government anticipates that relevant efficiencies will be implemented for similar tasks across all Services Components (SCs) and Optional Services Components (OSCs).

• The Government anticipates that the COR may occasionally request updates to plans (e.g., work plans, analysis plans). The Government anticipates that minor updates may be needed approximately every 6 months. More significant updates will be requested primarily when substantial changes to plans or timeline occur, or when OSCs are exercised.

1.0 Services Component 1

Period of Performance: Award – 9/30/25 Purpose: To support the launch of the pilot programs, assess their research and evaluation capacity, and document and provide technical assistance.

End Product of Value: A memorandum summarizing the technical assistance provided to all the pilot states during the period of performance (1.4 Task 4).

1.1 Task 1 – Project Communication and Management

The Contractor shall institute procedures to ensure effective management of the entire project, including resolving problems, maintaining an on-time schedule for deliverables, coordinating the work of subcontractors and consultants, communicating with the COR and other federal staff, and working within budget and on schedule to achieve the government’s objectives. Anticipated deviations shall be reported to the COR in a timely manner.

1.1.1 Subtask 1.1 – Orientation

Effective communication between the Contractor and the federal government, coordinated through the Contracting Officer’s Representative (COR), and successful project management are essential to the success of this requirement. Within five (5) business days of the beginning of the period of performance of this SC, the Contractor shall initiate communications with the COR to schedule a project orientation with the COR and other key federal staff. The project orientation will cover a range of topics, including, but not limited to:

clarification of ACF’s interests and objectives for the project, conducting work on an efficient schedule and budget, reaching agreement on outstanding issues, clarifying timelines and work schedules especially for early project deliverables, identifying staff (federal and Contractor) who will take lead responsibility for various activities and tasks, coordination with other federal partners and with the pilot states, methodologies to be employed, and challenges anticipated and potential solutions.

During the project orientation, ACF OCIO staff will provide an overview of the ACF OCIO Intake Request Form used to formalize/start the ACF OCIO Governance Framework requirements. The Contractor shall complete an ACF OCIO Intake Request Form within five (5) business days after the project orientation and submit it to the ACF OCIO Portfolio Management and Governance Division, customer_engagement@acf.hhs.gov.

The Contractor shall send an agenda and any relevant materials to the COR no less than five (5) business days prior to the project orientation. Within one (1) week of the orientation date, the Contractor shall submit to the COR a memorandum summarizing major decisions reached and follow-up issues identified during this discussion.

1.1.2 Subtask 1.2 – Ongoing Communication

Ongoing communication is necessary to ensure successful completion of this SC, and should be both verbal (e.g., regularly scheduled conference calls) and written (e.g., monthly progress reports).

The Contractor shall propose a schedule for bi-weekly telephone communications to update federal staff on progress and issues. Key Contractor staff, subcontractor staff, and/or consultants shall participate as needed to address progress and issues for discussion. The schedule for telephone discussions may be changed as agreed upon by the COR. The Contractor shall submit a proposed agenda for each call at least three (3) business days in advance of the scheduled date to the COR for comment. If there are materials that federal staff will need to review prior to the call date, such materials shall be submitted at least three (3) business days in advance of the call date. The Contractor shall submit a summary of telephone discussions to the COR for review and approval within three (3) business days of each bi-weekly telephone call.

In addition to the ongoing conference calls, the Contractor shall submit written monthly progress reports throughout this SC, which include the following information: activities completed and progress on each task for the report month, including expenditure data by task, monthly and cumulative expenditures, and the balance remaining. The Contractor reports shall include details related to project performance. Monthly progress reports shall be submitted to the COR no later than the 15th day of the subsequent month or before submission by the Contractor of invoices related to that period of performance, whichever is earlier.

1.1.3 Subtask 1.3 – Work Plan

The Contractor shall submit, no later than three (3) weeks after the orientation (or election of an OSC), a draft work plan that reflects 1) more detailed information about and understanding of the activities required to meet the goals and objectives of the project and to carry out the tasks than were reflected in the Contractor’s proposal and 2) information gathered based on conversations with the COR and other federal staff, including OFA. At a minimum, the work plan shall include a detailed discussion by task of the methods to be used and activities to be conducted to ensure the successful completion of each task; a timeline for accomplishing tasks and ensuring timely delivery of all work products; a detailed description of major work products and deliverables; a discussion of staff responsibilities for specific activities or tasks; a budget for each task; and a detailed plan for addressing and resolving concerns or problems that may emerge during the course of the project. Within two (2) weeks of receipt of COR comments, the Contractor shall submit a revised work plan. The work plan shall be considered a living document, to be updated as needed throughout this SC.

1.1.4 Subtask 1.4 – Coordination of Technical Assistance Efforts Throughout all tasks in this SC, the Contractor must ensure intentional and thoughtful coordination with any other parties supporting the states participating in the FRA TANF pilot program. Other parties may include but are not limited to other federal contractors (including researchers and/or technical assistance providers);

OPRE, OFA, other federal partners and agencies; and non-federal entities and organizations. All coordination must be approved in advance by the COR, and the COR must be copied on any coordination-related communications. In addition, all coordination activities and related timelines must be incorporated into the work plan (1.1.3 Subtask 1.3).

1.2 Task 2 – Active Engagement

ACF defines active engagement as the intentional involvement in all phases of the inquiry process of groups and individuals who are invested in the outcomes of the research or evaluation – including academic experts, researchers, practitioners, policymakers, program participants, and others. The goal of active engagement is for both practice and empirical knowledge to inform tasks at all key stages of the project.

This type of engagement can improve the rigor and relevance of ACF research and evaluation, facilitate the uptake of findings, and increase our capacity to promote equity. The nature or frequency of engagement may vary for different groups or individuals, but opportunities to provide input should be considered at multiple points throughout the project. If appropriate, a Memorandum of Understanding between the contractor and some individuals or groups may be warranted. To protect the independence and objectivity of the evaluation, all active engagement activities shall ensure there is neither appearance nor reality of a conflict of interest.

1.2.1 Subtask 2.1 – Develop Active Engagement Plan

On a schedule to be agreed upon with the COR, the Contractor shall submit a draft Active Engagement Plan describing proposed groups and individuals to engage; project tasks and activities where active engagement will occur; engagement methods to be used to achieve specific goals; budget considerations;

and other details as requested by the COR. The active engagement may include in- person, virtual, or a combination of in person and virtual activities. The Plan shall include an explicit discussion, specific to the context of this project, of how research independence will be maintained. Within two (2) weeks of receipt of COR comments, the Contractor shall submit a revised Active Engagement Plan.

1.2.2 Subtask 2.2 – Implement Active Engagement Plan

Once the Active Engagement Plan has been accepted by the COR, the Contractor shall implement the Active Engagement Plan. The Contractor shall submit draft materials to the COR no later than 2 weeks prior to each engagement and final materials on a schedule to be agreed upon with the COR.

Additionally, the Contractor shall submit written summaries of engagements to the COR. Drawing on the Contractor’s technical expertise, the summary shall provide high-level notes summarizing the engagement;

synthesize top-level issues raised; highlight key themes or topics of discussion; and summarize any next steps or action items suggested by the discussions. The Contractor shall provide the draft engagement summary to the COR for review no later than two (2) weeks after the engagement. Within two (2) weeks of receipt of COR comments, the Contractor shall submit a final summary.

1.3 Task 3 – Understanding Pilot States’ Programs - Approaches, Capacity, and Technical Assistance Needs The Contractor shall undertake activities to ensure a thorough understanding of the pilot states’ programs, as well as each of those states’ existing level of capacity to participate in research and evaluation activities related to the pilot. The information will be used primarily to inform and tailor the technical assistance provided under 1.4 Task 4 and facilitate connections and learning across pilot states and their respective programs.

1.3.1 Subtask 3.1 – Assess Capacity and Technical Assistance Needs In consultation with the COR, and on a schedule proposed by the Contractor and approved by the COR, the Contractor shall develop and implement a method to assess the research, evaluation, and data-related capacity and technical assistance needs of each pilot state. The Contractor may identify multiple dimensions of capacity to assess. This may include, but is not limited to, the following: the current TANF landscape that has relied on the WPR as a primary outcome; knowledge of the evidence base related to their program; the state’s capacity to collect data, conduct research activities, and carry out evaluations; any barriers the state faces in carrying out these activities; and other information deemed by the COR or the Contractor to be appropriate for inclusion. This assessment shall be based on the pilot program application and supplemented via information provided to the Contractor after the start of this SC. The Contractor may engage as needed in targeted follow-up with individual states to clarify or supplement information included in their applications. Any additional documentation requirements should not place undue burden on the pilot states.

The Contractor shall develop a standardized template for summarizing information related to the capacity and technical assistance needs of each pilot state. The Contractor shall submit the draft summary template to the COR for review no later than four (4) weeks after the project orientation (Subtask 1.1). Within one (1) week of receipt of COR comments, the Contractor shall submit the final summary template.

1.3.2 Subtask 3.2 – Prepare Summaries

Using the capacity assessments developed in Subtask 1.3.1, the Contractor shall prepare a summary document for each of the states supported under this SC. These summaries should include a synthesis of the capacity assessments conducted for each pilot state, preliminary technical assistance needs, and other information deemed by the COR or the Contractor to be appropriate for inclusion. These summaries will inform the tailored technical assistance provided in 1.4 Task 4. The Contractor shall submit the draft summary documents within two (2) months of the beginning of the pilot state capacity assessment. Within two (2) weeks of receipt of COR comments, the Contractor shall submit the revised summaries. The Contractor shall update the summaries as necessary throughout the duration of this SC to document changes in states’ plans.

1.4 Task 4 – Research, Evaluation, and Data-Related Technical Assistance to Pilot States The Contractor shall provide research, evaluation, and data-related technical assistance to each pilot state.

The support shall be individualized and tailored to each state, taking into account the particular state and program, existing research, evaluation, and data-related capacity, possible research and evaluation activities that the state may undertake, and other information gathered in 1.3 Task 3. Technical assistance shall be provided in a way that is culturally competent and with the goal of working in collaboration with the states.

ACF intends to promote a model of bidirectional learning wherein both the states and ACF, along with its Contractor, learn from one another. For example, state staff should have opportunities to develop skills and learn about research, evaluation, and/or data use while evaluators should have opportunities to learn about the state organization, community, program, and population served. The COR will also facilitate close coordination with OFA and any related OFA-funded efforts. The COR, along with OFA staff, will approve all technical assistance activities prior to their start.

The Contractor shall provide technical assistance to states in areas related to participating in the pilot program. Some example activities include:

• Determining and operationalizing new work and family stability and well-being benchmarks.

• Assisting with establishing processes and tools for collecting benchmark data such as developing tracking systems and identifying and accessing relevant data sources.

• Measuring and reporting progress toward established benchmarks throughout the pilot program.

• Developing or refining a logic model and theory of change related to the pilot program, in order to link proposed activities to identified outcomes.

• Understanding and refining their target population(s), including compiling and analyzing data on those populations.

• Understanding contextual factors and how they may affect proposed activities and targeted outcomes.

• Identifying, understanding, and incorporating lessons from the existing evidence base related to their programs.

• Participating in a federally-funded implementation and outcomes evaluation of the pilot program.

• Identifying and refining research questions that will provide data that can inform decision-making around their program, as well as aligning research questions with methods/instruments and outcomes.

• Identifying objectives and outcomes of interest, as well as valid and reliable measures to assess these outcomes.

• Understanding and using administrative data the organization already collects to address questions of interest.

• Supporting states to engage with families with lived experience in their programs to inform pilot program activities.

The Contractor shall establish a schedule for regular check-ins with each state. The schedule for these check-ins shall take into account availability of either the COR or another OPRE point of contact. Support to states shall be provided through a combination of virtual interaction, including the regular check-ins, and in-person site visits when feasible. All site visits must be approved at least one month in advance in writing by the COR. The Contractor shall submit all draft site visit materials to the COR for review no later than one (1) week in advance of each site visit. Materials may include but are not limited to site visit agenda, PowerPoint slides, and handouts. Final materials must be approved by the COR. For all site visits, the Contractor shall provide a written summary of the site visit to the COR no later than three (3) weeks after returning from the visit.

During bi-weekly communications with the COR (1.1.2 Subtask 1.2), the Contractor shall provide updates on the status of the technical assistance being provided.

In addition, on a schedule proposed by the Contractor and approved by the COR, the Contractor shall draft a memorandum summarizing the technical assistance provided to all the pilot states during this SC.

This memorandum will document all of the technical assistance activities, accomplishments, opportunities, and challenges across all pilot states and implications for the ongoing provision of technical assistance beyond the first year of the pilot program.

1.5 Task 5 – Peer Learning

Per the FRA legislation, the pilot states will establish their performance benchmarks and negotiate targets during the first year of the pilot program, and so during this time the Contractor shall support pilot state coordination and communication through peer learning activities. These activities are intended to establish open lines of communication among the pilot states so that they benefit from more in-depth interactions with each other. The activities may also be used to inform and target resources developed in future OSCs.

On a schedule proposed by the Contractor and approved by the COR, the Contractor shall submit a plan (including a schedule) for peer learning activities conducted during SC 1. The Contractor shall submit a revised plan no later than two (2) weeks after receipt of comments from the COR. Upon approval of the plan and each activity, the Contractor shall plan and facilitate these activities throughout the duration of this SC. The Contractor shall solicit topics of interest from the states as well as propose their own ideas for topics. The Contractor shall develop and compile materials (including an agenda, if applicable) for any peer learning activities and provide logistical support for the activities as needed.

The Contractor shall submit draft materials for the activity to the COR at least two (2) weeks prior to each activity. Incorporating any feedback from the COR, the Contractor shall distribute the approved materials to all participants at least three (3) business days prior to each activity.

During bi-weekly communications with the COR (1.1.2 Subtask 1.2), the Contractor shall provide updates on all peer learning activities. Additionally, the Contractor shall submit written summaries of activities to the COR. The Contractor shall provide the draft activity summary to the COR for review no later than two

(2) weeks after the activity. Within two (2) weeks of receipt of COR comments, the Contractor shall submit a final summary.

1.6 Task 6 – Project Description

The Contractor shall develop a brief, one-page Project Description for use by the Contractor and OPRE that provides an overview of the project and communicates the purpose of the project. The first draft of the written project description shall be submitted to the COR no later than one (1) week after the project orientation. The Contractor shall revise the draft project description based on COR feedback and shall submit a revision on a schedule proposed by the Contractor and approved by the COR. The Contractor shall update the project description over the course of the contract at the request of the COR in order to ensure that the project description adequately provides up-to-date information about the project. The updated project description shall be submitted no later than two (2) weeks after request from the COR.

1.7 Task 7 – Special Topics Activities

The Contractor shall address topics of special interest to ACF through research and analyses, the convening of experts, or undertaking special activities related to the pilot programs as requested by the COR. This task may include supporting the production of the Interim Report to Congress (due 12 months after enactment of the pilot programs), other reports, briefs, memoranda, and data analyses. This may also include making substantive contributions to any virtual or in-person convenings of the pilot program states (e.g., contributing to agenda development, creating presentation content, and/or presenting on topics as requested).

The COR will identify the topics and output(s) (e.g., reports/briefs), or the Contractor may recommend to the COR topics to be considered and output(s). The COR, with input from other federal staff and officials, will make the final determination about topics and output(s).

The Contractor shall perform the following activities for each topic authorized by the COR under this task on a schedule to be agreed upon with the COR:

• Consult with the COR and other federal staff, as appropriate, for initial discussion and guidance on the topic and to obtain approval from the COR to undertake work on the topic;

• Submit a draft work plan for undertaking the work involved after the COR approves the topic, including focus, cost estimates for activities to be conducted, data sources, timeline, outline, table shells (if appropriate), and other details as required;

• After receipt of comments from the COR on the draft work plan, submit a final detailed plan for undertaking the work involved to the COR for discussion and approval; and

• Submit a draft of any products to the COR and, after receipt of comments from the COR on the draft product, submit a revised product to the COR for approval.

1.8 Task 8 – Privacy and Data Security Activities and Monitoring ACF is committed to ensuring that any data collected as part of this contract are maintained and stored securely in a matter consistent with applicable laws and regulations. These laws and regulations may include, but are not limited to: Executive Orders; Privacy Act of 1974; Health Insurance Portability and Accountability Act (HIPAA); Federal Information Security Management Act of 2002 (FISMA); Freedom of Information Act of 1974; Federal Records Management Act; National Institute of Standards and Technology (NIST) Special Publication (SP) Guidelines; OMB Circulars and Government Accounting Office (GAO) guidance; HHS/ACF Rules and Guidance; and Department of Defense’s Defense Intelligence Security Agency Security Technical Implementation Guide Hardening Guidelines. As such, the Contractor shall undertake activities to maintain the confidentiality, integrity, and availability of data gathered under this contract. In addition to electronic data security requirements, the Contractor must have a plan for the protection of any paper records, field notes, or other documents that contain sensitive or personally identifiable information (PII). Specifically, as appropriate, the Contractor shall follow the policies, procedures, controls, and standards required by the HHS/ACF Information Security Program to ensure the confidentiality, integrity, and availability of sensitive information for which the Contractor is responsible under this contract or to which the Contractor may otherwise have access under this contract. This will include completing a Privacy Impact Assessment (PIA) on a schedule as outlined in the data security plan (DSP) (discussed below). The COR will provide the PIA template and other appropriate documents to the Contractor after award. The Contractor shall update the PIA at least every three years following approval of the original submission, or when determined by the COR that a review and update are required.

The Contractor shall use any provided templates, policies, forms and other agency documents, if applicable, to comply with contract deliverables as appropriate.

Depending on the type and nature of the CUI collected (determined in conjunction with the COR and after review of the PIA or equivalent, the Contractor may be required to store the CUI in an environment that requires an Authority to Operate (ATO). If the Contractor does not have an environment with an ATO, but is determined to need one, they shall plan to secure one and submit that plan, including alternative options, to the COR on a schedule determined after the PIA and/or DSP has been completed. The Contractor should choose the most efficient and effective method in consultation with the COR and related ACF staff.

Should the Contractor be required to secure an ATO, the Contractor shall achieve compliance with HHS/ACF standards, meaning the Contractor shall create and supply any necessary Security Authorization

Documents (based on NIST Risk Management Framework and associated guidance), and participate in the ACF OCIO Governance Systems Development Life Cycle (SDLC) process.

The Contractor shall provide a detailed data security plan for protecting and access to any and all information collected in the study or accessed for secondary analysis. The security plan shall be due to the COR no later than three (3) months following the contract award date. The security plan shall be updated annually, or more often as needed based on changes to the project. The plan shall comply with the NIST SP 800-18, Guide for Developing Security Plans for Federal Information Systems; FIPS 199, Standards for Security Categorization of Federal Information and Information Systems; the Federal Information Processing Standard 200, Recommended Security Controls for Federal Information Systems; the latest version of NIST SP 800-53rev 4, Security and Privacy Controls for Federal Information Systems and Organizations applicable baseline requirements; and other applicable NIST guidance as well as HHS and ACF policies and other guidance. As appropriate, the Contractor shall comply with OMB Memorandum M- 05-22, Transition Planning for Internet Protocol Version 6 (IPv6). In consultation with the COR and consistent with guidance that will be provided by the COR, the data security plan shall specifically address data security and privacy procedures, including but not limited to:

• A description of the data that will be collected, accessed, stored, and/or transmitted, including noting which data will contain PII or sensitive information and the nature of that information.

• Documentation of the assigned personnel and roles associated with the project and associated data security and privacy safeguards.

• The assurances provided to respondents or participants about the privacy of their information.

• How data are collected, accessed, transmitted, and stored, including confirmation that user access controls, account management, and encryption standards and procedures meet the HHS/ACF standards. This should include discussions of procedures for both IT-based and non-IT based transmission and storage.

• A description of the environment(s) in which the data will be reside.

• The training procedures in place for all project staff at all levels of the project and specific instructions to all staff related to handling personal or sensitive information. Any Contractor or Subcontractor staff with significant security responsibilities (as determined by the COR) must complete role-based training annually commensurate with their role and responsibilities in accordance with HHS policy and the HHS Role-Based Training (RBT) of Personnel with Significant Security Responsibilities Memorandum.

• Documentation of the data breach…