PWS Asset Building Cohort 06-27-2022 - DRAFT FINAL.pdf

Performance Work Statement (PWS)

MTW Expansion Asset Building Cohort

06/27/2022

Vision Statement

1.0 General Information

1.1 Introduction

1.2. Background

1.3 Constraints

1.4 Description of Services

1.5 Non-Personal Services

1.6 Period of Performance

1.7 Place of Performance

1.8 Hours of Operation

1.9 Special Qualifications

1.10 Post Award/Kickoff Conference

1.11 Status Meetings

1.12 Contractor Travel

1.13 Transition In

1.14 Transition Out

2.0 Definitions and Acronyms

2.1 Definitions

2.2 Acronyms

3.0 Government-Furnished Property and Services

3.1 Government Services

3.2 Facilities

3.3 Equipment

3.4 Materials

3.5 Quality Assurance (QA)

4 Contractor-Furnished Items and Services

4.1 Facilities

4.2 Equipment

4.3 Material

4.4 Contractor Responsibilities

4.5 Contractor Personnel

4.6 Identification of Contractor Employees

4.7 Quality Control

5.0 Specific Tasks

5.1 Project Management

5.2 Expert Panel

5.3 White Paper and Engagement with PHAs

5.4 Design Memo and Expert Panel Meeting

5.5 Research Designs Report

5.6 (Optional) Data Collection and Analysis Plan (DCAP)

5.7 (Optional) Expert Panel Onboard

5.8 (Optional) Paperwork Reduction Act Package and Common Rule Compliance

5.9 (Optional) Monthly Reports and Ongoing Communication

5.10 (Optional) Transition to Evaluation Contractor

6.0 Deliverables

6.1 Quality Control Plan

6.2 Acceptance Criteria

7. Performance Requirements Summary

8. Related Documents

Performance Work Statement (PWS)

Research Design and Data Collection and Analysis Plan for the Moving to

Work Expansion Asset Building Cohort

Vision Statement

The vision of this requirement is to obtain a contractor to produce a research design to inform the

U.S. Department of Housing and Urban Development (HUD)’s implementation and evaluation of asset building programs implemented by Public Housing Agencies (PHAs) in the Asset

Building Cohort (ABC) of the Moving to Work (MTW) Expansion.

1.0 General Information

1.1 Introduction

The Consolidated Appropriations Act of 2016 authorized HUD to award MTW authority to 100 additional PHAs by September 2022, and required that this expansion involve rigorous research on policy innovations. MTW expansion PHAs will be selected in cohorts; each cohort housing choice and self-sufficiency for HUD-assisted households.1 One cohort will test pairing asset building programs with HUD housing assistance; this cohort is known as the Asset Building

Cohort (or, sometimes “ABC”).

HUD’s Office of Policy Development and Research (PD&R) is seeking a contractor to develop research designs for evaluating the two types of asset building programs to be implemented by

PHAs in the Asset Building Cohort of the MTW Expansion: (1) promoting savings accounts and

(2) reporting rent to build credit. HUD intends, if it meets the government’s needs, to use the research designs developed under this contract to evaluate the MTW Expansion Asset Building

Cohort and thereby to advance HUD’s understanding of the facilitators and obstacles to incorporating asset building into housing assistance programs.

The purpose of the base contract is to advise HUD, through development of a Research Design, how to evaluate the effectiveness of two different asset building programs as implemented in the

Asset Building Cohort: (1) savings accounts and (2) rent reporting to build credit. If it meets the government’s need to do so, HUD may also acquire the Optional Task “Data Collection and

Analysis Plan” and related optional tasks (i.e., Expert Panel, Paperwork Reduction Act Package and Common Rule Compliance, and Monthly Reports and Ongoing Communications) to develop a detailed data collection and analysis plan, including data collection instruments and OMB approval for the data collection. The Research Designs Report and Data Collection and Analysis

Plan together will provide a detailed, technical blueprint to guide evaluation of the programs implemented by PHAs in the Asset Building Cohort.

HUD will use the most rigorous methods feasible for evaluation of the policy innovations studied in each MTW expansion cohort.

1 Additional information about the MTW Expansion is available at:

https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion.

https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion

The Research Designs Report and the Data Collection and Analysis Plan (if it is acquired) will be the property of HUD and are expected to be published. HUD reserves the right to use the

Research Designs Report and the Data Collection and Analysis Plan (if it is acquired)—in whole, or in part, or with modifications—to guide work under a subsequent contract.

1.2. Background

MTW Expansion

The Moving to Work (MTW) Demonstration confers special status on selected PHAs, giving them the ability to get exemptions from certain HUD rules. As of 2016, there were 39 MTW

PHAs (now known as the “initial 39”). The Consolidated Appropriations Act of 2016 authorized

HUD to award MTW authority to 100 additional PHAs by September 2022 and required that this expansion involve rigorous research on policy innovations. MTW expansion PHAs will be selected in cohorts; each cohort will test a policy idea for improving the delivery of federally assisted housing and promoting housing choice and self-sufficiency for HUD-assisted households.2

On August 28, 2020, HUD published the MTW Expansion Operations Notice in the Federal

Register (FR-5994-N-05); the Operations Notice provides the general framework under which

MTW expansion PHAs will operate.3

HUD established a Research Advisory Committee (RAC) to consider which policy areas should be tested in the new MTW sites. The RAC was established under the rules of the Federal

Advisory Committee Act, and information related to the RAC’s deliberations is available online.4 Current studies of MTW expansion cohorts are investigating (1) how MTW flexibility affects small PHAs and the households they assist, (2) impacts of alternative rent calculations on

PHAs and assisted households, and (3) impacts of landlord incentives on the success of the housing choice voucher program. In consultation with the RAC, HUD chose to launch a new cohort of MTW expansion agencies to study the incorporation of asset building programs into

HUD housing assistance. HUD will allow two types of asset building programs in this cohort:

(1) programs intended to build savings accounts for assisted households and (2) programs intended to help assisted households build credit by reporting rent payments to credit bureaus.

HUD will use the most rigorous methods feasible for evaluation of the policy innovations studied in each MTW expansion cohort.

HUD expects to publish a Selection Notice in April of 2022 for the MTW expansion Asset

Building Cohort that will explain the process for applying and selecting PHAs into this cohort. It will also describe required elements of the asset building initiatives that participating PHAs must implement, while allowing PHAs flexibility in many details. Finally, the Selection Notice will state requirements that are necessary to ensure rigorous evaluation of the asset building initiatives. HUD anticipates knowing which PHAs will participate and the program type that each plans to implement by August 1, 2022, but no earlier.

2 Additional information about the MTW Expansion is available at:

https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion.

3 https://www.federalregister.gov/documents/2020/08/28/2020-18152/operations-notice-for-the-expansion-of-the-moving-to-work-demonstration-program 4 Additional information about the MTW RAC is available at:

https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion/rac.

https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion https://www.federalregister.gov/documents/2020/08/28/2020-18152/operations-notice-for-the-expansion-of-the-moving-to-work-demonstration-program https://www.federalregister.gov/documents/2020/08/28/2020-18152/operations-notice-for-the-expansion-of-the-moving-to-work-demonstration-program https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion/rac

Asset Building Cohort

The RAC discussed asset building at its meeting of October 28, 2021. Background information, discussion drafts, a recording of the meeting, and meeting minutes can be found here:

MTW Research Advisory Committee | HUD.gov / U.S. Department of Housing and Urban

Development (HUD). These materials provide context for this project, but do not directly address how to study asset building initiatives in the MTW expansion.

The innovations that HUD intends to study in the Asset Building Cohort are different from those being studied in the other MTW Expansion cohorts in that asset building programs are not core elements of HUD programs. In addition, asset building programs of the type to be studied are not unique to HUD housing assistance. For instance, several states have implemented opt-out child education accounts with seed funds. California recently implemented a law requiring certain landlords to offer the option of reporting rent to credit bureaus to their tenants. Colorado recently funded a pilot study of rent reporting for credit building. Such initiatives might offer interesting comparisons and the research team should be aware of the lessons being learned from them, as well as aware of the possible implications for research designs in particular PHAs.

1.3 Constraints

The services identified in this PWS will adhere to the rules, regulations, laws, standards, and conventions identified by HUD as well as within the Federal Government. Constraints include the following: complying with the requirements of the Paperwork Reduction Act and the Privacy

Act for all data collection, where applicable, producing written reports that comport with

HUD/PD&R’s Guidelines on Preparing a Report for Publication,5 and conducting research that supports the core principles and practices outlined in HUD’s Program Evaluation Policy

Statement.6

1.4 Description of Services

The Contractor shall produce one or more research designs to evaluate the programs implemented in the Asset Building Cohort, and, optionally, if it meets the government’s needs, a

Data Collection and Analysis Plan to guide the evaluation of the Asset Building Cohort. The

Contractor selected to carry out this evaluation must have expertise in evaluation of housing assistance and credit building programs (specifically programs to build savings and programs to build credit through rent reporting), rigorous experimental and quasi-experimental evaluation methods; collection and analysis of data pulled from credit reports; ways to measure financial well-being and financial knowledge; linking of administrative and survey data; complex, multi-sited research designs; managing an expert panel; and excellent oral and written communication skills.

1.5 Non-Personal Services

The Government will neither supervise Contractor employees nor control the method by which the Contractor performs the required tasks. Under no circumstances shall the Government assign tasks to, or prepare work schedules for, individual Contractor employees. It shall be the

5 HUD/PD&R’s Guidelines on Preparing a Report for Publication can be found here:

https://www.huduser.gov/portal/About/style-guide-for-reports.pdf 6 https://www.federalregister.gov/documents/2016/12/06/2016-29215/hud-program-evaluation-policy-policy-statement https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion/rac https://www.hud.gov/program_offices/public_indian_housing/programs/ph/mtw/expansion/rac https://www.huduser.gov/portal/About/style-guide-for-reports.pdf https://www.federalregister.gov/documents/2016/12/06/2016-29215/hud-program-evaluation-policy-policy-statement https://www.federalregister.gov/documents/2016/12/06/2016-29215/hud-program-evaluation-policy-policy-statement responsibility of the Contractor to manage its employees and to guard against any actions that are of the nature of personal services or give the perception of personal services.

If the Contractor believes that any actions constitute, or are perceived to constitute personal services, it shall be the Contractor's responsibility to notify the Contracting Officer (CO) immediately. These services shall not be used to perform work of a policy, decision making, or management nature, i.e. inherently Government functions. All decisions relative to programs supported by the Contactor shall be the sole responsibility of the Government.

1.6 Period of Performance

The period of performance shall be for 6 months for the base period and 7 months for the option period.

1.7 Place of Performance

The services to be performed under this contract shall be performed at the Contractor's facilities.

1.8 Hours of Operation

N/A

1.9 Special Qualifications

1.10 Post Award/Kickoff Conference

The Contractor shall attend any post award conference convened by the contracting activity or contract administration office in accordance with FAR Subpart 42.5. The Government intends to convene a Post Award Conference with the Contractor within ten business days after contract award. The Contracting Officer will notify the Contractor of the specific date, location and agenda within five days after contract award.

1.11 Status Meetings

The Contracting Officer, Contracting Officers Representative (COR) and other Government personnel, as appropriate may meet periodically with the Contractor to also review Contractor performance, requirement status, etc. At these meetings, the Contracting Officer will apprise the

Contractor of how the Government views the Contractor's performance or progress of the requirement. The Contractor will apprise the Government of problems, if any, being experienced. Appropriate action shall be taken to resolve outstanding issues. These meetings shall be at no additional cost to the Government. Post Award Conference and subsequent meetings may be held via teleconference.

1.12 Contractor Travel

Prior to travel, the Contractor shall coordinate with and receive Government authorization from the COR for all travel. Reimbursement of travel costs will be in accordance with the Federal

Travel Regulation and in accordance with FAR 31.205-46. The Contractor shall travel using the lower cost mode transportation commensurate with the mission requirements. When necessary to use air travel, the Contractor shall use the tourist class, economy class or similar lodging accommodations to the extent they are available and commensurate with the mission requirements. HUD will not reimburse Contractor’s local travel. Local travel is defined as travel within fifty (50) miles of Washington DC. All other travel will be reimbursed on a cost reimbursable basis; no profit or fee will be paid.

1.13 Transition In

N\A

1.14 Transition Out

2.0 Definitions and Acronyms

2.1 Definitions

Business/Work Days - Every official work day of the week, which are days between and including Monday to Friday. This does not include public holidays and weekends.

Calendar Day - Any day of the week.

Contractor - A supplier or vendor awarded a contract to provide specific supplies or service to the Government. The term used in this contract refers to the prime.

Contracting Officer (CO) - A person with authority to enter into, administer, and/or terminate contracts and make related determinations and findings on behalf of the Government. Note: the only individual who can legally bind the Government.

Contracting Officer's Representative (COR) - An employee of the U.S. Government appointed by the Contracting Officer to perform contract administration activities in regard to technical issues. This individual has authority to provide technical direction to the Contractor as long as direction is within the scope of the contract, does not constitute a change and has no funding implications. This individual does NOT have authority to change the terms and conditions of the contract.

Defective Service - A service output that does not meet the standard of performance associated with the Performance Work Statement.

Deliverable Anything that can be physically delivered but may include non-manufactured things such as meeting minutes or reports.

Government Furnished Property (GFP) - Government-furnished property means property in the possession of, or directly acquired by, the Government and subsequently furnished to the

Contractor for performance of a contract. Government-furnished property includes, but is not limited to, spares and property furnished for repair, maintenance, overhaul, or modification.

Government-furnished property also includes contractor-acquired property if the contractor-acquired property is a deliverable under a cost contract when accepted by the Government for continued use under the contract.

Performance Requirements Summary (PRS) - A listing of the performance requirements under the contract that are to be evaluated by the Government on a regular basis, performance indicators for these requirements, performance standards for these requirement and surveillance methods to be used to determine if performance standards are met.

Performance Standard - The Contractor's performance level required by the Government.

Performance Work Statement (PWS) - A statement of work for performance-based acquisitions that describe the required results in clear, specific and objective terms with measurable outcomes.

Physical Security - Actions that prevent the loss or damage of Government property.

Quality Assurance (QA) - Policies and procedures adopted by the Government to ensure that supplies and services acquired under Government contracts conform to the contracts quality requirements.

Quality Assurance Surveillance Plan (QASP) - A plan describing how the agency will survey, observe, test, sample, evaluate and document the Contractor's performance in meeting critical performance standards identified in the contract.

Quality Control (QC) - All necessary measures taken by the Contractor to assure that the quality of an end product of service shall meet contract requirements.

Service Contract - A contract that directly engages the time and effort of a Contractor whose primary purpose is to perform an identifiable task rather than to furnish an end item of supply.

Subcontractor - Any person, other than the prime Contractor, who offers to furnish or furnishes any supplies, material, equipment, or services of any kind under a prime contract or a subcontract entered into in connection with such prime contract, and any person who offers to furnish or furnishes general supplies to the prime contractor or a higher tier subcontractor. The

Government does not have privity of contract with a subcontractor.

Work Week - Monday through Friday, unless specified otherwise.

2.2 Acronyms

AQL - Acceptable Quality Level

ARP- American Rescue Plan Act of 2021

CFO or OCFO-Office of the Chief Financial Officer

CFR - Code of Federal Regulations

CIO or OCIO - Office of the Chief Information Officer of HUD

CO - Contracting Officer

CoC- Continuum of Care

COR - Contracting Officer's Representative

CPO - Office of the Chief Procurement Officer of HUD

DCAP-Data Collection and Analysis Plan

EHV- Emergency Housing Voucher

EST - Eastern Standard Time (U.S.)

FDS- Financial Data Schedule

HCV - Housing Choice Voucher

HMIS - Homeless Management Information System

HUD - U.S. Department of Housing and Urban Development

HUDAR - HUD Acquisition Regulation

IMS/PIC - Inventory Management System/Public and Indian Housing Information Center

IG - Inspector General

IT - Information Technology

MOU - Memorandum of Understanding

MWP- Management & Work Plan

OCPO - Office of the Chief Procurement Officer

OIG- Office of Inspector General

OMB - Office of Management and Budget

PD&R - Office of Policy Development & Research

PHA - Public Housing Agency

PIH- Office of Public and Indian Housing

PII- Personally Identifying Information

PL- Public Law

PM-Project Manager

POC - Point of Contact

PPM - Project Planning Management

PRA - Paperwork Reduction Act

PWS - Performance Work Statement

QA - Quality Assurance

QASP - Quality Assurance Surveillance Plan

QCP - Quality Control Plan

RD/DCAP- Research Design, Data Collection & Analysis

SORN- Systems of Record Notice

SF - Standard Form

TA - Technical Assistance

TBD - To be determined

U.S.C - United States Code

VMS- Voucher Management System

3.0 Government-Furnished Property and Services

The Contractor shall ensure accurate control and accountability of all Government-Furnished

Property in accordance with the terms and conditions of this contract. The Government will furnish, at no cost to the Contractor, the GFP shown below.

3.1 Government Services

The Government will make every effort to provide the Contractor with timely access to any administrative data or reports that are possessed by HUD and might be required throughout the course of the evaluation.

3.2 Facilities

No Government facilities will be provided during the contract period of performance.

3.3 Equipment

No Government equipment will be supplied during the contract period of performance.

3.4 Materials

No Government materials will be provided during the contract period of performance.

3.5 Quality Assurance (QA)

The Government shall evaluate the Contractor's performance under this contract in accordance with the Quality Assurance Surveillance Plan. This plan is primarily focused on what the

Government must do to ensure that the Contractor has performed in accordance with the performance standards. It defines how the performance standards will be applied, the frequency of surveillance, and the minimum acceptable quality level.

4 Contractor-Furnished Items and Services

The Contractor shall furnish, all facilities, equipment, and supplies required to perform the work under this contract that are not listed under Government-Furnished Property and Services.

4.1 Facilities

The contractor shall furnish all facilities required to perform the duties of this contract.

4.2 Equipment

The contractor shall furnish all equipment required to perform the duties of this contract.

4.3 Material

The contractor shall furnish all materials required to perform the duties of this contract.

4.4 Contractor Responsibilities

The Contractor shall only conduct business with designated Government personnel listed as points of contact (POCs). Names of authorized personnel shall be provided to the Contractor by the Government, in writing, and updated as necessary throughout the contract period.

U.S. Government records, original data collected, and reports generated under this contract remain the property of the U.S. Government. These files/results must be surrendered to the

COR.

4.5 Contractor Personnel

The Contractor shall provide a Contract/Project Manager who shall be responsible for the performance of work. An alternate shall also be designated to act in the absence of the

Contract/Project Manager. These Contractor personnel (main point of contact and alternate point of contact) are considered Key Personnel by the Government and shall be listed as such in accordance with HUDAR 2452.237-70, “Key personnel.”

The Contract/Project Manager and alternate shall have full authority to act on all contract matters relating to daily operations of this contract. Accordingly, at a minimum, the points of contact shall have the technical knowledge of the requirement and be in the position to actually receive assignment, guidance, and direction from the COR, PM and CO per HUDAR 2452.237-73, "Conduct of Work and Technical Guidance" and shall be allocated enough hours to the requirement to ensure successful performance. These points of points of contact shall each be an employee of the Contractor. An employee of a subcontractor is not acceptable for either of these positions.

The Contract/Project Manager or alternate shall be available between the hours of 8:00am to

4:30pm Monday through Friday EST, except Federal Holidays or when the Government facility is closed for administrative reasons.

In addition to the Contract/Project Manager and alternate, the Contractor shall specify key personnel with the following expertise (one individual may account for more than one area of expertise):

(1) Rigorous program evaluation methodologies including multi-site social experiments using random control trial and quasi-experimental research designs

(2) Qualitative methods in program evaluation

(3) Evaluation of incentivised savings programs for very low-income households

(4) Evaluation impacts of rent reporting on credit building for residents of affordable housing

Subject matter experts may be employees of subcontractors, affiliates, joint venture partners, or team members and may be expert consultants. These subject matter experts are considered Key

Personnel by the Government and shall be listed as such in accordance with HUDAR 2452.237-

70, “Key personnel.”

4.6 Identification of Contractor Employees

While in the HUD building, all Contractor/subcontractor personnel shall wear company picture identification badges as to distinguish themselves from Government employees. When conversing with Government personnel during business meetings, over the telephone, or via electronic mail, Contractor/subcontractor personnel shall identify themselves as such to avoid situations arising where sensitive topics might be better discussed solely between Government employees.

Contractors/subcontractors shall identify themselves on any attendance sheet or any coordination documents they may review. Electronic mail signature blocks shall identify their company affiliation. Where practicable, Contractor/subcontractor occupying collocated space with their

Government program customer shall identify their workspace area with their name and company affiliation, or as a minimum, “Contractor” after name.

4.7 Quality Control

The Contractor shall establish and maintain a complete quality control program that shall ensure services are performed in accordance with this contract. The Contractor shall develop and implement procedures to identify, prevent, and ensure non reoccurrence of defective services. The Contractor's quality control program is the means by which he assures himself that his work complies with the requirements of the contract. The Contractor shall provide the associated Quality Control Plan to the Government as directed.

4.7.1 Quality Control Plan

The Contractor shall develop, maintain, enforce, and document a Quality Control Plan (QCP).

The QCP shall ensure the Government receives the level of quality that is consistent with the requirements specified in this contract. The QCP shall be sufficiently detailed to provide the

Contractor's methodology for identifying and recruiting qualified personnel. The QCP shall also provide the Contractor's methodology for resolving problems identified by the Government during reviews conducted in accordance with its Quality Assurance Surveillance Plan (QASP).

The QCP shall also provide the Contractor's methodology for establishing an internal feedback system for support personnel, and for resolving problems identified by that feedback system.

The QCP shall demonstrate and validate that the services or deliverables to be provided under the contract are completed with a level of quality that meets the minimum performance threshold established in the Government's QASP. The QCP shall address Quality Management Approach, Quality Assurance, Quality Control and Quality Standards.

5.0 Specific Tasks

5.1 Project Management

5.1.1 Opening Meeting

The Opening Meeting will take place within two weeks of contract award, by videoconference or in person, by mutual agreement between HUD and the contractor. At the Opening Meeting, HUD and the contractor will establish a shared understanding of the project. HUD will provide the contractor with information about the Asset Building Cohort.

Meeting invitees will include, at a minimum, staff from HUD’s Office of Policy Development and Research (PD&R) and HUD’s Office of Public and Indian Housing (PIH). Among the topics for this meeting will be HUD’s goals and expectations for the work, a review of each task encompassed under the PWS and a discussion of any challenges that might be faced during the completion of each, review of project schedule, and administrative details related to invoicing, monthly progress reports, and ongoing communications. The Project Director and the COR shall collaborate to develop the agenda for the Opening Meeting. The COR will be responsible for finalizing the agenda, and the Contractor shall be responsible for developing presentation materials for the Opening Meeting. The contractor must take detailed notes of the meeting and provide them to the COR within three business days after the meeting.

Deliverables

A001 Draft slide deck for Opening Meeting

A002 Final slide deck for Opening Meeting

A003 Opening Meeting Summary Memorandum

5.1.2 Management and Work Plan

The Contractor’s draft Management and Work Plan (MWP) shall be delivered to the COR and

CO within two (2) weeks after contract award. HUD will respond with comments within one (1) week. The Contractor shall submit a final MWP incorporating HUD’s comments within one (1) week of receipt of HUD comments. It shall be submitted to the COR and CO within 15 business days when changes are made thereafter. After acceptance of the MWP, the Contractor shall receive the CO’s acceptance in writing of any proposed changes to the Plan.

The COR may direct the Contractor to update the MMP in the event of a modification or reallocation of resources within the existing scope, budget, and overall time of completion.

Where changes affect the scope of work, budget, or overall time of completion, changes will require a contract modification and approval by the CO

The MW P shall conform to the following criteria:

A. The Management Plan shall be clear, concise, and shall demonstrate it will meet the objectives and requirements contained within the Performance Work Statement.

B. The Management Plan shall identify the following:

1. An outline of all key personnel roles and responsibilities.

2. Any proposed subcontracting or teaming arrangements and reporting relationships of subcontractors and team members; including clearly identifying aspects of the work to be performed by the prime and detailing work aspects to be performed by each subcontractor.

3. Schedules of all tasks and subtasks, meetings, and deliverables.

4. A plan that demonstrates successful communication and coordination between the

Contractor and the government personnel/roles.

5. An organization chart with key personnel roles and names, including subcontractors and teaming partners. The chart shall demonstrate clear lines of authority from the top of the organization to all those working on this effort.

Performance Standards

Standard: Timely: The Draft and Final Management Plan is submitted to the Government in accordance with the deliverable schedule.

AQL: Zero Deviation

A004 Draft Management Plan

A005 Final Management Plan

5.1.3 Monthly Reports and Ongoing Communication

The Contractor shall provide monthly reports on the progress of the project by the 15th of each month to the CO and COR and will report on the contract activities from the previous month.

Each report will include: (1) a description of the work performed under each task; (2) summary of deliverables; (3) problems encountered or remaining from prior months; (4) approach to resolve problems; (5) activities for next month; (6) breakdown of monthly expenditures by tasks, and (7) any other significant concerns or issues. Each report should be sent directly to the COR via electronic mail.

The Contractor shall also participate in regular conference calls with the COR and other HUD staff, as appropriate, to discuss the progress of the study and address any issues or challenges that to may have arisen over the duration of the contract. These conference calls may be weekly during the early stages of the contract and/or during any period of survey data collection, and shift to bi-weekly or monthly during other times. The contractor must plan and facilitate the meeting and take detailed notes of the meeting and provide them to the COR within three business days after the meeting.

Standard: Monthly reports are submitted by the 15th of each month.

AQL: Deviation of 3 business days

Standard: Reports convey project status clearly and accurately

AQL: Zero deviation

Standard: Minutes accurately convey agreements and HUD communications

AQL: Zero deviation

A006 Monthly Progress Reports

A007 Ongoing Communication Meeting Minutes

5.2 Expert Panel

The Contractor shall recruit five subject matter experts to be part of an Expert Panel that will review and comment on the White Paper Draft (see Task 5.3) and to prepare for, attend, and contribute substantially to one (1) meeting to discuss the Design Memo and two (2) meetings to discuss the Research Designs Report Draft.

HUD anticipates that the Expert Panel should provide some or all of the following areas of expertise, and that some members will have multiple areas of expertise and skills.

• Rent reporting for credit building

• Credit situations of low- and very-low income individuals

• Financial services for low and very low-income individuals

• Emergency savings accounts (and possibly other types of savings accounts, such as child savings accounts, 529 plans, or something else entirely)

• Measures and scales commonly used in research to assess financial wellbeing of low-income households

• Uses of financial and credit report data for research purposes

• Measures and scales commonly used in research to assess material hardship, and emotional and physical wellbeing

• Experience as a renter in affordable housing having their rent reported for credit building purposes

The expertise needed on the Expert Panel should reflect the programs being implemented by the

PHAs and complement the expertise on the research team. For example, if several PHAs intend to implement child savings accounts or encourage residents to start a 529 plan, the Expert Panel should include an expert in such accounts. The research team and the Expert Panel may have areas of expertise that are complementary or overlapping.

5.2.1 List of Potential Expert Panel Members

Within two (2) weeks of contract award, the Contractor must submit a list of potential members of the Expert Panel. The Expert Panel will provide substantive input on all aspects of the

Research Design. HUD will review and approve the proposed members or request revisions within one week.

5.2.2 Signed Participant Agreements for Five (5) Expert Panel Members

Within five (5) weeks of contract award five (5) (Just a question, why 5 do you mean minimum of or exactly 5?) Expert Panel members should be on board with signed non-disclosure agreements and documented roles and honoraria amounts on record. The Expert Panel members must be available to review the White Paper Draft, which is due 5 weeks after contract award, and the Design Memo, which is due 10 weeks after contract award. The Expert Panel meeting to discuss the Design Memo should take place at 11 weeks after contract award.

Standard: Expert Panel includes appropriate experts

A008 List of Potential Expert Panel Members

A009 Signed Participant Agreements for Five (5) Expert Panel Members

5.3 White Paper and Engagement with PHAs

The Contractor shall produce the White Paper. The purpose of the White Paper is to review and synthesize studies that provide information about the likely components, size, and scope that would be needed for a program intended to create a savings account and a program of reporting rent to build credit to have observable impacts. This paper will be an internal document for use by the research team, Expert Panel, and HUD staff. The White Paper, in turn, will serve as the basis for developing an educational webinar and related resource materials intended for PHAs in the Asset Building Cohort. The research team will develop the materials, including slides and handouts, and also present the webinar three times to participating PHAs. The White Paper and webinar materials will serve as a resource for HUD staff and Asset Building Cohort PHAs as the

PHAs design their programs.

5.3.1 White Paper Draft

The White Paper Draft is due 5 weeks after contract award. The purpose of the White Paper is to review and synthesize what current literature suggests about the likely components, size and scope needed for a savings or rent reporting program to have observable impacts. This paper will be an internal document for use by the research team, Expert Panel, and HUD staff. HUD and the Expert Panel will have two weeks to review and comment on the draft White Paper.

5.3.2 White Paper

The final White Paper will be due 9 weeks after contract award. The White Paper and webinar materials based upon its findings will serve as a resource for HUD staff and Asset Building

Cohort PHAs as the PHAs design their programs. The final White Paper must incorporate feedback from HUD staff and the Expert Panel.

5.3.3 Three Webinar Presentations

The Contractor shall produce the Webinar Presentations. The Webinar Slides and Materials will be due 15 weeks after contract award. The webinar must be designed to communicate clearly to

PHA staff who are designing their asset building program—be it savings or rent reporting—what the evidence says about the components, size, and scope of interventions that are likely to produce observable impacts.

The Contractor shall present the webinar three times to staff of PHAs participating in the Asset

Building Cohort. The webinar slides and handouts will be posted on HUD’s website and serve as a resource for HUD staff and PHA staff to help them design their asset building programs.

5.3.4 Consulting with Individual PHAs

The Contractor shall consult with each participating PHA about the PHA’s proposed intervention for the purpose of determining if the proposed interventions seem likely to have an observable impact on households and to strategize ways to enhance or change the intervention so that it is more likely to have an impact. These consultations shall be in addition to the discussions that occur as part of the webinars. The Contractor shall be available for up to four (4) hours of consulting with each PHA selected into the Asset Building Cohort. (HUD anticipates up to 30

PHAs to participate in the Asset Building Cohort.)

Standard: White Paper Draft describes at least 10 studies and what they suggest is needed for the

ABC cohort asset building programs to have an observable impact

Standard: White Paper meets standard for draft paper and additionally is clear and readable and responsive to all HUD comments

A010 White Paper Draft

A011 White Paper

A012 Webinar Slides and Handouts

A013 Three Webinar Presentations

5.4 Design Memo and Expert Panel Meeting

HUD anticipates that a major challenge of developing the evaluation research design is that there will be two different program types and that PHAs have great flexibility to design their versions of these program types. HUD prefers to see a research design approach in which the research designs are related to each other—for instance, there may be overlap in the impact and outcome variables studied. HUD anticipates that at least two, but possibly even three, research designs will be needed, depending on the PHAs that join the Asset Building Cohort and which asset building programs they intend to implement.

5.4.1 Design Memo

The Design Memo, due no later than ten (10) weeks after contract award, must outline research design approaches to studying each of the program types that the PHAs in the Asset Building

Cohort propose to implement. The Design Memo must identify critical questions and decision points that could affect the Research Design, the Data Collection and Analysis Plan, and the evaluation.

The Design Memo must identify critical questions and decision points related to most or all of the following questions and may also address additional issues raised by the contractor or HUD:

1) What confirmatory outcomes should HUD’s evaluation monitor to determine the impact of the two types of asset building initiatives?

2) What other outcomes should be considered?

3) What outcomes could be the same for savings programs and rent reporting for credit building programs?

4) What data sources and collection methods are appropriate to measure the recommended outcomes and impacts?

5) What qualitative information will be necessary to understand the implementation of the asset building programs, thinking about the perspectives of assisted households, PHAs, and other stakeholders?

6) Given the number of PHAs in the Asset Building Cohort, the Asset Building programs they intend to implement, and the numbers of households they intend to enroll

a. What counterfactuals can be observed?

b. Can rigorous impact analyses be done and, if so, how?

c. What are the best research designs to cost effectively produce the most rigorous findings for each program type?

d. Are there any characteristics of the programs that should be required in order to ensure that a rigorous study can be done (e.g., do contributions to savings need to be at a certain level?)

e. What timeframes are required to detect impacts of the studied programs?

7) What challenges would we expect the recommended approaches to encounter and how should the challenges be mitigated?

5.4.2 Design Memo Expert Panel Meeting

Within one week of submitting the Design Memo, the Project Director and other project staff, as appropriate, shall meet with the COR, other relevant HUD staff, other relevant stakeholders, and the Expert Panel to determine the approach to developing research designs for the MTW

Expansion Asset Building Cohort. The Design Memo will guide this discussion. HUD intends for these discussions to result in a clear understanding on the approaches to be developed in the

Research Designs Report.

The contractor must plan and facilitate the meeting, and take detailed notes of the meeting and provide the notes to the COR within one week after the meeting.

Standard: The Design Memo meets the full substantive requirements of the PWS

A014 Design Memo

A015 Minutes of the Expert Panel Meeting

5.5 Research Designs Report

The Research Designs Report, due no later than 26 weeks after contract award, must be a complete, stand-alone written product that fully addresses the questions related to the research listed in Task 3.1 (Design Memo) and any additional issues raised by the Contractor or HUD.

HUD anticipates that at least two, but possibly even three, research designs will be needed, depending on the PHAs that join the Asset Building Cohort and which asset building programs they intend to implement.

HUD anticipates that the research designs for the different program types will be related to each other—for instance that they may include some of the same outcome or impact variables—and that the research effort will advance HUD’s understanding of the facilitators and obstacles to incorporating asset building into housing assistance programs.

5.5.1 Research Designs Report Draft

The Research Designs Report Draft will be due 18 weeks after contract award. It must be a complete, stand-alone written product that addresses the questions related to the research listed in

Task 3.1 and any additional issues raised by the Contractor or HUD during discussions of the

Design Memo. The report draft should resolve questions that were identified in the Design

Memo and discussed with HUD staff and the Expert Panel, and should incorporate any additional direction the COR provided in writing to the research team. The report draft must demonstrate how and why the contractor arrived at the report’s recommendations. HUD anticipates that at least two, but possibly even three, research designs will be needed, depending on the PHAs that join the ABC and the asset building programs they propose.

HUD may reject the Research Designs Report Draft and require it to be revised and resubmitted, if it fails to meet any of the following performance standards:

(1) It must resolve questions related to the research listed under Task 3.1 and discussed in the

Design Memo, and the additional issues (if any) raised by the Contractor or HUD and during discussions of the Design Memo

(2) The report must justify its recommendations

(3) Justifications must be consistent with established research on the studied asset building programs

(4) It must be compatible with HUD’s guidance on what the PHAs in the Asset Building

Cohort are required and allowed to do as detailed in the Selection Notice and any further guidance by HUD

(5) It must reflect the input received during the Expert Panel meeting on the Design Memo and feedback to the research team provided by the COR in writing

5.5.2 Research Designs Expert Panel Meetings

The Research Designs Expert Panel Meetings, to take place no later than 20 weeks after contract award, are intended to resolve research design challenges. HUD anticipates that two meetings will be required, one to discuss evaluation of savings programs and one to discuss evaluation of reporting rent to build credit. Each meeting should include the Project Director and other project staff, as appropriate, the COR, other relevant HUD staff, other relevant stakeholders, and the

Expert Panel.

The contractor must plan and facilitate the meetings and take detailed notes of the meetings and provide the notes to the COR within one week after each meeting.

5.5.3 Research Designs Report

The Research Designs Report, due no later than 26 weeks after contract award, is the key deliverable under the base contract. It must be a complete, stand-alone written product that fully addresses the questions related to the research listed under Task 3.1 and the additional issues (if any) raised by the Contractor or HUD and agreed upon in discussions of the Design Memo and in discussions of the Research Designs Report Draft. The report must justify its recommendations. HUD anticipates that at least two, but possibly even three, research designs will be needed, depending on the PHAs that join the cohort and which asset building programs they plan to implement.

The Research Designs Report should include estimated levels of effort and cost for proposed research approaches.

The Research Designs Report must respond to the substantive input received during the Expert

Panel meetings or communicated in written reviews of the draft report provided by the COR to the contractor. Each submitted draft must include a summary of all changes made, including justifications for any feedback not incorporated. The contractor shall submit a summary and a tracked changes version of the text with notes on how and where substantive input from the

Expert Panel and HUD was addressed.

HUD may reject the Research Designs Report, and require that it be revised and resubmitted, if it fails to meet the following performance standards:

(1) It must address the questions related to the research listed under Task 3.1 and the additional issues (if any) raised by the Contractor or HUD and agreed upon in discussions of the Design Memo and in discussions of the Research Designs Report Draft

(2) The Report must justify its recommendations

(3) Justifications must be consistent with established research on the studied asset building programs

(4) It must be compatible with HUD’s guidance on what the PHAs in the Asset Building

Cohort are required and allowed to do as detailed in the Selection Notice and any further guidance by HUD

(5) It must reflect the input received during the Research Designs Expert Panel Meetings

(Task 5.2) from HUD staff and other stakeholders

(6) It must include estimated levels of effort and costs for different research approaches

The Research Designs Report will be the property of HUD and is expected to be published. HUD reserves the right to use the Research Designs Report—in whole, or in part, or with modifications—to guide work under a subsequent contract.

Performance Standard

Standard: Meets the full substantive requirements of the PWS

A016 Research Designs Report Draft

A017 Research Designs Expert Panel Meeting Minutes

A018 Research Designs Report

5.6 Data Collection and Analysis Plan (DCAP) (Option Period)

The Data Collection and Analysis Plan (DCAP), due 39 weeks after base contract award, will provide a detailed technical blueprint, including data collection instruments, for implementation of the evaluation research. The DCAP will be based on the Research Designs Report produced under the base contract. The DCAP must be a complete, stand-alone written product that describes the feasible and cost-effective implementation of the research designs. It must

(1) Explain how to implement the agreed upon research design

(2) Detail feasible methods for data collection

(3) Detail valid methods for data analysis

(4) Include field-ready data collection instruments

(5) Maintain scientific integrity

(6) Provide cost estimates for major data collection and analysis tasks

5.6.1 DCAP Draft

The DCAP Draft, 34 weeks after base contract award (8 weeks after option), will explain how the research designs will be implemented. The DCAP draft must include draft data collection instruments.

(1) It must explain in detail how to implement the agreed upon Research Designs and where applicable present alternative approaches with discussion of pros and cons

(2) The proposed data collection and analysis methods must be the most rigorous methods that are feasible given the number of participating PHAs

(3) The proposed data collection and analysis methods must be feasible within reasonable cost constraints

(4) The Plan must include estimated levels of effort and costs for proposed data analysis and collection tasks

5.6.2 DCAP Draft Expert Panel Meetings

The DCAP Draft Expert Panel Meetings, to take place no later 36 weeks after base contract award (10 weeks after option award), is intended to offer expert input to the research team as it tries to resolve questions about how to implement the research design.