National_and_Tribal_Evaluation_of_the_2nd_Generation_of_the_Health_Profession_Opportunity_Grants_Solicitation.pdf

SEE ADDENDUMIS CHECKED

CODE 18a. PAYMENT WILL BE MADE BY

CODE

FACILITYCODE

17b. CHECK IF REMITTANCE IS DIFFERENT AND PUT SUCH ADDRESS IN OFFER

OFFEROR

DAM

Rockville MD 20857 12501 Ardennes Avenue Twinbrook Place, Suite 400

DHHS/PSC/AMS/DAM

ACF CODE 16. ADMINISTERED BYCODE

X

X

541611

SIZE STANDARD:

% FOR:SET ASIDE:UNRESTRICTED ORDAM

RFPIFB

10. THIS ACQUISITION ISCODE

RFQ

14. METHOD OF SOLICITATION

13b. RATING

NAICS:

SMALL BUSINESS

07/15/2015 1200 ET

05/15/2015

ISAAC BELLAMY

(No collect calls)

INFORMATION CALL:

FOR SOLICITATION 8. OFFER DUE DATE/LOCAL TIMEb. TELEPHONE NUMBER a. NAME

4. ORDER NUMBER3. AWARD/ 6. SOLICITATION

15-233-SOL-00191

5. SOLICITATION NUMBER

SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL ITEMS 1. REQUISITION NUMBER PAGE OF

1 124 ACF148121OFFEROR TO COMPLETE BLOCKS 12, 17, 23, 24, & 30

TELEPHONE NO.

17a. CONTRACTOR/

Washington DC 20447 370 L'Enfant Promenade, S.W.

Administration for Children and Fam Admin for Children + Families

15. DELIVER TO

Rockville MD 20857 12501 Ardennes Avenue Twinbrook Place, Suite 400

9. ISSUED BY

7.

2. CONTRACT NO.

EFFECTIVE DATE

$15.0

18b. SUBMIT INVOICES TO ADDRESS SHOWN IN BLOCK 18a UNLESS BLOCK BELOW

ISSUE DATE

DELIVERY FOR FOB DESTINA-

TION UNLESS BLOCK IS

MARKED

11.

SEE SCHEDULE

12. DISCOUNT TERMS

THIS CONTRACT IS A

RATED ORDER UNDER

DPAS (15 CFR 700)

13a.

SERVICE-DISABLED

VETERAN-OWNED

SMALL BUSINESS

HUBZONE SMALL

BUSINESS

8(A)

DHHS/PSC/AMS/DAM

WOMEN-OWNED SMALL BUSINESS

(WOSB) ELIGIBLE UNDER THE WOMEN-OWNED

SMALL BUSINESS PROGRAM

EDWOSB

24.

AMOUNT

23.

UNIT PRICE

22.

UNIT

21.

QUANTITY

20.

SCHEDULE OF SUPPLIES/SERVICES

19.

ITEM NO.

National and Tribal Evaluation of the 2nd Generation of the Health Profession Opportunity Grants (HPOG) Period of Performance: 09/30/2015 to 09/29/2025

1 Services Component 1 (Award - 72 Month Period) 1 EA

Continued ...

(Use Reverse and/or Attach Additional Sheets as Necessary)

HEREIN, IS ACCEPTED AS TO ITEMS:

X

XX

DATED

ROSANNA BROWNING

. YOUR OFFER ON SOLICITATION (BLOCK 5),

INCLUDING ANY ADDITIONS OR CHANGES WHICH ARE SET FORTH

COPIES TO ISSUING OFFICE. CONTRACTOR AGREES TO FURNISH AND DELIVER

ARE

ARE

31c. DATE SIGNED

27b. CONTRACT/PURCHASE ORDER INCORPORATES BY REFERENCE FAR 52.212-4. FAR 52.212-5 IS ATTACHED. ADDENDA

31a. UNITED STATES OF AMERICA (SIGNATURE OF CONTRACTING OFFICER)

30c. DATE SIGNED 31b. NAME OF CONTRACTING OFFICER (Type or print)

ALL ITEMS SET FORTH OR OTHERWISE IDENTIFIED ABOVE AND ON ANY ADDITIONAL

SHEETS SUBJECT TO THE TERMS AND CONDITIONS SPECIFIED.

27a. SOLICITATION INCORPORATES BY REFERENCE FAR 52.212-1, 52.212-4. FAR 52.212-3 AND 52.212-5 ARE ATTACHED. ADDEND

26. TOTAL AWARD AMOUNT (For Govt. Use Only)

OFFER

STANDARD FORM 1449 (REV. 2/2012)

Prescribed by GSA - FAR (48 CFR) 53.212

ARE NOT ATTACHED.

ARE NOT ATTACHED.

AUTHORIZED FOR LOCAL REPRODUCTION

PREVIOUS EDITION IS NOT USABLE

30b. NAME AND TITLE OF SIGNER (Type or print)

30a. SIGNATURE OF OFFEROR/CONTRACTOR

28. CONTRACTOR IS REQUIRED TO SIGN THIS DOCUMENT AND RETURN

25. ACCOUNTING AND APPROPRIATION DATA

29. AWARD OF CONTRACT:

REF.

32e. MAILING ADDRESS OF AUTHORIZED GOVERNMENT REPRESENTATIVE

32c. DATE 32b. SIGNATURE OF AUTHORIZED GOVERNMENT REPRESENTATIVE

ACCEPTED, AND CONFORMS TO THE CONTRACT, EXCEPT AS NOTED:

32a. QUANTITY IN COLUMN 21 HAS BEEN

RECEIVED INSPECTED

40. PAID BY39. S/R VOUCHER NUMBER38. S/R ACCOUNT NUMBER

37. CHECK NUMBER

FINALPARTIAL

36. PAYMENT

FINALPARTIAL

35. AMOUNT VERIFIED

CORRECT FOR

34. VOUCHER NUMBER33. SHIP NUMBER

COMPLETE

32g. E-MAIL OF AUTHORIZED GOVERNMENT REPRESENTATIVE

42d. TOTAL CONTAINERS42c. DATE REC'D (YY/MM/DD)

42b. RECEIVED AT (Location)

42a. RECEIVED BY (Print)

41c. DATE41b. SIGNATURE AND TITLE OF CERTIFYING OFFICER

41a. I CERTIFY THIS ACCOUNT IS CORRECT AND PROPER FOR PAYMENT

STANDARD FORM 1449 (REV. 2/2012) BACK

24.

AMOUNT

23.

UNIT PRICE

22.

UNIT

21.

QUANTITY

20.

SCHEDULE OF SUPPLIES/SERVICES

19.

ITEM NO.

2 Optional Services Component 2 (Exercise Option - 1 EA

12 month period)

(Option Line Item)

3 Optional Services Component 3 (Exercise Option - 1 EA

60 month period)

(Option Line Item)

4 Optional Services Component 4 (Exercise Option - 1 EA

60 month period)

(Option Line Item)

5 Optional Services Component 5 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

6 Optional Services Component 6 (Exercise Option - 1 EA

Continued ...

32f. TELEPHONE NUMBER OF AUTHORIZED GOVERNMENT REPRESENTATIVE

32d. PRINTED NAME AND TITLE OF AUTHORIZED GOVERNMENT REPRESENTATIVE

124 2 of

ITEM NO. SUPPLIES/SERVICES QUANTITY UNIT UNIT PRICE AMOUNT

NAME OF OFFEROR OR CONTRACTOR

3 124

CONTINUATION SHEET

REFERENCE NO. OF DOCUMENT BEING CONTINUED PAGE OF

(A) (B) (C) (D) (E) (F)

15-233-SOL-00191

24 month period)

(Option Line Item)

7 Optional Services Component 7 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

8 Optional Services Component 8 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

9 Optional Services Component 9 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

10 Optional Services Component 10 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

11 Optional Services Component 11 (Exercise Option - 1 EA

84 month period)

(Option Line Item)

12 Optional Services Component 12 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

Continued ...

NSN 7540-01-152-8067 OPTIONAL FORM 336 (4-86)

Sponsored by GSA

FAR (48 CFR) 53.110

4 124

CONTINUATION SHEET

REFERENCE NO. OF DOCUMENT BEING CONTINUED PAGE OF

(A) (B) (C) (D) (E) (F)

15-233-SOL-00191

13 Optional Services Component 13 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

14 Optional Services Component 14 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

15 Optional Services Component 15 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

16 Optional Services Component 16 (Exercise Option - 1 EA

72 month period)

(Option Line Item)

17 Optional Services Component 17 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

18 Optional Services Component 18 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

19 Optional Services Component 19 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

Continued ...

NSN 7540-01-152-8067 OPTIONAL FORM 336 (4-86)

5 124

CONTINUATION SHEET

REFERENCE NO. OF DOCUMENT BEING CONTINUED PAGE OF

(A) (B) (C) (D) (E) (F)

15-233-SOL-00191

20 Optional Services Component 20 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

21 Optional Services Component 21 (Exercise Option - 1 EA

24 month period)

(Option Line Item)

NSN 7540-01-152-8067 OPTIONAL FORM 336 (4-86)

Solicitation: 15-233-SOL-00191 National and Tribal Evaluation of the 2nd Generation of the Health Profession Opportunity Grants (HPOG)

SECTION B – SUPPLIES OR SERVICES AND PRICE/COSTS

B.1 LINE ITEMS

In consideration of performance of the work described in Section C, Line Items/Specifications/Statement of Work, the Contractor shall be reimbursed the Cost Plus Fixed Fee amount as follows:

CLIN 1 – Services Component 1 (Award – 72 Month Period) Estimated POP 09/2015 – 09/2021 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Final Report of HPOG Impact Study Execution. See Section F2 (SC1 Subtask 4.3).

- Estimated Cost $

- Fixed Fee $ Estimated Cost Plus Fixed Fee Total $

CLIN 2 – Optional Services Component 2 (Exercise Option – 12 month period) Estimated

POP 09/2015 – 09/2016

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is a final evaluation plan of the 2nd Generation Tribal HPOG programs. See Section F2 (OSC2, Task 5).

Estimated Cost Plus Fixed Fee Total $

CLIN 3 - Optional Services Component 3 (Exercise Option – 60 month period) Estimated

POP 9/2016 – 09/2021

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is a report of the 2nd Generation Tribal HPOG study findings. See Section F2 (OSC3, Task 4).

- Estimated Cost $

CLIN 4 - Optional Services Component 4 (Exercise Option – 60 month period) Estimated

POP 09/2017 – 09/2022

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Final Report of 15-month Impact Findings for the HPOG 2nd Generation National Evaluation. See Section F2 (OSC4, Task 7).

- Estimated Cost $

CLIN 5 - Optional Services Component 5 (Exercise Option – 24 month period) Estimated

POP 09/2018 – 09/2020

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Evaluation Progress Memorandum. See Section F2 (OSC5, Task 2).

- Estimated Cost $

CLIN 6 - Optional Services Component 6 (Exercise Option – 24 month period) Estimated

POP 09/2019 – 09/2021

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Evaluation Progress Memorandum. See Section F2 (OSC6, Task 2).

- Estimated Cost $

CLIN 7 - Optional Services Component 7 (Exercise Option – 24 month period) Estimated

POP 09/2018 – 09/2020

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC7, Task 2).

- Estimated Cost $

CLIN 8 - Optional Services Component 8 (Exercise Option – 24 month period) Estimated

POP 09/2019 – 09/2021

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC8, Task 2).

- Estimated Cost $

CLIN 9 - Optional Services Component 9 (Exercise Option – 24 month period) Estimated

POP 09/2020 – 09/2022

This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC9, Task 2).

- Estimated Cost $

CLIN 10 - Optional Services Component 10 (Exercise Option – 24 month period) Estimated POP 09/2021 – 09/2023 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC10, Task 2).

CLIN 11 - Optional Services Component 11 (Exercise Option – 84 month period) Estimated POP 09/2018 – 09/2025 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Final Report of 36-month Impact Findings for the HPOG 2nd Generation National Evaluation. See Section F2 (OSC11, Task 6).

- Estimated Cost $

CLIN 12 - Optional Services Component 12 (Exercise Option – 24 month period) Estimated POP 09/2019 – 09/2021 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC12, Task 2).

- Estimated Cost $

CLIN 13 - Optional Services Component 13 (Exercise Option – 24 month period) Estimated POP 09/2020 – 09/2022 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC13, Task 2).

- Estimated Cost $

CLIN 14 - Optional Services Component 14 (Exercise Option – 24 month period) Estimated POP 09/2021 – 09/2023 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC14, Task 2).

- Estimated Cost $

CLIN 15 - Optional Services Component 15 (Exercise Option – 24 month period) Estimated POP 09/2022 – 09/2024 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Additional Data Collection Summary Memorandum.

See Section F2 (OSC15, Task 2).

- Estimated Cost $

CLIN 16 - Optional Services Component 16 (Exercise Option – 72 month period) Estimated POP 09/2019 – 09/2025 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is the Final Report Summarizing Findings of the HPOG 2nd Generation Cost-Benefit Study. See Section F2 (OSC16, Task 2).

- Estimated Cost $

CLIN 17 - Optional Services Component 17 (Exercise Option – 24 month period) Estimated POP 09/2016 – 09/2018 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is Final Special Topics Reports. See Section F2 (OSC17, Task 1).

- Estimated Cost $

CLIN 18 - Optional Services Component 18 (Exercise Option – 24 month period) Estimated POP 09/2018 – 09/2020 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is Final Special Topics Reports. See Section F2 (OSC18, Task 1).

- Estimated Cost $

CLIN 19 - Optional Services Component 19 (Exercise Option – 24 month period) Estimated POP 09/2020 – 09/2022 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is Final Special Topics Reports. See Section F2 (OSC19, Task 1).

- Estimated Cost $

CLIN 20 - Optional Services Component 20 (Exercise Option – 24 month period) Estimated POP 09/2022 – 09/2024 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is Final Special Topics Reports. See Section F2 (OSC20, Task 1).

- Estimated Cost $

CLIN 21 - Optional Services Component 21 (Exercise Option – 24 month period) Estimated POP 09/2023 – 09/2025 This is a cost plus fixed fee completion type line item for non-commercial, non-severable services. The end product of value is Final Special Topics Reports. See Section F2 (OSC21, Task 1).

* The timing of the actual exercising of optional services may vary and is at the discretion of the Government. Optional services components periods of performance may overlap.

USE OF FUNDS: Funds for each CLIN may only be used for work under that CLIN and cannot be used for any other CLIN. Funds are only available for use for the line item to which they are obligated. Unused funds from one line item may not rollover for use in other line items.

B.2 Proposal Assumptions

Technical proposals should reflect Offerors’ experience with similar projects and describe how past efforts and strategies have resulted in effective execution of similar projects and/or the use of techniques similar to those proposed here. Offerors are expected to provide a technical approach that is innovative, relevant to the current policy and programmatic environment, of the highest scientific quality and rigor, and consistent with effective project management.

Additionally, Offerors are expected to recruit, select, and subcontract with experts on conducting research with tribal populations and communities to assist with the design and execution of the Evaluation of Tribal HPOG programs (Key Optional Services Components 2 and 3), unless Offerors can demonstrate to the satisfaction of the ACF that they have sufficient experience and capacity to do so without a subcontract. If a subcontractor is needed to satisfy this requirement, their relevant qualifications and experience should be included in the proposal. Offerors may also propose to include subcontractors on other tasks where appropriate.

Offerors may use the following assumptions on which to base cost estimates:

Services Component 1:

- Task 2.1 (Consultation with Experts): If Offerors propose to consult with experts, the exact number of experts will be determined in consultation with the COR; however, for cost estimation purposes, Offerors shall assume that they may consult with up to ten

(10) experts.

- Task 3 (Assess Site Evaluability): For the purposes of estimating costs, Offerors shall assume that 35 HPOG grantees will be included in the National Evaluation of the 2nd Generation of HPOG.

- Task 4 (Conduct Impact Study): For the purposes of estimating costs, Offerors shall assume that 35 HPOG grantees will be included in the National Evaluation of the 2nd Generation of HPOG.

- Subtask 5.1 (Site Payments): While the range of supplemental payments that would be needed to support the goals and objectives of the evaluation to have strong tests that are well managed and to obtain all information and data required for the evaluation is expected to vary, for cost purposes, Offerors shall assume total payments of $1,000,000 per fiscal year for two years to be shared across all sites (assume approximately 35 HPOG grantees) for this task.

- Subtask 6.1 (Develop Data Collection Plan): ACF does not expect it to be possible to survey the entire sample of the National Evaluation of the 2nd Generation of HPOG (assuming approximately 80,000 respondents across the treatment and control groups).

Offerors should propose their best ideas for innovative, creative, and cost-efficient methods for maximizing the information collected given finite survey resources. These ideas should include but are not limited to innovative, creative, and cost-efficient methods for tracking and locating individuals that are traditionally difficult to reach, as well as proposals for how to best use administrative data to complement survey data.

- Subtask 6.2 (Design of First Follow-up Survey): For the purposes of estimating costs, Offerors shall assume that the First Follow-up Survey will take approximately one hour to administer.

- Task 11 (Special Topics Reports, Briefs, and Documents): For the purposes of estimating costs, Offerors shall assume that three (3) special topics reports, briefs, and documents shall be developed under this task.

Key Optional Services Component 2:

- Subtask 2.2 (Consultation with Subject Matter Experts): The exact number of experts to be involved will be determined after exercising this optional services component, but for the purposes of estimating costs, Offerors shall assume five (5) expert consultants will be required.

- Subtask 2.3 (Brief Review of the Literature): For the purposes of estimating costs, Offerors shall assume the literature review shall be no longer than 40 pages.

- Task 8 (Special Topics Reports, Briefs, and Documents): For the purposes of estimating costs, Offerors shall assume two (2) special topics papers.

Key Optional Services Component 3:

- Task 2 (Ongoing Consultation with Tribal Leaders and Subject Matter Experts): The exact number of experts to be involved will be determined after exercising this optional services component, but for the purposes of estimating costs, Offerors shall assume five

(5) expert consultants will be required.

- Task 4 (Conduct Tribal HPOG Evaluation): For the purposes of estimating costs, Offerors shall assume four (4) site visits per Tribal HPOG grantee (assume approximately 5 Tribal HPOG grantees).

- Task 7 (Special Topics Reports, Briefs, and Documents): For the purposes of estimating costs, Offerors shall assume four (4) special topics papers.

Key Optional Services Component 4:

- Task 2 (Ongoing Support for Evaluation Sites): While the range of supplemental payments that would be needed to support the goals and objectives of the evaluation to have strong tests that are well managed and to obtain all information and data required for the evaluation is expected to vary, for cost purposes, Offerors shall assume total payments of $1,000,000 per fiscal year for one year to be shared across all sites (assume approximately 35 HPOG grantees) for this task. To the extent possible and reasonable, payments may be reduced over time if the evaluation burden is reduced.

- Task 3 (Administer First Follow-up Survey): ACF does not expect it to be possible to survey the entire sample of the National Evaluation of the 2nd Generation of HPOG (assuming approximately 80,000 respondents across the treatment and control groups).

Offerors should propose their best ideas for innovative, creative, and cost-efficient methods for maximizing the information collected given finite survey resources. These ideas should include but are not limited to innovative, creative, and cost-efficient methods for tracking and locating individuals that are traditionally difficult to reach, as well as proposals for how to best use administrative data to complement survey data.

For the purposes of estimating costs, Offerors shall assume that 4,000 participants in the National Evaluation will be administered a follow-up survey under this task.

- Task 4 (Administrative Data Collection): ACF expects to utilize administrative data sources to measure impacts and outcomes of the 2nd Generation of HPOG. Offerors shall assume that the entire sample of the National Evaluation (approximately 80,000 respondents) will be included in administrative data collection.

- Task 5 (Conduct Process/Implementation Evaluation): For the purposes of estimating costs, Offerors shall assume that all (approximately 35) HPOG grantees shall be included in the process/implementation evaluation.

- Task 6 (Analysis): For the purposes of estimating costs, Offerors shall assume that, in addition to the National Evaluation findings, ten (10) HPOG grantees will be eligible to measure site-specific impact findings.

- Task 7 (Reporting and Dissemination): For the purposes of estimating costs, Offerors shall assume that, at a minimum, reports will be produced for the Final Implementation/Process Study Findings, the Final 15-month Follow-up Study Findings, and that ten (10) grantees will be eligible to measure site-specific impact findings.

Optional Services Components 5, 6:

- Task 1 (Ongoing Support for Evaluation Sites): While the range of supplemental payments that would be needed to support the goals and objectives of the evaluation to have strong tests that are well managed and to obtain all information and data required for the evaluation is expected to vary, for cost purposes, Offerors shall assume total payments of $1,000,000 per fiscal year for one year to be shared across all sites (assume approximately 35 HPOG grantees) for this task. To the extent possible and reasonable, payments may be reduced over time if the evaluation burden is reduced.

Key Optional Services Component 7, 8, 9, 10:

- Task 1 (Administration and Collection of Additional Survey Data): For the purposes of estimating costs, Offerors shall assume that 3,000 participants of the National Evaluation will be surveyed under this task for each optional services component.

Optional Services Component 11:

- Task 2 (Instrument Development and OMB Clearance): For the purposes of estimating costs, Offerors shall assume that the Second Follow-up Survey will take approximately one hour to administer.

- Task 3 (Administer Second Follow-up Survey): ACF does not expect it to be possible to survey the entire sample of the National Evaluation of the 2nd Generation of HPOG (assuming approximately 80,000 respondents across the treatment and control groups).

Offerors should propose their best ideas for innovative, creative, and cost-efficient methods for maximizing the information collected given finite survey resources. These ideas should include but are not limited to innovative, creative, and cost-efficient methods for tracking and locating individuals that are traditionally difficult to reach, as well as proposals for how to best use administrative data to complement survey data.

Offerors shall assume that the same respondents administered the First Follow-up Survey (through the completion of OSCs 8, 9, 10, 11, and 12) will be administered the Second Follow-up Survey under this task. Offerors shall assume that 4,000 respondents will be administered the Second Follow-up Survey under this optional services component.

- Task 3 (Administrative Data Collection): ACF expects to utilize administrative data sources to measure impacts and outcomes of the 2nd Generation of HPOG. Offerors shall assume that the entire sample of the National Evaluation (approximately 80,000 respondents) will be included in administrative data collection.

- Task 5 (Analysis): For the purposes of estimating costs, Offerors shall assume that, in addition to the National Evaluation findings, ten (10) HPOG grantees will be eligible to measure site-specific impact findings.

- Task 6 (Reporting and Dissemination): For the purposes of estimating costs, Offerors shall assume that, at a minimum, reports will be produced for the Final 36-month Follow-up Study Findings, and that ten (10) grantees will be eligible to measure site-specific impact findings.

- Task 9 (Special Topics Reports, Briefs, and Documents): Offerors shall assume that three (3) special topics reports, briefs, and documents will be developed under this task.

Optional Services Component 12, 13, 14, 15:

- Task 1 (Administration and Collection of Additional Survey Data): For the purposes of estimating costs, Offerors shall assume that 3,000 participants of the National Evaluation will be surveyed under this task for each optional services component.

Optional Services Component 16:

- Task 2 (Carry Out HPOG Cost-Benefit Study): For budgeting purposes, Offerors shall assume that the cost‐benefit analysis will be conducted across the non-tribal HPOG evaluation (assume approximately 35 grantees).

Optional Services Component 17, 18, 19, 20, 21:

- Task 1 (Special Topics Reports, Briefs, and Documents): For budgeting purposes, Offerors shall assume the four (4) special topics papers will be produced under each optional services component.

Estimated Level of Effort The Government has provided an estimated level of effort for each of the Services Components as shown below. The Government estimates the following distribution by labor category (I = Senior; II = Associate; III = Intermediate; IV = Junior; V = Editorial; and VI = Clerical/Admin).

However, Offerors are to present the labor mix they determine necessary to successfully complete the work.

Services Component 1

Category Labor Hours

I 1800

II 2400

III 3000

IV 3600

V 600

VI 800

Optional Services Component 2

Category Labor Hours

I 468

II 468

III 749

IV 1000

V 400

VI 936

Optional Services Component 3

Category Labor Hours

I 2000

II 2000

III 3000

IV 4000

V 1000

VI 3500

Optional Services Component 4

Category Labor Hours

I 4200

II 4800

III 6000

IV 6000

V 800

VI 1000

Optional Services Component 5, 6

Category Labor Hours

I 50

II 100

III 200

IV 400

V 50

VI 100

Optional Services Component 7, 8, 9, 10

Category Labor Hours

I 160

II 320

III 480

IV 480

V 0

VI 80

Optional Services Component 11

Category Labor Hours

I 3600

II 4200

III 4800

IV 6000

V 600

VI 1200

Optional Services Component 12, 13, 14, 15

Category Labor Hours

I 240

II 320

III 480

IV 480

V 0

VI 80

Optional Services Component 16

Category Labor Hours

I 640

II 1920

III 1920

IV 560

V 170

VI 560

Optional Services Component 17, 18, 19, 20, 21

Category Labor Hours

I 200

II 525

III 200

IV 270

V 80

VI 200

SECTION C – STATEMENT OF WORK (SOW)

TITLE: National and Tribal Evaluation of the 2nd Generation of the Health Profession Opportunity Grants (HPOG)

C.1 PURPOSE

Through this contract, the Office of Planning, Research and Evaluation (OPRE) in the Administration for Children and Families (ACF) plans to implement Federally-sponsored impact, outcome, and implementation studies of the second round of grants awarded under the extension of the Health Profession Opportunity Grants (HPOG) program. The goal of these studies is to rigorously evaluate approaches being used by HPOG grantees to provide Temporary Assistance for Needy Families (TANF) recipients and other low-income individuals with opportunities for education, training, and advancement that lead to jobs that pay well and address the healthcare professions’ workforce needs by focusing on sectors expected to either experience labor shortages or have high demand. While these studies will institute a new portfolio of work around the new HPOG grants, they will build on what we have learned and continue to learn from OPRE’s current career pathways portfolio (see the description of the components of this portfolio below).

C.2 BACKGROUND

Policy Background The Patient Protection and Affordable Care Act (ACA) of 20101 provided funds for demonstration projects to provide low-income individuals with opportunities for education, training, and advancement that lead to jobs that pay well and address the healthcare professions’ workforce needs by focusing on sectors expected to either experience labor shortages or have high demand. The grant program, entitled Health Profession Opportunity Grants (HPOG), is administered by the Office of Family Assistance (OFA) within the Administration for Children and Families (ACF). In 2010, OFA awarded five-year grants to 32 organizations under two Funding Opportunity Announcements (FOAs). Under the first FOA, 27 awards were made to state entities, local workforce investment boards, institutions of higher education, and community-based organizations. Under the second FOA, five awards were made to tribes, tribal organizations, or tribal colleges or universities.

The Protecting Access to Medicare Act (HR 4302) extends HPOG for one year through fiscal year (FY) 2015, which enables a new grant competition process for the program.2 Accordingly, ACF has announced a competition to award new program grants in FY 2015 for a five-year project period, with the understanding that subsequent awards in years two through five of the project will be contingent on the availability of funding.3 Work to be completed under this contract is intended to expand the career pathways evidence base and to build on what has been learned to date about how to design and implement successful career pathways programs for low-income and low-skilled individuals, and improve the outcomes of individuals who participate in these programs.

Section 2008 of the Social Security Act (42 U.S.C. 1397) as enacted by Section 5507 of the Patient Protection and

Affordable Care Act (Pub. L. 111-148).

See: https://beta.congress.gov/bill/113th-congress/house-bill/4302

See FOA HHS-2015-ACF-OFA-FX-0951 (http://www.acf.hhs.gov/grants/open/foa/index.cfm?switch=foa&fon=HHS-

2015-ACF-OFA-FX-0951) and FOA HHS-2015-ACF-OFA-FX-0952 (http://www.acf.hhs.gov/grants/open/foa/index.cfm?switch=foa&fon=HHS-2015-ACF-OFA-FY-0952).

https://beta.congress.gov/bill/113th-congress/house-bill/4302 http://www.acf.hhs.gov/grants/open/foa/index.cfm?switch=foa&fon=HHS-2015-ACF-OFA-FX-0951

Career Pathways Approach Over the past two decades, state and federal TANF policies have increasingly emphasized moving cash assistance recipients into jobs, and over this time period, large numbers of recipients have gone to work. However, many of these and other low-income workers continue to face challenges in the labor market including finding jobs that offer benefits and relatively high wages, retaining jobs once employed, and advancing to better jobs.

Education and training are critical to success in the labor market. Unfortunately, many low-income families lack the necessary training, credentials, and skills. Fifty-three percent of TANF recipients report having twelve years of formal education and only six percent of adult TANF recipients report having more than twelve years of formal education.4 Programs that serve TANF recipients and other low-income individuals may use approaches that increase education in combination with other strategies such as improving basic skills, job training, job search assistance, career pathways, incentives, or provision of supportive services that are closely linked with labor market needs.

While local economies vary, job opportunities in specific sectors are rising in many places. For example, demand is growing in the healthcare sector (the focus of HPOG). The need for healthcare workers is predicted to grow over the next several decades as the population ages, medical technology advances, and the number of persons living with chronic medical conditions increases. The U.S. Department of Health and Human Services and the U.S. Department of Labor both report that by 2050, the nation will need between 5.7 million and 6.5 million long-term care nurses, nursing aides, and home health and personal care workers to meet the needs of baby boomers. In the short term, more individuals are expected to obtain health insurance as a result of the ACA, resulting in an increased demand for care. Further, employment in health occupations that do not require a four-year degree—including nurses, psychiatric and home health aides, and health technologists and technicians—is projected to grow by 26 to 39 percent by 2020, much faster than the average rate projected across all occupations in the economy (14 percent).5

In 2014, Vice President Joseph R. Biden, Jr. led a review of federal job training programs to ensure that training programs are designed to train workers with the skills needed to perform in the positions that are available. This review resulted in the report, Ready to Work: Job-Driven Training and American Opportunity, which emphasized that training programs should be designed for jobs that actually exist. When a person completes a training program, they should have confidence a job is available that is closely aligned with the training they received. Job-driven training programs engage employers, offer work-based learning opportunities, use labor market data, measure and evaluate employment and earnings outcomes, build career pathways, provide relevant support services, and develop regional partnerships.

The programs funded by HPOG are based on a career pathways framework of postsecondary education that is designed to address the dual goals of preparing low-income populations for

U.S. Department of Health and Human Services, “Characteristics and Financial Circumstances of TANF Recipients, Fiscal Year 2012.” Available at: http://www.acf.hhs.gov/programs/ofa/resource/characteristics-and-financial-circumstances-appendix-fy2012.

Anderson, T., Loprest, P., Derrick-Mills, T., Eyster, L., Morley, E., & Werner, A. (2014). Health Profession

Opportunity Grants: Year Two Annual Report (2011–2012). OPRE Report #2014-03, Washington, DC: Office of

Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services: Abt Associates and the Urban Institute.

http://www.whitehouse.gov/sites/default/files/skills_report_072014_2.pdf http://www.whitehouse.gov/sites/default/files/skills_report_072014_2.pdf http://www.acf.hhs.gov/programs/ofa/resource/characteristics-and-financial-circumstances-appendix-fy2012 http://www.acf.hhs.gov/programs/ofa/resource/characteristics-and-financial-circumstances-appendix-fy2012 employment and meeting local labor market demand by establishing connections to local employers. The career pathways framework has emerged as a promising strategy to promote education, training, and workforce advancement among low-income or low-skilled individuals.

Career pathways programs aim to address the economy’s vital need for skilled workers while offering low-wage workers the opportunity to obtain education and training and advance into the middle class. To achieve their goals, career pathways programs offer low-skilled adults well-articulated training and employment steps targeted to locally in-demand jobs combined with promising instructional approaches and supportive services. The framework embodies several core principles. Career pathways programs provide postsecondary education and training as a series of manageable steps leading to successively higher credentials and employment opportunities in growing occupations. These programs also include contextualized basic skills instruction, academic and non-academic support services, and strategies for connecting participants with employers. Each step is designed to prepare students for the next level of employment and education, and also to provide a credential with labor market value. To effectively engage, retain, and facilitate learning for a diverse population, programs integrate screening, instruction, academic and non-academic supports, and employment experiences and opportunities.6 The current HPOG programs funded in 2010 vary in their design and implementation of these core principles. The programs have created a constellation of services and supports appropriate for the given grantee organization, its context, its objectives, and its target population.

On the same day that Vice President Biden delivered his report to President Barack Obama, the President signed into law the Workforce Innovation and Opportunity Act (WIOA). WIOA reflects the strategies identified in the Job-Driven Training Report, encouraging the coordination of employment and training services provided by its core programs so that job seekers acquire skills and credentials that meet employers’ needs.

Consistent with the strategies in the Job Driven Training report and WIOA, HPOG programs provide education and training programs for professions demanded by the healthcare industry.

The Departments of Labor, Commerce, Education, and Health and Human Services recently published What Works in Job Training: A Synthesis of the Evidence, which includes information about both engaging employers and using labor market information. Engaging employers— particularly around sector specific training programs—is an important step to assist students in connecting their education to future employment opportunities. Similarly, there is evidence that providing a combination of labor market information and other career guidance can result in better persistence in training programs, higher rates of employment, and increased earnings for participants7. The HPOG programs to be funded under the extension of the HPOG program are expected to be designed in consultation with employers and aligned with labor market demand so that participants can obtain employment in the occupation they are trained for within their community, and achieve self-sufficiency through a career pathway that is expected to pay well.

Fein, D. (2012). Career Pathways as a Framework for Program Design and Evaluation: A Working Paper from the

Innovative Strategies for Increasing Self-Sufficiency (ISIS) Project. OPRE Report # 2012-30, Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services; and Werner, A., Dun Rappaport, C., Bagnell Stuart, J., & Lewis, J. (2013). Literature Review:

Career Pathways Programs, OPRE Report #2013-24, Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.

What Works in Job Training: A Synthesis of the Evidence. A joint report of the U.S. Departments of Labor, Commerce, Education, and Health and Human Services. Available at http://www.dol.gov/asp/evaluation/jdt/jdt.pdf http://www.doleta.gov/wioa/ http://www.dol.gov/asp/evaluation/jdt/jdt.pdf http://www.dol.gov/asp/evaluation/jdt/jdt.pdf

ACF views the HPOG program as a national model in implementing the strategies described in the Job-Driven Training Report and codified in WIOA, and expects future HPOG programs will continue and expand upon these strategies. HPOG programs will actively engage and coordinate with state and local agencies responsible for WIOA implementation, so that HPOG continues to learn about the effectiveness of such partnerships.

The Health Profession Opportunity Grants (HPOG) Program As described above, in 2010, ACF awarded five-year grants to 32 HPOG grantees in 23 states.

ACF distributes approximately $67 million annually to these grantees. Current HPOG grantees are post-secondary educational institutions, workforce investment boards (WIBs), state or local government agencies, and community-based organizations (CBOs). Five grantees are tribes or tribal organizations.8 Enrollments to date and HPOG grantee projections suggest that HPOG will serve more than 30,000 individuals over the five-year period of the grants (2010–2015). The current HPOG grantees are in their final year and are scheduled to conclude by the end of September 2015.

The HPOG program has dual goals: to provide TANF recipients and other low-income individuals with opportunities for education and training that lead to employment and advancement in the healthcare workforce, and to address the increasing shortfall in the supply of healthcare professionals in the face of expanding demand. HPOG grantees are required to carry out their projects in coordination with the state or tribal TANF agency, relevant local and state WIBs, and the state apprenticeship agency. Further, the demonstrations are expected to:

(1) target skills and competencies demanded by the healthcare industry; (2) support career pathways, such as an articulated career ladder; (3) result in an employer- or industry-recognized certificate or degree (which can include a license, as well as a Registered Apprenticeship certificate or degree); (4) combine supportive services with education and training services to help participants overcome barriers to employment, as necessary; and (5) provide training services at times and locations that are easily accessible to targeted populations.

The ACA mandated an evaluation of the HPOG demonstration projects that includes, “identification of successful activities for creating opportunities for developing and sustaining, particularly with respect to low-income individuals and other entry-level workers, a health professions workforce that has accessible entry points, that meets high standards for education, training, certification, and professional development, and that provides increased wages and affordable benefits, including healthcare coverage, that are responsive to the workforce’s needs.”9 To accomplish this, OPRE is using a multi-pronged evaluation strategy to assess the success of the HPOG programs funded in 2010.10 The research and evaluation activities aim to provide information on program implementation, systems change, outcomes, and impact. The current ACF career pathways portfolio includes eight related research and evaluation projects:11

Grants were awarded through two Funding Opportunity Announcements – one for TANF and low-income individuals

(see: http://www.acf.hhs.gov/grants/open/foa/view/HHS-2010-ACF-OFA-FX-0126) and one limited to Indian tribes and tribal organizations (see: http://www.acf.hhs.gov/grants/open/foa/view/HHS-2010-ACF-OFA-FY-0124).

The ACA mandates an evaluation of the demonstration projects (H.R. 3590, Title V, Subtitle F, Sec. 5507, sec.

2008, (a)(3)(B)). The Act further indicates that the evaluation will be used to inform the final report to Congress (H.R.

3590, Title V, Subtitle F, Sec. 5507, sec. 2008, (a)(3)(C)).

Information on OPRE’s evaluation portfolio of HPOG programs can be found at http://www.acf.hhs.gov/programs/opre/research/project/evaluation-portfolio-for-the-health-profession-opportunity-grants-hpog.

Abt Associates, in collaboration with the Urban Institute, is conducting the HPOG Impact, PACE, HPOG ISO, NIE, and HPOG Next Gen Design studies. Abt Associates is conducting the PACE and Intermediate Outcomes of Career Pathways Projects studies. NORC at the University of Chicago is conducting the Evaluation of Tribal HPOG, in http://www.acf.hhs.gov/grants/open/foa/view/HHS-2010-ACF-OFA-FX-0126 http://www.acf.hhs.gov/grants/open/foa/view/HHS-2010-ACF-OFA-FY-0124 http://www.acf.hhs.gov/programs/opre/research/project/evaluation-portfolio-for-the-health-profession-opportunity-grants-hpog http://www.acf.hhs.gov/programs/opre/research/project/evaluation-portfolio-for-the-health-profession-opportunity-grants-hpog

The HPOG Impact Study is using an experimental design to examine the effect of HPOG on participants’ educational and economic outcomes.12 This evaluation aims to identify which components of HPOG programs (e.g., types of support services, program structure, and training areas) contribute to participant success. For some grantees, a multi-arm experimental design is being implemented, creating a control group that does not have access to HPOG, an “HPOG services as usual” treatment group, and an “enhanced HPOG” group that receives additional supports and services. The 20 grantees that are not part of another study within OPRE’s portfolio that is collecting individual-level data are included in the HPOG Impact Study. Additionally, the HPOG Impact Study analysis will include data from the three HPOG grantees being evaluated as part of the Pathways for Advancing Careers and Education (PACE) study (described below).

The HPOG Impact Study is addressing the following research questions:

1. What impacts do the HPOG programs, as a group, have on the outcomes of participants and their families?

2. To what extent do those impacts vary across selected subpopulations?

3. Which locally adopted program components influence average impacts?

4. To what extent does participation in a particular HPOG component (or components) change the impact on trainees?

Three program enhancements were selected for the experimental test: facilitated peer support groups, emergency assistance, and non-cash incentives. Approximately half of the grantees are participating in an enhancement. All 20 grantees in this study concluded random assignment in November 2014. The total sample size is approximately 10,700 individuals. Two people were randomly assigned to the treatment group for every one assigned to the control group. The study is examining impacts at 15 months after random assignment.

Pathways for Advancing Careers and Education (PACE)13 is a ten-year random assignment evaluation of promising career pathways interventions that aim to increase employment and self-sufficiency among low-skilled, low-income individuals.14 The study includes nine programs15 (including three HPOG programs) and is designed to assess the impact of these interventions on educational attainment, employment and earnings, and other relevant outcomes.

partnership with Red Star Innovations and the National Indian Health Board. Five university research institutions are leading the University Partnership Research Grants, including the Institute for Policy Research at Northwestern University, the School of Social Work at Temple University, the Institute on Assets and Social Policy at Brandeis University, the School of Social Work at Loyola University Chicago, and North Dakota State University.

This information is included in the report, “Health Professions Opportunity Grants (HPOG) Impact Study Design Report,” available at http://www.acf.hhs.gov/programs/opre/resource/health-profession-opportunity-grants-hpog-impact-study-design-report.

Pathways for Advancing Careers and Education (PACE) was previously called “Innovative Strategies for Increasing Self-Sufficiency (ISIS)”.

This information is included in the report, “Innovative Strategies for Increasing Self-Sufficiency (ISIS) Evaluation Design Report,” an in-clearance report available to offerors upon request.

For more information about each of the PACE programs, view each site’s profile at:

http://www.acf.hhs.gov/programs/opre/research/project/innovative-strategies-for-increasing-self-sufficiency.

http://www.acf.hhs.gov/programs/opre/resource/health-profession-opportunity-grants-hpog-impact-study-design-report http://www.acf.hhs.gov/programs/opre/resource/health-profession-opportunity-grants-hpog-impact-study-design-report http://www.acf.hhs.gov/programs/opre/research/project/innovative-strategies-for-increasing-self-sufficiency

The PACE study is examining impacts at 15 months after random assignment. The study will measure differences between the treatment and control group members on main educational outcomes (i.e., persistence in education, receipt of certificates and degrees) and employment and earnings-related outcomes. Analyses will also assess whether impacts vary by subgroup, as well as examine impacts for intermediate outcomes for each program. The study will analyze and report findings for each program separately.

Additionally, the PACE study includes an implementation study that will provide a detailed description of the programs, document the experiences of participants in the career pathways programs (the treatment group), and examine how their program experiences compare to individuals who did not receive the career pathways services (the control group). A cost-benefit study will describe the tangible benefits and costs from varying perspectives (i.e., social, participant, and taxpayer).

Programs began random assignment in November 2011 and random assignment ended in all sites in spring of 2015. Total sample per site ranges from approximately 650 to over 2,500.

HPOG Implementation, Systems, and Outcomes (ISO) Evaluation Design and Performance Reporting16 has two parts. The first developed an evaluation plan for measuring the implementation, systems change, and outcomes of HPOG programs, including enrollment, program retention, training completion, job entry, employment retention and advancement, and earnings. The second built and now maintains the HPOG Performance Reporting System (PRS)17, a management information system, to track grantee progress for program management and accountability and to record participant data for use in the evaluation.

HPOG National Implementation Evaluation (NIE) is the execution of the study devised in the ISO evaluation plan (above).18 The NIE includes an in-depth examination of the HPOG grantee program design and implementation, a systems analysis of networks created by HPOG programs (e.g., among grantees, employers, and other partners), and a quantitative descriptive analysis of HPOG program outputs and outcomes. Twenty-seven grantees—excluding the five tribal organizations—are included in this analysis.

Evaluation of Tribal HPOG19 is a separate implementation and outcome evaluation of the first round of HPOG programs operated by tribes, tribal organizations, and tribal colleges. The goal of this evaluation is to provide documentation and lessons about diverse programmatic approaches to health professions training serving American Indians and Alaska Natives.