Amendment 02- 72066922Q00001-2222022.pdf

9B. DATED (SEE ITEM 11)

01/31/2022

10A. MODIFICATION OF

CONTRACT/ORDER NO.

10B. DATED (SEE ITEM 13)

(X)

1 62

6. ISSUED BY

USAID/ Liberia, American Embassy 502 Benson Street Same as item 6 Monrovia, Liberia

8. NAME AND ADDRESS OF CONTRACTOR (No., street, county, State and ZIP Code) 9A..

72066922Q00001

11. THIS ITEM ONLY APPLIES TO AMENDMENTS OF SOLICITATIONS

The above numbered solicitation is amended as set forth in Item 14. The hour and date specified for receipt of Offers is extended, is not extended.

Offers must acknowledge receipt of this amendment prior to the hour and date specified in the solicitation or as amended, by one of the following methods:

(a)By completing items 8 and 15, and returning 1 copies of the amendment; (b) By acknowledging receipt of this amendment on each copy of the offer submitted; or (c) By separate letter or telegram which includes a reference to the solicitation and amendment numbers. FAILURE OF YOUR ACKNOWLEDGMENT TO BE RECEIVED AT THE PLACE DESIGNATED FOR THE RECEIPT OF OFFERS PRIOR TO THE HOUR AND DATE SPECIFIED MAY RESULT IN REJECTION OF YOUR OFFER. If by virtue of this amendment your desire to change an offer already submitted, such change may be made by telegram or letter, provided each telegram or letter makes reference to the solicitation and this amendment, and is received prior to the opening hour and date specified.

12. ACCOUNTING AND APPROPIRATION DATA (If required)

13. THIS ITEM ONLY APPLIES TO MODIFICATION OF

CONTRACTS/ORDERS. IT MODIFIES THE

CONTRACT/ORDER NO. AS DESCRIBED IN ITEM 14.

CHECK ONE A. THIS CHANGE ORDER IS ISSUED PURSUANT TO: (Specify authority) THE CHANGES SET FORTH IN ITEM 14 ARE MADE IN THE CONTRACT ORDER

NO. IN ITEM 10A.

B. THE ABOVE NUMBERED CONTRACT/ORDER IS MODIFIED TO REFLECT THE ADMINISTRATIVE CHANGES (such as changes in paying office, appropriation date, etc. ) SET FORTH IN ITEM 14, PURSUANT TO THE AUTHORITY OF FAR 43.103(b).

C. THIS SUPPLEMENTAL AGREEMENT IS ENTERED INTO PURSUANT TO AUTHORITY OF:

D. OTHER (Specify type of modification and authority)

E. IMPORTANT: Contractor is not, is required to sign this document and return copies to the issuing office.

14. DESCRIPTION OF AMENDMENT/MODIFICATION ( Organized by UCF section headings, including solicitation/contract subject matter where feasible.)

The purpose of this amendment is to respond to questions received by the due date from potential offerors and make updates to the solicitation accordingly. The closing date and time of the solicitation remain unchanged

Except as provided herein, all terms and conditions of the document referenced in Item 9A or 10A, as heretofore changed, remains unchanged and in full force and effect.

15A. NAME AND TITLE OF SIGNER (Type or print) 16A. NAME AND TITLE OF CONTRACTING OFFICER (Type or print)

Andrea M. Plucknett, Supervisory Contracting Officer

15B. CONTRACTOR/OFFEROR

(Signature of person authorized to sign)

15C. DATE SIGNED 16B. UNITED STATES OF AMERICA

(Signature of Contracting Officer)

16C. DATE SIGNED

NSN 7540-01-152-8070

Previous edition unusable

STANDARD FORM 30 (REV. 10-83)

Prescribed by GSA FAR (48 CFR) 53.243

PROJECT NO. (If applicable)

7. ADMINISTERED BY (If other than Item 6)

4. REQUISITION/PURCHASE REQ. NO.

3. EFFECTIVE DATE:

02/22/2022

PAGE OF PAGES

ANDREA MARIA PLUCKNETT

(affiliate)

Digitally signed by ANDREA MARIA PLUCKNETT (affiliate) Date: 2022.02.22 16:55:40 Z

1. It states that it is open only to local organizations in Liberia. We were wondering if IQVIA can participate as a consortium partner with a local Liberian organization or does USAID want all services to be performed by local entity?

USAID Response: The prime shall be a local organization. Consortiums with international organizations are authorized if in line with Clause H.17, Limitation on Subcontracting to Non-Local Entities, b(1) Services

(except construction): At least fifty (50) percent of the cost of contract performance incurred for personnel must be expended for employees of the prime/local entity. The solicitation is amended accordingly.

2. In Section D on “Packaging and Marking”, would we receive the USAID branding guidelines, including pictures?.

USAID Response: A branding and marking template will be provided as part of the call order. Contractors are to follow branding and marking requirements provided in the order. General Guidance for branding can be found at the Agency Website web address:

https://www.usaid.gov/sites/default/files/documents/320.pdf

3. Under Section F.5 on “Reports and Deliverables or Outputs”, for each of the data collection and verification rounds, should we plan to combine F.5.1. Component 1 - Monitoring and Counter-verification of health service delivery Milestones and F.5.2. Component 2 - Monitoring Quality of Care through Primary Data Collections for efficiency gains and effectiveness?

USAID Response: No. Contractors are expected to plan for each component separately.

4. For F.5.2. Component 2 - Monitoring Quality of Care through Primary Data Collection, should we consider FGDs in communities? Does USAID have specific guidelines to follow for FGDs?

USAID Response: As noted, Section C.4 details on the scope of qualitative assessments on the quality of care with stakeholders will be developed during the co-creation process. The details will be provided through separate call orders for each quarter.

5. Under Section L2, pt. (g) on Consortiums, it is highlighted that “Partnerships are encouraged and expected”. Can a subcontractor or a consortium partner be a non-Liberian entity?.

USAID Response: Please see response under question 1 above.

6. For M.2 TECHNICAL EVALUATION CRITERIA, can you share if there are any % or weightage for each of the M.2.1, M.2.2, and M.2.3?

USAID Response: The three factors are equally weighted.

7. In section C4 Statement of Work. “USAID expects that a team of at least two data collectors will use a maximum of four days to counter verify all outputs in each health facility”. Does health facility in this case refer to both primary and secondary facilities? And do “Outputs” refer to Service Delivery

Milestones only? For example, if the Contractor is to verify Service Delivery Milestones only at 4

Primary health facilities, and 1 Secondary health facility from Gbarpolu County. Then the total days for counter verification of service delivery milestones would be calculated as the Number of facilities selected per county x 4 days=20days.

USAID Response: Health facility mentioned there refers to both primary and secondary health facilities.

Please refer to Appendix 1 for the list of outputs. As noted, outputs include both service delivery and minor infrastructural investments mentioned as the quality improvement bonus.

The contractor is expected to recruit and train the required personnel to undertake counter verification as required. A maximum of ten days is allowed for counter verification of outputs. Thus, from the Gbarpolu

County example, the contractor is expected to recruit, train and provide logistics to at least two teams, each with at least two data collectors per health facility.

8. “It is expected that the contractor will complete field work to counter verify outputs at the health facilities in a maximum of ten working days (i.e., two weeks)”. Do health facilities in this case refer only to the selected primary health facilities and all secondary facilities within a county?

USAID Response: Yes, the list of facilities for counter verification will be provided to the offeror each quarter through separate call orders.

9. And again does “Output refer to Component 1- Monitoring and Counter-verification of health service delivery milestones only or “Output” is referring to both Component 1-service delivery, and Component

2-monitoring quality of care and Component 3- Evaluation and Learning Service.

USAID Response: Appendix 1 provides a list of proposed outputs to be counter verified.

10. On Logistical Arrangements: Who is responsible to procure major logistical assets such as vehicles, bikes, smartphones and computers? Should we cost them in our financial proposal?

USAID Response: The contractor will be responsible for providing all the logistics needed for performance of the effort. All the costs pertaining to performance should be captured in the proposed fully loaded rates except travel that will be negotiated as a separate Firm Fixed Price line Item as per Clause B.6 - Travel of the BPA solicitation.

11. Regarding the captioned solicitation, we which clarification regarding the following matter about B.5 (a)

Burdened Ceiling Daily Rates (CDR):

Kindly clarify the difference between hourly rates and daily loaded rates. Are daily loaded rates simply hourly rates times the number of working hours?

USAID Response: As stated above, the loaded rate captures all costs (direct or indirect) related to performance. It could include salary rate, benefits or other allowances, overhead rate / costs associated with the effort etc…. Offerors are requested to use the budget narrative to provide details of what is included in their proposed rates as well as any justification information. The solicitation is amended accordingly.

Issuance Date: January 31, 2022 Clarification/Questions Due Date: February 11, 2022 Clarification/Questions Due time:

5:00 GMT Closing Date: February 28, 2022

Closing Time: 5:00 pm Liberia Time (GMT)

Subject: Blanket Purchase Agreement (BPA) for the Counter Verification and Quality Assessment of Liberia’s Health Service Delivery System

(CVQAL)

Solicitation Number: 72066922Q00001

Dear Potential Offeror, The United States Government represented by the United States Agency for International Development (USAID) Mission in Liberia is seeking proposals for the Counter Verification and Quality Assessment of Liberia’s Health Service Delivery System activity as described in the attached Request for Quotation (RFQ). USAID anticipates the award multiple awards for a performance period of three (3) year base and two (2) one (1) year option periods.

This will be a Blanket Purchase Agreement (BPA) set aside to local organizations in Liberia.

BPA-Ordering procedures will be in accordance with Section F, Ordering procedures.

Section C of this solicitation sets the activities required to be implemented. USAID estimates that the ordering ceiling for BPA’s resulting from this RFQ will be approximately $5,000,000 over the 5- year (Base and options) ordering period. The ceiling is a current estimate and may be exceeded. This ceiling is not being subdivided among the number of awardees nor is it being multiplied by the number of awardees. There is no guarantee on the number of BPA-Call Orders that the successful contractors will receive.

Section L sets forth instructions for the preparation and submission of the proposal and specifies the required contents of the proposal. Please submit your proposal in accordance with the requirements in Sections C and L of this Solicitation. Section M States the criteria by which the proposal will be evaluated, and the award will be made. Please refer to Section L for information regarding proposal requirements. Offerors should take into account the expected delivery time required by the proposal transmission method they choose, and they are responsible for ensuring proposals are received at USAID by the due date and time as specified in Section L. Failure to comply with the submission date will deem any submission unacceptable and it will not be reviewed or evaluated. Faxed proposals are not acceptable, nor will they be reviewed or evaluated.

Section L of the RFQ sets forth all instructions for the preparation and submission of required proposal contents, including critical dates/times for the submission of questions, and the proposal submission closing date and time. Section M states the criteria by which proposals will be evaluated. Oral explanations or instructions given before award of the BPA will not be binding.

This is a limited competition, limited to local entities/local Liberian firms and organizations as defined in Section 7077 of Public Law 112-74, the Consolidated Appropriation Act, 2012 (P.L. 112-74), as amended by Section 7028 of the Consolidated appropriations Act, 2014 (P.L.

113-76). Consortiums with international organizations are authorized if in line with Clause H.17. Only Liberian firms or organization will be considered for award. For the purpose of this solicitation, local entities include an individual, corporation, commercial organization and nonprofit organization that:

1. Is legally organized under the laws of Liberia

2. Has as its principal place of business or operations in Liberia;

3. Is majority owned by individuals who are citizens or lawful permanent residents of Liberia; and

4. Is managed by a governing body the majority of who are citizens or lawful permanent residents of Liberia

This RFQ in no way obligates USAID to award a contract nor does it commit USAID to pay any cost incurred in the preparation and submission of a proposal. Award of a Contract under this RFQ is subject to availability of funds and other internal USAID approvals.

This RFQ can be viewed and downloaded from https://sam.gov/content/home. USAID bears no responsibility for data errors resulting from transmission or conversion processes.

Further, be aware that amendments to solicitations are occasionally issued and will be posted on the same website from which you downloaded the solicitation. USAID advises to regularly check the above website for amendments.

Questions and comments related to this RFP must be in writing only and submitted electronically no later than the questions due date/time stated above to Edward Lamin, Contracting Specialist at elamin@usaid.gov with a copy to Rukmal S. Perera, Contracting Officer at rperera@usaid.gov. No questions will be accepted after the stated date.

New to USAID? Specific instructions to receive U.S. Federal Government funding:

The Contracting Officer highly recommends to all new offerors willing to work with USAID to follow the link at Workwithusaid.org to learn more about working with USAID, specifically regarding registration in System for Award Management (SAM.gov).

Sincerely, Rukmal Srikantha Perera (affiliate)

Rukmal S. Perera Contracting Officer

Digitally signed by Rukmal Srikantha Perera

(affiliate)

Date: 2022.01.31 15:39:38 Z

Office of Acquisition and Assistance (OAA) USAID/Liberia

4. TYPE OF SOLICITATION

RATING 1. THIS CONTRACT IS A RATED

ORDER UNDER DPAS (15 CFR 700)

PAGE OF PAGES

SOLICITATION, OFFER AND AWARD

5. DATE ISSUED

2. CONTRACT NUMBER

6. REQUISITION/PURCHASE NUMBER

REQ-669-22-000016

7. ISSUED BY CODE

00000

8. ADDRESS OFFER TO (If other than Item 7)

NOTE: In sealed bid solicitations "offer" and "offeror" mean "bid" and "bidder".

SOLICITATION

9. Sealed offers in original and copies for furnishing the supplies or services in the Schedule will be received at the place specified in Item 8, or if hand carried, in the depository located in until 1400 D local time

(Hour)

02/28/2022 (Date)

CAUTION: LATE Submissions, Modifications, and Withdrawals: See Section L, Provision No. 52.214-7 or 52.215-

1. All offers are subject to all terms and conditions contained in this solicitation.

10. FOR

INFORMATION

CALL:

A. NAME

Rukmal Perera

B. TELEPHONE (NO COLLECT CALLS) C. E-MAIL ADDRESS

rperera@usaid.gov AREA CODE

NUMBER

490-1042

EXT.

11. TABLE

OF

CONTE

NTS

(X) SEC. DESCRIPTION PAGE(S) (X) SEC. DESCRIPTION PAGE(S)

PART I - THE SCHEDULE PART II - CONTRACT CLAUSES

A SOLICITATION/CONTRACT FORM

I CONTRACT CLAUSES

B SUPPLIES OR SERVICES AND PRICES/COSTS

PART III - LIST OF DOCUMENTS, EXHIBITS AND OTHER ATTACH.

C DESCRIPTION/SPECS./WORK STATEMENT

J LIST OF ATTACHMENTS

D PACKAGING AND MARKING

PART IV - REPRESENTATIONS AND INSTRUCTIONS

E INSPECTION AND ACCEPTANCE

K REPRESENTATIONS, CERTIFICATIONS AND

OTHER STATEMENTS OF OFFERORS

F DELIVERIES OR PERFORMANCE

G CONTRACT ADMINISTRATION DATA

L INSTRS., CONDS., AND NOTICES TO OFFERORS

H SPECIAL CONTRACT REQUIREMENTS

M EVALUATION FACTORS FOR AWARD

OFFER (Must be fully completed by offeror)

NOTE: Item 12 does not apply if the solicitation includes the provisions at 52.214-16, Minimum Bid Acceptance

Period.

12. In compliance with the above, the undersigned agrees, if this offer is accepted within 0 calendar days (60 calendar days unless a different period is inserted by the offeror) from the date for receipt of offers specified above, to furnish any or all items upon which prices are offered at the price set opposite each item, delivered at the designated point(s), within the time specified in the schedule.

A W A R

STANDARD FORM 33 (Rev. 9-97)

Prescribed by GSA - FAR (48 CFR) 53.214(c)

19. ACCEPTED AS TO ITEMS

NUMBERED

22. AUTHORITY FOR USING OTHER THAN FULL AND

COMPETITION:

10 U.S.C. 2304 (c) (

24. ADMINISTERED BY (If other than Item

26. NAME OF CONTRACTING OFFICER (Type or print)

13. DISCOUNT FOR PROMPT PAYMENT

(See Section I, Clause No. 52.232.8)

10 CALENDAR DAYS (%) 20 CALENDAR DAYS (%) 30 CALENDAR DAYS (%) CALENDAR DAYS (%)

14. ACKNOWLEDGEMENT OF AMENDMENTS

(The offeror acknowledges receipt of amendments to the SOLICITATION for offerors and related documents numbered and dated):

AMENDMENT NO. DATE AMENDMENT NO. DATE

15A. NAME

AND

ADDRESS

OF

OFFEROR

CODE

FACILITY

16. NAME AND TITLE OF PERSON AUTHORIZED TO SIGN OFFER

(Type or print)

15B. TELEPHONE NUMBER 15C. CHECK IF REMITTANCE ADDRESS

IS DIFFERENT FROM ABOVE - ENTER

SUCH ADDRESS IN SCHEDULE.

17. SIGNATURE 18. OFFER DATE

AREA CODE NUMBER EXT.

SECTION B

PART I - THE SCHEDULE

SECTION B - SUPPLIES OR SERVICES AND PRICE/COSTS

B.1 PURPOSE

The Counter-Verification and Quality Assessment of Liberia’s Health Service Delivery System (CVQA) under Performance Based Financing (PBF) will contribute to ensuring that USAID’s Health development objective in Liberia achieves its intended results through strong performance management service provision, in an efficient and cost-effective manner, with a focus on monitoring and counter-verification of Ministry of Health (MOH) health services and quality delivery milestones;

qualitative data collection; and monitoring, learning and adaptive management services.

B.2 AWARD TYPE AND SERVICES

This is a Blanket Purchase Agreement (BPA) type award. The Government will issue BPA- Call Orders that are Firm Fixed Price (FFP) type. The Contractor must perform the services set forth in BPA- Work Orders at prices consistent with Section B of this BPA.

B.3 ESTIMATED AWARD CEILING

This is a single or multiple award Blanket Purchase Agreement (BPA) with an estimated overall ceiling price of $5,000,000 for CQVA. The ceiling is a current estimate and may not be exceeded. This ceiling is not being subdivided among the number of awardees nor is it being multiplied by the number of awardees.

B.4 AWARD LINE ITEMS (CLINs):

Firm Fixed Price (FFP) Items for Base and all Option Years:

Verification and Quality Assessment of Liberia’s Health vice Delivery System

CLIN Title Price

Component 1 - Monitoring and Counter-verification of health service delivery milestones

$5,000,000.00

Component 2 - Monitoring Quality of Care through Primary Data

Collection

Component 3 - Evaluation and Learning Services

Component 4 - Reports, Presentations and Reporting

Total $5,000,000.00

B.5 LABOR

The Contracting Officer has determined that a key (full-time) technical manager is not necessary or required to administer the basic BPA. Contractors will not be authorized to bill USAID directly for BPA management costs under this BPA or under BPA-Work orders.

B.5 (a) Burdened Ceiling Daily Rates (CDR)

(1) The BPA-Call Order rates must not exceed the ceiling daily rates set forth in the table below.

(2) The CDRs set forth below are fixed for the BPA period and is for a productive eight (8) hour day, and apply to all subcontractors set forth in clause 52.244-2 in Section I. If a new subcontractor is proposed for a specific BPA-Call order on other than a fixed-price basis, the CDRs set forth below will apply, and the subcontract is subject to consent by the BPA-Call Order CO in accordance with FAR Part 44.

Base Period Year 1:

Labor Category Unit Hourly Rate Loaded Daily Rate

USD

Project Director Hour

Head of Finance and administration Hour

Head of Research, Monitoring, Evaluation and Learning Hour

Quality of Care Specialist Hour

Field Coordinator Hour

Data Collectors - category 1 Hour

Data Collectors - category 2 Hour

Data Collectors - category 3 (quality of care) Hour

Base Period Year 2:

USD

Project Director Hour

Head of Finance and administration Hour

Head of Research, Monitoring, Evaluation and Learning Hour

Quality of Care Specialist Hour

Field Coordinator Hour

Data Collectors - category 1 Hour

Base Period Year 3:

USD

Project Director Hour

Head of Finance and administration Hour

Head of Research, Monitoring, Evaluation and Learning Hour

Quality of Care Specialist Hour

Field Coordinator Hour

Data Collectors - category 1 Hour

Option Year 1:

USD

Project Director Hour

Head of Finance and administration Hour

Head of Research, Monitoring, Evaluation and Learning Hour

Quality of Care Specialist Hour

Field Coordinator Hour

Data Collectors - category 1 Hour

Option Year 2:

USD

Project Director Hour

Head of Finance and administration Hour

Head of Research, Monitoring, Evaluation and Learning Hour

Quality of Care Specialist Hour

Field Coordinator Hour

Data Collectors - category 1 Hour

[Note 1: The burdened Ceiling Daily Rates apply to any BPA-Call Orders(s) that are awarded under this BPA and are based on negotiated rates.]

[Note 2: The burdened Ceiling Daily Rates apply to all labor (the prime contractor, subcontractor and consultant salaries]

B.5 (b) Minimum Qualifications

In order to perform the statement of work set forth in Section C, the Contractor must provide personnel that meet the minimum education and experience requirements set forth in “Section C.7.1 Key Positions”.

B.6 TRAVEL

Local travel will be reimbursed under the BPA and subsequent BPA-Call Orders for each county-based Orders. Local travel will be negotiated under each Call Order and inserted to the Call Order as a FFP line item. Examples of local travel which will not be subject to reimbursement are travel to and from home of record to job sites. Personnel temporarily working at a Government site or alternative facility will consider such facility his/her normal job site.

Local travel will be negotiated and awarded on individual BPA-Call Orders. Travel will be reimbursed in accordance with Federal Travel Regulations and applicable cost principles.

[END OF SECTION B]

SECTION C - DESCRIPTION/SPECIFICATIONS/STATEMENT OF WORK

C.1 PURPOSE

The Counter-Verification and Quality Assessment of Liberia’s Health Service Delivery

System (CVQA) under Performance Based Financing (PBF) will contribute to ensuring that USAID’s Health development objective in Liberia achieves its intended results through strong performance management service provision, in an efficient and cost-effective manner, with a focus on monitoring and counter-verification of Ministry of

Health (MOH) health services and quality delivery milestones; qualitative data collection;

and monitoring, learning and adaptive management services.

C.2 BACKGROUND

Since 2013, the Ministry of Health (MOH) has implemented a Performance-Based

Financing (PBF) program to improve the quality of health services provided to the population. The PBF program has been supported by various donors including the

MOH’s Pooled Fund (which ended in 2018), the World Bank, and the United States

Agency for International Development (USAID). The MOH PBF program is being revised to build on lessons learned over the past nine years. The MOH in collaboration with donors, will from January 2022, implement the revised PBF program across the country.

The Ministry of Health is revising its strategic documents which are geared towards accelerating gains towards improving quality health care delivery as well as decreasing preventable maternal, newborn, and child deaths. One of the strategic documents to improve the quality of health services is the PBF guideline. The PBF guideline, will from January 2022, expand on the number of services under MOH PBF program, harmonize PBF implementation across all counties, promote accountability at all levels of the health system, and provide funding for service delivery in line with the Liberia Health Equity Fund.

MOH has agreed with its sub-units (central MOH offices and County Health Teams, District Health Teams, and Health Facilities) to disburse a stipulated amount to them upon accomplishment of agreed-upon milestones. Many of the milestones are the same among the MOH, USAID and other donors activities, and they will rely on a single, common verification (or counter verification) from the contractor.

Data will be collected and verified through MOH Health Management Information

Systems. On a monthly or quarterly basis (depending on the type of data), data is summarized and entered into the Ministry of Health’s Health Information System (HIS).

The HIS is a suite of different systems and applications that collects and stores data which are required for national decision making. The systems include: the Community-based Information System (CBIS) which collects and stores community level data; the

District Health Information System version 2 (DHIS2) which houses health facility data;

and the Electronic Logistics Management Information System which houses data for the supply chain. Additionally, there are reports of activities and meeting notes of the various structures established by the Government of Liberia (MOH and other government

Agencies) for the effective management and oversight of health services. These reports are submitted to the higher office in accordance with the MOH decentralized structures

– community, health facility, district health team, county health team, central MOH.

Disbursements within the health system will be made against results generated through these systems. Quality milestone reimbursement will be based on counter-verification and primary data collection by the contractor.

As with PBF programs globally, the health facilities service delivery milestones will need to be counter verified by a third-party. Additionally, the quality of services at the point of care (health facilities, providers, clients), and administration, oversight, and management from within the Health System (County Health Teams and the central

MOH divisions) will need to be assessed. In addition, this activity will support learning, adaptive management, and capacity building processes that will greatly benefit all PBF stakeholders while emphasizing strong core monitoring and evaluation capabilities.

The Counter Verification and Quality Assessment Activity is a five-year contract, with a two-year base period and three one-year option periods. It is designed to capitalize on the experience derived from past PBF projects (both USAID and non-USAID), programs, and policies in order to contribute to improvements in project or program performance and promote organizational learning. Based on significant stakeholder feedback, and a critical review of the Mission’s past and current experience, the key objective of the Activity is to provide high quality counter-verification and primary data collection as part of monitoring, evaluation, and learning support services to USAID’S PBF stakeholders and ensure the robust integration of M&E and learning to inform PBF programming and health service delivery in Liberia.

C.3 OBJECTIVES

The Activity will contribute to the U.S. Government’s Development Objective whereby the “Foundation for Growth Strengthened through a Healthy, Productive and Educated

Population” by providing high quality counter-verification and primary data collection as part of monitoring, evaluation, and learning (MEL) support services to USAID’S PBF stakeholders and ensure the robust integration of MEL to inform USAID’s management of its flagship health service delivery government-to-government (G2G) agreement as well as PBF programming and point of care service delivery in Liberia. Third party counter-verification and health system performance monitoring under PBF will enable project managers and PBF stakeholders to manage better adaptively to improve results. The data collected and analyses performed will inform learning to support integration of evidence and best practices, enabling USAID/Liberia and other stakeholders to adjust programming to better achieve desired goals and objectives. The Contractor must provide high-quality, objective, and reliable performance management support services that will allow the Mission to effectively collect performance and development related data

(particularly in environments that pose challenges to accessibility) to ensure the achievement of the Mission’s development objectives. The three key objectives of this contract are described below:

1. Monitoring and Counter-verification of health service delivery milestones:

The contractor will counter verify PBF outputs in a sample of health facilities in all counties implementing MOH’s PBF program each quarter. The number of counties implementing MOH PBF Program will increase from eleven in the first year, to thirteen in the second year, and to fifteen in the third year and beyond. The contractor must counter verify outputs within the primary and the secondary levels of the Liberian Health

Care System. Data which is collected at each level of service delivery using Ministry of

Health approved registers/ledgers must be counter verified.

The contractor must counter verify a maximum of 27 service delivery outputs in 20% of all primary health facilities in each county per quarter and 29 service delivery outputs in all secondary health facilities (i.e., hospitals) in each county per quarter. Additionally, the contractor must verify achievements in point of care improvements (versus planned) in all the selected primary and secondary health facilities per quarter. Point of care improvements (referred to as quality improvement bonus under MOH PBF program) may include but are not limited to minor renovation and infrastructural improvements at the health facility. USAID expects that a team of at least two data collectors will use a maximum of four days to counter verify all outputs in each health facility. Data collectors serving as supervisors, will supervise at least three teams during field work to ensure data integrity. It is expected that the contractor will complete field work to counter verify outputs at the health facilities in a maximum of ten working days (i.e., two weeks). The list of service delivery outputs for primary and secondary health facilities is available in Appendix 1.

The total number of health facilities in each county is available in Appendix 2. Through a co-creation process, described in Component 3, USAID will provide the contractor with the scope which will include the list of facilities selected for quarterly counter verification by the contractor. Appendix 4 provides the selected list of health facilities for the first quarter of counter verification (January to March 2022) in eleven counties - a total of 89 health facilities (69 primary health facilities and 20 secondary health facilities).

2. Monitoring Quality of Care through Primary Data Collection:

The contractor shall monitor the quality of health care services through primary data collection of satisfaction; opinions; and/or recommendations related to quality of services provided from clients, providers and other stakeholders associated with sampled primary and secondary health facilities.

The contractor must assess the quality of care, using the Ministry of Health approved checklist, in half (i.e., 50%) of the number of primary health facilities selected under

Component 1 and all secondary health facilities mentioned in Component 1. Through the co-creation process, described in Component 3, USAID will provide the contractor the list of facilities to collect data on quality of health care. The Ministry of Health quality of care checklists (for primary and secondary health facilities) is available in Appendix 3.

USAID will expect that field work to collect data on the quality of care provided by health facilities be completed in ten working days.

The contractor must also collect data on client satisfaction using MOH approved tools

(tools available in Appendix 3). On a quarterly basis, the contractor must interview a minimum of 75 (not to exceed 100 clients) and a minimum of 40 clients (not to exceed 50 clients) respectively accessing all primary health facilities and all secondary health facilities selected in Component 1. A maximum of five days is estimated to collect data on client satisfaction with the catchment communities of all selected health facilities.

The contractor must also collect qualitative data from stakeholders through focus group discussions, key informant interviews, and workshops. The scope/details of the stakeholder engagements will be developed through the co-creation process mentioned above. A maximum of five days is estimated to engage stakeholders.

3. Evaluation and Learning Services:

Prior to each quarterly data collection effort, the contractor will organize a co-creation workshop which will bring together stakeholders implementing or supporting the MOH

PBF program each quarter. The stakeholders will include USAID, the MOH, donors, USAID technical assistance partners, and other multilateral agencies providing technical support to the MOH. The workshop will be held for a maximum of two days with a virtual option for remote participation of county and other stakeholders. The major output of each quarterly co-creation workshop will be the scope of the next quarterly verification which will include: (1) the number of counties; (2) list of primary and secondary health facilities in each county; and (3) methodology to engage stakeholders to collect quality of healthcare services data.

The Contractor will be expected to provide analysis of findings and recommendations using multiple data sources through quarterly reporting which may involve primary data collection as stated above, analysis of related MOH data and counter verification and/or desk review of documents. Findings will be presented to USAID, County Health Teams and MOH technical divisions.

Additionally, the Contractor will be required to prepare (1) mid-term evaluation and (1) Final Evaluation of USAID’s G2G Partnership for Improved Health Outcomes Activity.

With approval from USAID, the contractor may hire local consultants to conduct the mid-term and final evaluation. The scope and methodology for each evaluation will be approved by USAID. Upon final clearance of the mid-term and final evaluation reports, the Contractor must submit the report to the Development Experience Clearinghouse (DEC) within 30 days.

For the G2G evaluation, the contractor, in collaboration with USAID/Liberia, must use the host government systems for data collection, but be prepared to supplement this data with additional data to be collected by the contractor. The G2G evaluation must support a close working partnership with government officials and may require specialized approaches.

C.4 STATEMENT OF WORK

The CVQA mechanism will support USAID’s Health Office management of its flagship service delivery G2G agreement with the GOL within the context of the MOH PBF program. The MOH PBF will be implemented in all 15 counties in Liberia. It is critical that the Contractor engages USAID technical staff and activity managers, as well as with

Ministry of Health central level and county administrators and other stakeholders and donors for the success of this contract. This engagement will provide an opportunity for the Contractor to develop a comprehensive understanding of challenges and opportunities in MEL across health service delivery in Liberia and foster a more collaborative working relationship with both USAID, the GOL and external partners.

The Contractor must abide by applicable USAID principles and requirements, including

USAID’s Evaluation Policy; the ADS 200 series (found at https://www.usaid.gov/who-weare/ agency-policy/series-200) (Attachment J.12); and the Mission’s performance management policies, particularly its Mission Orders on Performance Monitoring and

Evaluation. The Contractor must provide sector-specific expertise and employ the most recent and innovative techniques and approaches in quality health assessment, M&E and learning, while ensuring cost-effective provision of services.

The Contractor must provide direct services and operational support to fulfill all potential requirements for three (3) components illustrated below.

In advance of each periodic data verification data collection effort, the contractor will organize and hold a co-creation workshop with relevant stakeholders (as indicated by

USAID) to develop the scope of the work to be performed, the specific counties to be reached and the specific facilities to be visited. The contractor will use the information

(specific counties or facilities reached and scope of work for the period) to develop and present a work plan and budget for USAID approval.

1) Component 1 - Monitoring and Counter-verification of health service delivery milestones:

The contractor will counter verify PBF outputs in a sample of health facilities in all counties implementing MOH’s PBF program each quarter. The number of counties implementing MOH PBF Program will increase from eleven in the first year, to thirteen in the second year, and to fifteen in the third year and beyond. The contractor must counter verify outputs within the primary and the secondary levels of the Liberian Health

Care System. Data which is collected at each level of service delivery using Ministry of

Health approved registers/ledgers must be counter verified.

The contractor must counter verify a maximum of 27 service delivery outputs in 20% of all primary health facilities in each county per quarter and 29 service delivery outputs in all secondary health facilities (i.e., hospitals) in each county per quarter. Additionally, the contractor must verify achievements in point of care improvements (versus planned) in all the selected primary and secondary health facilities per quarter. Point of care improvements (referred to as quality improvement bonus under MOH PBF program) may include but are not limited to minor renovation and infrastructural improvements at the health facility. USAID expects that a team of at least two data collectors will use a maximum of four days to counter verify all outputs in each health facility. Data collectors serving as supervisors, will supervise at least three teams during field work to ensure data integrity. It is expected that the contractor will complete field work to counter verify outputs at the health facilities in a maximum of ten working days (i.e. two weeks). The list of service delivery outputs for primary and secondary health facilities is available in

Appendix 1.

The total number of health facilities in each county is available in Appendix 2. Through a co-creation process, described in Component 3, USAID will provide the contractor with the scope which will include the list of facilities selected for quarterly counter verification by the contractor. Appendix 4 provides the selected list of health facilities for the first quarter of counter verification (January to March 2022) in eleven counties - a total of 89 health facilities (69 primary health facilities and 20 secondary health facilities).

2) Component 2 - Monitoring Quality of Care through Primary Data Collection:

The contractor shall monitor the quality of health care services through primary data collection of satisfaction; opinions; and/or recommendations related to quality of services provided from clients, providers and other stakeholders associated with sampled primary and secondary health facilities.

The contractor must assess the quality of care, using the Ministry of Health approved checklist, in half (i.e., 50%) of the number of primary health facilities selected under

Component 1 and all secondary health facilities mentioned in Component 1. Through the co-creation process, described in Component 3, USAID will provide the contractor the list of facilities to collect data on quality of health care. The Ministry of Health quality of care checklists (for primary and secondary health facilities) is available in Appendix 3.

USAID will expect that field work to collect data on the quality of care provided by health facilities be completed in ten working days.

The contractor must also collect data on client satisfaction using MOH approved tools

(tools available in Appendix 3). On a quarterly basis, the contractor must interview a minimum of 75 (not to exceed 100 clients) and a minimum of 40 clients (not to exceed 50 clients) respectively accessing all primary health facilities and all secondary health facilities selected in Component 1. A maximum of five days is estimated to collect data on client satisfaction with the catchment communities of all selected health facilities.

The contractor must also collect qualitative data from stakeholders through focus group discussions, key informant interviews, and workshops. The scope/details of the stakeholder engagements will be developed through the co-creation process mentioned above. A maximum of five days is estimated to engage stakeholders.

3) Component 3 - Evaluation and Learning Services:

Prior to each quarterly data collection effort, the contractor will organize a co-creation workshop which will bring together stakeholders implementing or supporting the MOH

PBF program each quarter. The stakeholders will include USAID, the MOH, donors, USAID technical assistance partners, and other multilateral agencies providing technical support to the MOH. The workshop will be held for a maximum of two days with a virtual option for remote participation of county and other stakeholders. The major output of each quarterly co-creation workshop will be the scope of the next quarterly verification which will include: (1) the number of counties; (2) list of primary and secondary health facilities in each county; and (3) methodology to engage stakeholders to collect quality of healthcare services data.

The Contractor will be expected to provide analysis of findings and recommendations using multiple data sources through quarterly reporting which may involve primary data collection as stated above, analysis of related MOH data and counter verification and/or desk review of documents. Findings will be presented to USAID, County Health Teams and MOH technical divisions.

Additionally, the Contractor will be required to prepare (1) mid-term evaluation and (1)

Final Evaluation of USAID’s G2G Partnership for Improved Health Outcomes Activity.

With approval from USAID, the contractor may hire local consultants to conduct the mid-term and final evaluation. The scope and methodology for each evaluation will be approved by USAID. Upon final clearance of the mid-term and final evaluation reports, the Contractor must submit the report to the Development Experience Clearinghouse

(DEC) within 30 days.

For the G2G evaluation, the contractor, in collaboration with USAID/Liberia, must use the host government systems for data collection, but be prepared to supplement this data with additional data to be collected by the contractor. The G2G evaluation must support a close working partnership with government officials and may require specialized approaches.

4) Component 4 - Reports, Presentations, and Reporting:

The contractor must train all personnel involved in data collection (component 1-3), analysis (component 3) and reporting. The contractor must provide all logistical support

(per diem, travel, tools and equipment, etc.) for in-country teams carrying out analytical work; provide quality control for all deliverables; facilitate presentations to the Mission, and other donors and partners on the findings; and finalize assessment reports in coordination with the Health Office.

The Contractor will also be required each quarter to present findings from Components

1 and 2. Reports should present summary information from counter-verification and primary data collection with analysis and recommendations. A maximum of four presentations of these findings per quarter per year.

The Contractor must also develop dissemination materials, such as infographics of counter-verification findings and short summary briefs that incorporate visuals, organize dissemination/learning events, and propose dissemination approaches that encourage the utilization of counter-verification findings.

C.5 SPECIFIC CONSIDERATIONS

In implementing this SOW, the contractor shall take into consideration the following in the development and delivery of orders issued under this BPA.

Use of electronic systems

The Contractor shall be responsible for their established uses of electronic systems, including information and communication technology to save client (USAID) time and effort.

Methods for maintaining quality control over materials

The Contractor shall be responsible for their methods for maintaining quality control over data and reports. The Contractor shall be responsible for quality production of data and reports. Quality is defined as high degree of clarity, correctness, timeliness, accuracy, and appropriateness of produced data.

Section 508 Compliance

Contract reports, deliverable and information/intellectual products must be submitted in electronic form. Electronic documentation must comply with Section 508 of the

Rehabilitation Act of 1973.

C.6 REQUIREMENTS

The Contractor's duties primarily include, but not limited to, the four major functional objectives below:

Component 1: Monitoring and Counter-verification of health service delivery milestones

Component 2: Monitoring Quality of Care through Primary Data Collection

Component 3: Evaluation and Learning Service

Component 4: Reports, Presentations, and Reporting

The Contractor shall furnish services that include individuals having experience and expertise, both practical and conceptual, in the subject matter required by each order.

USAID will define its needs in orders, which will be managed by Contracting Officer’s

Representative (COR).

C.7 POSITIONS & STAFFING QUALIFICATIONS

The Contractor shall be responsible for ensuring qualified staff are available for performance of this BPA. The contractor must engage qualified staff with the experience and requisite qualification(s) to undertake this scope of work. All staff, listed in C.7.1 and

C.7.2, except for the field data coordinators and field data collectors, must be approved by USAID prior to the assuming duties with the contractor.

Descriptions of the Positions and Staff are found below in C.7.1 and C.7.2.

C.7.1 Positions

The Contractor shall provide the following positions for this award, as described below.

Position

Project Director

Head of Finance and Administration

Head of Research, Monitoring, Evaluation and Learning

Quality of Care Specialist

Field Coordinator

Data Collectors - category 1

Data Collectors - category 2

Data Collectors - category 3 (quality of care)

C.7.2 Key Positions and staff required qualifications

A Master’s degree in public health, epidemiology, statistics or related field with at least five years’ experience managing complex donor funded projects. Experience in research, monitoring and evaluation is desired. Experience working with government stakeholders is required.

A Bachelor’s in accounting or business administration with at least seven years of experience overseeing the finances of institutions. Experience in operations management will be an added advantage.

A Master’s degree in epidemiology, public health, statistics, monitoring and evaluation, or related fields with at least five years’ experience leading research, data visualization, monitoring and evaluation and learning projects.

A Clinical degree (medicine, nursing, physician assistant, midwifery) with five years of experience providing technical assistance to government institutions around quality of healthcare. A certificate in health care quality from a recognized institution will be an added advantage.

Field Coordinator

A Diploma in business administration, nursing, public administration, public health or related field with at least five years’ experience in project management including coordination and supervision of teams.

Data Collectors - category 1

High School Diploma with at least two years of experience collecting data, research, and monitoring and evaluation.

Data Collectors - category 2

A clinical diploma (nurse, physician assistant, midwife, etc) with three years of work experience in their respective fields in Liberia.

Data Collectors - category 3 (quality of care)

A health professional (medicine, nursing, physician assistant, midwifery, laboratory technologist) with at least four years’ experience working in Liberia. A good understanding of the MOH quality management system and tools will be an added advantage

[END OF SECTION C]

SECTION D - PACKAGING AND MARKING

D.1 AIDAR 752.7009 MARKING (JANUARY 1993)

(a) It is USAID policy that USAID-financed commodities and shipping containers, and project construction sites and other project locations be suitably marked with the USAID emblem. Shipping containers are also to be marked with the last five digits of the USAID financing document number.

As a general rule, marking is not required for raw materials shipped in bulk (such as coal, grain, etc.), or for semi-finished products which are not packaged.

(b) Specific guidance on marking requirements should be obtained prior to procurement of commodities to be shipped, and as early as possible for project construction sites and other project locations. This guidance will be provided through the cognizant technical office indicated on the cover page of this contract, or by the Mission Director in the Cooperating Country to which commodities are being shipped, or in which the project site is located.

(c) Authority to waive marking requirements is vested with the Regional Assistant

Administrators, and with Mission Directors.

(d) A copy of any specific marking instructions or waivers from marking requirements is…