AMENDED_PERFORM_SOL-391-14-000030_(05-17-14).pdf

SOLICITATION, OFFER AND AWARD 1. THIS CONTRACT IS A RATED ORDER

UNDER DPAS (15 CFR 7900)

RATING PAGE OF PAGES

2. CONTRACT NUMBER 3. SOLICITATION NUMBER 4. TYPE OF SOLICITATION 5. DATE ISSUED 6. REQUISITION/PURCHASE NUMBER

CODE7. ISSUED BY 8. ADDRESS OFFER TO (If other than item 7)

NOTE: In sealed bid solicitations "offer" and "offeror" mean "bid" and "bidder".

SOLICITATION

9. Sealed offers in original and copies for furnishings the supplies or services in the Schedule will be received at the place specified in item 8, or if hand carried, in the depository located in until local time

CAUTION - LATE Submissions, Modifications, and Withdrawals: See Section L, Provision No. 52.214-7 or 52.215-1. All offers are subject to all terms and conditions contained in this solicitation.

10. FOR

INFORMATION

CALL:

A. NAME B. TELEPHONE (NO COLLECT CALLS)

AREA CODE NUMBER EXT.

C. E-MAIL ADDRESS

11. TABLE OF CONTENTS

(X) SEC. DESCRIPTION PAGE(S) (X) SEC. PAGE(S)DESCRIPTION

A B C D E F G H

I

J

K

L

M EVALUATION FACTORS FOR AWARD

INSTRS., CONDS., AND NOTICES TO OFFERORS

REPRESENTATIONS, CERTIFICATIONS AND OTHER

STATEMENTS OF OFFERORS

PART IV - REPRESENTATIONS AND INSTRUCTIONS

LIST OF ATTACHMENTS

PART III - LIST OF DOCUMENTS, EXHIBITS AND OTHER ATTACH.

CONTRACT CLAUSESSOLICITATION/CONTRACT FORM

SUPPLIES OR SERVICES AND PRICES/COSTS

DESCRIPTION/SPECS./WORK STATEMENT

PACKAGING AND MARKING

INSPECTION AND ACCEPTANCE

DELIVERIES OR PERFORMANCE

CONTRACT ADMINISTRATION DATA

SPECIAL CONTRACT REQUIREMENTS

NOTE: Item 12 does not apply if the solicitation includes the provisions at 52.214-16, Minimum Bid Acceptance Period.

OFFER (Must be fully completed by offeror)

12. In compliance with the above, the undersigned agrees, if this offer is accepted within calendar days (60 calendar days unless a different period is inserted by the offeror) from the date for receipt of offers specified above, to furnish any or all items upon which prices are offered at the set opposite each item, delivered at the designated point(s), within the time specified in the schedule.

13. DISCOUNT FOR PROMPT PAYMENT

(See Section I, Clause No. 52.232-8)

14. ACKNOWLEDGMENT OF AMENDMENTS

(The offeror acknowledges receipt of amendments to the SOLICITATION for offerors and related documents numbered and dated):

10 CALENDAR DAYS (%) 20 CALENDAR DAYS (%) 30 CALENDAR DAYS (%) CALENDAR DAYS(%)

DATEAMENDMENT NO.AMENDMENT NO. DATE

15A. NAME AND

ADDRESS

OF OFFER-

OR

CODE FACILITY 16. NAME AND THE TITLE OF PERSON AUTHORIZED TO SIGN OFFER

(Type or print)

15B. TELEPHONE NUMBER

AREA CODE NUMBER EXT.

15C. CHECK IF REMITTANCE ADDRESS IS

DIFFERENT FROM ABOVE - ENTER SUCH

ADDRESS IN SCHEDULE.

17. SIGNATURE 18. OFFER DATE

AWARD (To be completed by Government)

19. ACCEPTED AS TO ITEMS 20. AMOUNT 21. ACCOUNTING AND APPROPRIATION

22. AUTHORITY FOR USING OTHER THAN FULL OPEN COMPETITION:

10 U.S.C. 2304 (c) 41 U.S.C. 253 (c)

24. ADMINISTERED BY (If other than Item 7)

26. NAME OF CONTRACTING OFFICER (Type or print)

IMPORTANT - Award will be made on this Form, or on Standard Form 26, or by other authorized official written notice.

AUTHORIZED FOR LOCAL REPRODUCTION

Previous edition is unusable

23. SUBMIT INVOICES TO ADDRESS SHOWN IN

(4 copies unless otherwise specified)

25. PAYMENT WILL BE MADE BY

27. UNITED STATES OF AMERICA

(Signature of Contracting Officer)

28. AWARD DATE

CODE

ITEM

STANDARD FORM 33 (REV,. 9-97)

Prescribed by GSA - Far (48 CFR) 53.214 (c)

SEALED BID (IFB)

NEGOTIATED (RFP)

(Hour) (Date)

PART I - THE SCHEDULE PART II - CONTRACT CLAUSES

N/A 01 135

REQ-391-14-000067

See Item 7 USAID/Pakistan, Office of Acquisition and Assistance (OAA), US

Embassy, Diplomatic Enclave, Ramna 5, Islamabad 44000 Pakistan.

SOL-391-14-000030

TBD

Muhammad Yasser myasser@usaid.gov

49 128

TBD

92 51 2081275

See Cover Page

REQUES T FOR PROPOSAL NO. 391-14-000030

Performance Management Support Contract—PERFORM

TABLE OF CONTENTS

SECTION B—SUPPLIES OR SERVICES AND PRICES/COSTS

B.1 Purpose

B.2 Contract Type B.3 Total Estimated Cost and Obligated Amount

B.4 Budget B.5 Indirect Costs

B.6 Reimbursable Costs B.7 Payment of Fixed Fee

B.8 Multi-Year Contract

SECTION C—STATEMENT OF WORK

C.1 Introduction and Objective

C.2 Statement of Work C.3 Contractor Coordination with PERFORM COR

C.4 Gender Considerations C.5 Electronic Payments

C.6 Estimated Anticipated Deliverables C.7 Outputs and Outcomes: Contract Performance Indicators and Targets

C.8 Key Personnel

SECTION D—PACKAGING AND MARKING

D.1 AIDAR 752.7009 Marking (JAN 1993) D.2 Branding

D.3 Branding Implementation and Marking Plan

SECTION E—INSPECTION AND ACCEPTANCE

E.1 Notice Listing Contract Clauses Incorporated by Reference E.2 Inspection and Acceptance

E.3 Performance Standards

SECTION F—DELIVERIES OR PERFORMANCE

F.1 Notice Listing Contract Clauses Incorporated by Reference

F.2 Period of Performance F.3 Place of Performance

F.4 Key Personnel F.5 Personnel

F.6 Authorized Work Day/Week F.7 AIDAR 752.242-70, Periodic Progress Reports (OCT 2007)

F.8 Reports

F.9 Estimated Anticipated Deliverables

SECTION G—CONTRACT ADMINISTRATION DATA

G.1 Administrative Contracting Office

G.2 Contracting Officer’s Authority G.3 Contracting Officer’s Representative

G.4 Technical Direction G.5 Acceptance and Approval

G.6 Paying Office G.7 AIDAR 752.7003 Documentation of Payment (Nov 1998)

G.8 Invoicing Instructions G.9 Accounting and Appropriation Data

G.10 Contractor’s Primary Point of Contact

SECTION H—SPECIAL CONTRACT REQUIREMENTS

H.1 Notice Listing Contract Clauses Incorporated by Reference H.2 AIDAR 752.7027 Personnel (DEC 1990)

H.3 Language Requirements

H.4 AIDAR 752.7004 Emergency Locator Information (JUL 1997) H.5 Authorized Geographic Code

H.6 AIDAR 752.225-70 Source and Nationality Requirements (FEB 2012) (Class Deviation No.

OAA-DEV-12-01c)

H.7 AIDAR 752.228-3 Worker’s Compensation Insurance (Defense Base Act)

H.8 Defense Base Act Insurance and Services H.9 AIDAR 752.228-70 Medical Evacuation (MEDEVAC) Services (JULY 2007)

H.10 ADS 302.3.5.13(a) USAID Disability Policy—Acquisition (DEC 2004) H.11 ADS 302.3.5.5 Reporting of Foreign Taxes (JULY 2007)

H.12 AIDAR 752.7007 Personnel Compensation (JULY 2007) H.13 Additional Requirements for Personnel Compensation

H.14 AIDAR 752.231-7 Salary Supplements for Host Government Employees (OCT 1998) H.15 International Travel Approval and Notification Requirements

H.16 AIDAR 722.170 Employment of Third Country Nationals (TCNs) and Cooperating Country Nationals (CCNs) H.17 Nonexpendable Property Purchases

H.18 Information Technology Resources H.19 Management of Information Technology Resources

H.20 ADS 302.3.5.13 Access to USAID Facilities and USAID’s Information Systems (August 2013)

H.21 Government Furnished Facilities or Property

H.22 Logistic Support

H.23 AIDAR 752.7013 Contractor-Mission Relationships (OCT 1989) H.24 Disclosure of Information

H.25 Organizational Conflicts of Interest H.26 Organizational Conflicts of Interest Discovered After Award

H.27 Organizational Conflicts of Interest: Preclusion from Furnishing Certain Services and Restrictions on Use of Information H.28 Executive Order on Terrorism Financing

H.29 Homeland Security Presidential Directive -12 (HSPD-12) (SEP 2006) H.30 Prohibition on the Promotion or Advocacy of the Legalization or Practice of Prostitution or Sex Trafficking (Acquisition) (April 2010)

H.31 Foreign Government Delegations to International Conferences H.32 Environmental Compliance

H.33 Consent to Subcontract H.34 Nondiscrimination (June 2012)

H.35 Security Conditions H.36 Ammonium Nitrate and Calcium Ammonium Nitrate Restriction (Sep 2011) (Class Deviation OAA-DEV-11-03c, expiration date, September 8, 2016)

H.37 USAID-Financed Third-Party Websites (August 2013) H.38 Conference Planning and Required Approvals (August 2013)

H.39 American Citizens Services Registration H.40 Anti-Fraud Hotline

H.41 Electronic Payment H.42 Standards of Conduct—Improper Business Practices

H.43 Prohibition of Assistance to Drug Traffickers H.44 Preclusion from USAID/Pakistan Awards During Period of Performance

SECTION I—CONTRACT CLAUSES

I.1 Notice Listing Contract Clauses Incorporated by Reference

I.2 52.203-13 Contractor Code of Business Ethics and Conduct (APR 2010) I.3 52.209-7 Information Regarding Responsibility Matters (JUL 2013)

I.4 52.209-9 Updates of Publicly Available Information Regarding Responsibility Matters (JUL 2013) 82 I.5 52.215-23 Limitations on Pass-Through Charges (OCT 2009)

I.6 52.216-8 Fixed Fee (JUN 2011) I.7 52.222-50 Combatting Trafficking in Persons (FEB 2009)

I.8 752.219 - 8 Utilization of Small Business Concerns and Small Disadvantaged Business Concerns I.9 752.219-70 USAID Mentor-Protégé Program (JUL 2007)

I.10 AIDAR 752.245-70 Government Property—USAID Reporting Requirements

I.11 AIDAR 752.7101 Voluntary Population Planning Activities (JUN 2008)

SECTION J—LIST OF ATTACHMENTS

SECTION K—REPRESENTATIONS, CERTIFICATIONS, AND OTHER STATEMENTS OF

OFFERORS

K.1 Notice Listing Contract Clauses Incorporated by Reference

K.2 52.204-3 TAXPAYER IDENTIFICATION (OCT 1998)

K.3 52.204-8 Annual Representations and Certifications (JAN 2014)

K.4 52.209-5 Certification Regarding Responsibility Matters (APR 2010) K.5 52.230-1 Cost Accounting Standards Notices And Certifications (MAY 2012)

K.6 52.230-7 Proposal Disclosure—Cost Accounting Practice Changes (APR 2005) K.7 Insurance—Immunity From Tort Liability

K.8 Compliance with Veterans Employment Reporting Requirements K.9 Authorized Negotiators

K.10 Agreement On, Or Exceptions To, Terms and Conditions K.11 Signature

K.12 52.222-22 Previous Contracts and Compliance Reports (FEB 1999) K.13 Key Individual Certification Concerning Narcotics Offenses and Drug Trafficking

SECTION L—INSTRUCTIONS, CONDITIONS, AND NOTICES TO OFFERORS

L.1 52.252-1 Solicitation Provisions Incorporated by Reference (FEB 1998)

L.2 Notice Listing Contract Clauses Incorporated by Reference

L.3 52.215-1 Instructions to Offerors—Competitive Acquisition (JAN 2004) L.4 52.216-1 Type of Contract (APR 1984)

L.5 52.233-2 Service of Protest (SEP 2006) L.6 Acquisition Schedule

L.7 General Instructions to Offerors L.8 Instructions for the Preparation of the Technical Proposal

L.9 Instructions for the Preparation of the Cost Proposal L.10 Instructions for the Preparation of the Branding Implementation Plan and the Marking Plan . 126

L.11 Security Plan

SECTION M—EVALUATION FACTORS FOR AWARD

M.1 Award Without Discussions M.2 Source Selection

M.3 Determination of Competitive Range M.4 Technical Proposal Evaluation Factors

M.5 Evaluation of Cost Proposals M.6 Contracting with Small Business Concerns and Disadvantaged Enterprises

PART I—THE SCHEDULE

SECTION B—SUPPLIES OR SERVICES AND PRICES/COSTS

B.1 Purpose

The United States Agency for International Development’s (“USAID” or the “Agency”) mission to the Islamic Republic of Pakistan (“Pakistan,” and, together, “USAID/Pakistan” or the “Mission”) requires technical services to implement a performance management support contract (“PERFORM”) as described in Section C.

B.2 Contract Type

This is a Cost-Plus-Fixed-Fee Completion Contract. For the consideration set forth in the contract, the contractor for PERFORM (“Contractor”) must provide the deliverables and outputs described in Section C and Section F.

B.3 Total Estimated Cost and Obligated Amount

(a) The total estimated cost for the performance of the work required for the contract, exclusive of fixed fee, if any, is $[TBD]. The fixed fee, if any, is $[TBD]. The total estimated cost plus fixed fee, if any, is $[TBD]. USAID will not pay the Contractor any sum in excess of the total estimated cost.

(b) The total obligated amount available for reimbursement of allowable costs incurred by the

Contractor (and payment of fixed fee, if any) for performance under the contract is $[TBD]. The Contractor must not exceed the aforesaid obligated amount in accordance with Federal Acquisition Regulation (“FAR”) § 52.232.22, “Limitation of Funds.”

B.4 Budget

CLIN Description Year 1 Year 2 Year 3 Year 4 Year 5 Total 01 Component 1:

Monitoring Support

Fixed Fee (if any) $ $ $ $ $ $ 02 Component 2:

Evaluation Services

Fixed Fee (if any) $ $ $ $ $ $ 03 Component 3:

Assessment Services

Fixed Fee (if any) $ $ $ $ $ $ 04 Component 4: Learning

Support Services

Fixed Fee (if any) $ $ $ $ $ $

Total Estimated Cost Plus Fixed Fee

(a) The inclusion of any costs in the above budget does not obviate the requirement for prior approval by the Contracting Officer of cost items designated as requiring prior approval by any of the terms and conditions of this contract, including the applicable cost principles (see FAR § 52.216-7, “Allowable Cost and Payment”); nor, does it constitute a determination of allowability by the Contracting Officer of any item of cost, unless specifically stated elsewhere in this contract. Also, the Contractor must not adjust these amounts without a written modification signed by the Contracting Officer. The Contractor must not bill any amounts against this contract in excess of the amounts specified for each line item.

(b) The Contractor agrees to furnish data that the Contracting Officer may request on costs expended or accrued under this contract in support of the budget information provided herein.

(c) The Contracting Officer based the budget in Section B.4 on the Contractor’s [original proposal or the Final Cost Proposal Revision], which the Contracting Officer accepted through award of this contract.

(d) Without the prior written approval of the Contracting Officer, the Contractor must not exceed the total estimated cost set forth in the budget or the total obligated amount, whichever is less.

(e) Without the prior written approval of the Contracting Officer, the Contractor must not exceed each Contract Line Item Number (“CLIN”) total per year or shift funding between CLINs.

B.5 Indirect Costs

[To Be Determined at Award]

(a) Pending establishment of revised provisional or final indirect cost rates, USAID/Pakistan will reimburse allowable indirect costs on the basis of the following negotiated provisional or predetermined rates and the appropriate bases pursuant to the contractor’s current executed Negotiated Indirect Cost Rate Agreement (“NICRA”):

Description Rate Base Type Period % 1/ 1/ 1/

1/ Base of Application:

Type of Rate:

Period:

(b) The Contractor will make no change in its established method of classifying or allocating indirect costs without the prior written approval of the Contracting Officer.

B.6 Reimbursable Costs

(a) The U.S. dollar costs allowable will be limited to reasonable, allocable, and necessary costs determined in accordance with FAR § 52.216-7, “Allowable Cost and Payment,” FAR § 52.216- 8, “Fixed Fee,” FAR § 52.232-20, “Limitation of Cost,” and FAR § 52-232-22, “Limitation of Funds,” if applicable, and AIDAR 752.7003, “Documentation for Payment.”

B.7 Payment of Fixed Fee

(a) USAID/Pakistan will pay a proportion of the contractor’s fixed fee each month pursuant to FAR § 52.216-8, “Fixed Fee,” upon the receipt of an invoice deemed proper by the Office of Financial Management in USAID/Pakistan.

(b) In the event the Contractor does not submit the required deliverables at the conclusion of the period of performance, the Contracting Officer will adjust the fixed fee proportionately to the deliverables accepted. For example, if USAID/Pakistan accepted 85% of the deliverables, then the Contractor remains entitled to 85% of the fixed fee amount; provided, however, that the Contractor satisfactorily performs the terms of the contract.

B.8 Multi-Year Contract

USAID/Pakistan considers this contract non-severable. Therefore, as a multi-year contract as defined in FAR § 17.103, the contract remains subject to the requirements contained in FAR § 17.106. However, as a cost-reimbursement contract, USAID/Pakistan will authorize the reimbursement for all allowable costs incurred by the Contractor pursuant to FAR § 52.216-7, “Allowable Costs and Payment.” As a result, the Contractor will not incur any costs that require amortization over the contract’s period of performance in the event that the Contracting Officer cancels the contract pursuant to FAR 52.217-2. Thus, $0 will serve as the cancellation ceiling for each cancellation date. Accordingly, no requirement to include cancellation dates in the contract exists.

END OF SECTION B

SECTION C—STATEMENT OF WORK

C.1 Introduction and Objective

PERFORM will serve as a centralized management support mechanism that will support USAID/Pakistan’s mission to increase stability, democracy, and prosperity for the men and women of Pakistan through the implementation of the Mission Strategic Framework (“MSF”). See Section J.1.

PERFORM will contribute to the U.S. Government’s goal of “Developing an economically vibrant, secure, and stable Pakistan which, in turn, promotes peace and security in South Asia,” by providing oversight capability, documentation of project and implementer performance, information to help project managers improve project results through better implementation, and services that support the Mission’s learning and adapting process, enabling it to better target its programming and achieve its goal and objectives.

The Contractor will provide high-quality, reliable, and objective performance management support services that will allow the Mission to effectively collect (particularly in environments that pose challenges to accessibility) and use relevant performance and development-related data to ensure the achievement of the Mission’s development objectives as identified in the MSF.

As a result, USAID/Pakistan’s MSF and the accompanying Performance Management Plan (“PMP”) will guide the implementation of this contract as the Contractor responds to demands driven by the performance of each project and activity. See Section J.2.

C.2 Statement of Work

The Contractor’s performance of the below contract components must comply with USAID quality standards outlined in the Automated Directives System (“ADS”) Chapter 202, ADS Chapter 203, and the USAID Evaluation Policy. See Section J.3 for the USAID Evaluation Policy. In addition, the Contractor will comply with USAID/Pakistan’s performance management policies and directives upon their completion, which the Mission should complete during the first year of the contract’s period of performance.

C.2.1 Component 1: Monitoring Support

USAID/Pakistan currently monitors projects and activities through Contracting Officer’s Representatives (“COR”) for acquisition instruments and Agreement Officer’s Representatives (“AOR”) for assistance instruments currently performed in its program’s portfolio. PERFORM will provide the requisite services to support CORs, AORs, and other USAID/Pakistan staff members (together, “Technical Representatives”) in meeting these responsibilities—especially in high-threat and security restricted areas.

The satisfaction of these responsibilities requires the use of performance monitoring data to (1) identify projects with implementation challenges, improve and adapt projects and activities during implementation and (2) to inform new project designs.

Therefore, the Contractor will provide high-quality, timely, and useful performance monitoring support services for USAID/Pakistan’s development projects and activities, which will allow the effective management of these projects and activities. The Contractor will perform tasks under this contract component in accordance with the USAID/Pakistan MSF, PMP, and the individual project and activity level Monitoring and Evaluation (“M&E”) plans, which USAID/Pakistan will provide upon contract award to develop its Annual Work Plan.

As one tool of USAID’s monitoring approach, the Contractor may use subcontractors or other partners to conduct site visits to verify activities completed by an implementing partner, which must be reported to the relevant USAID/Pakistan Technical Representative. The Contractor will utilize local partners that possess experience working in the project or activity’s place of performance for some portion of the monitoring support activities.

The Contractor will utilize creative, innovative approaches to resolve the difficulties of monitoring in remote or difficult-to-reach areas. These methods must remain sensitive to the operating environment of the country and may include a variety of approaches such as: Global Positioning System (“GPS”) location-stamped photos, data from GPS tracking devices, and/or remote sensing, surveys (e.g., rapidly deployed crowd sourced/community mobilization or longer-term door-to-door household surveys), remote data collection using mobile devices (e.g., SMS, text message, or Interactive Voice Response), and/or crowdsourcing.

The Contractor will also provide monitoring support services for direct government-to-government (“G2G”) agreements which USAID/Pakistan executed with the Government of Pakistan (“GOP”). The Contractor will focus its support on strengthening and supporting the relationship between USAID and the GOP. This means that monitoring support services for G2G activities must include the appropriate GOP officials—both at the national and provincial/local levels—contributing to building and strengthening these relationships. Where government capacity and/or systems are limited, restricting the Contractor’s ability to conduct monitoring support tasks, then the Contractor will utilize alternative methods that mitigate these weaknesses. In the end, the Contractor must adapt and conform its approaches and process to the specifications within the varied host country agreements (i.e., some agreements have very specific M&E and performance management requirements and other agreements cursorily mention such.)

Specific performance monitoring support tasks will include, but are not limited to:

C.2.1.1 Site Visits and Activity Verification

The Contractor will provide regularly scheduled site visits and activity verification aligned with project and activity M&E Plans and work plans. In addition, the Contractor will provide monitoring support services for projects and activities located in environments that pose challenges to accessibility, especially in the Federally Administered Tribal Areas (“FATA”), Khyber Pakhtunkhwa (“KP,” and, together, “FATA/KP”), and some areas of Karachi. The Contractor will verify USAID contractor, recipient, and GOP partner compliance during all types of site visits. Further, the Contractor will routinely provide the USAID/Pakistan Technical Representatives with the necessary data to verify partner compliance with award requirements, including but not limited to, activities conducted under the work plan, results achieved, participant training requirements, environmental requirements or environmental plans, and marking and branding compliance. For example, the Contractor will verify activities such as commodities and equipment delivery and usage, community outreach and mobilization, capacity building, and stipend programs.

For infrastructure projects, USAID/Pakistan has executed agreements with engineering firms to conduct oversight of construction tasks. Nevertheless, the ultimate effect of those construction activities (e.g., roads, dams, power plants, schools or clinics constructed) on beneficiaries remains of interest to USAID/Pakistan for which the Contractor will support the monitoring of higher order effects of construction projects and activities.

The Contractor will document its findings through site visit reports and quarterly reports, which it will make available in electronic form through PakInfo.

C.2.1.2 Data Quality Assessments

The Contractor will support the completion of Data Quality Assessments (“DQA”), which include recommendations to ensure the soundness of data collection methods and common definitions and facilitate aggregation of data from multiple partners/sources.

USAID/Pakistan anticipates the need for annual DQAs that will contain new or updated indicators.

USAID/Pakistan also anticipates that in Years 2, 3 & 4 a batch DQA is expected to update a total of over 200 MSF indicators per Agency guidance.

C.2.2 Component 2: Evaluation Services

The Contractor will provide high-quality, timely, and useful performance and impact evaluations of USAID/Pakistan’s development projects and activities, which will allow the Mission to effectively implement these projects and activities—and plan future projects and activities—based on the results of these evaluations. High-quality performance and impact evaluations of USAID/Pakistan projects and activities will support the achievement of the results defined in the MSF.

The Contractor will use rigorous methods meeting international and USAID standards for evaluations as provided in the evaluation policy and relevant international standards. See Section J.4. This requires that the Contractor provide a full range of professional performance evaluation services that necessarily include the following:

• Design and implement independent rigorous performance evaluations for USAID/Pakistan projects and activities;

• Conduct data analysis and produce reports on evaluation findings that are clear and accessible to multiple audiences; and

• Contribute to the knowledge of USAID/Pakistan staff and stakeholders about the effectiveness of USAID investments through the dissemination of information and lessons from performance evaluations.

The Contractor’s evaluation services will assess outcomes, inform future programming, and enable the broader dissemination of knowledge in relation to the learning agenda for the MSF.

According to ADS 203 evaluation is a “the systematic collection and analysis of information about the characteristics and outcomes of programs and projects as a basis for judgments, to improve effectiveness, and/or inform decisions about current and future programming.” USAID evaluations are grouped into two categories (performance and impact evaluations). Given the nature of USAID project designs and implementation strategies, performance evaluations are the most common type of evaluation conducted;

however, USAID is now placing greater emphasis on conducting impact and program level evaluations.

When conducting performance and impact evaluations, the Contractor will use the best available methods to answer the evaluation questions, which will include using a range of quantitative and qualitative methods for data collection and analysis. The USAID/Pakistan Technical Representatives will work with the PERFORM Contractor to determine the appropriate methodology for the evaluation. Afterwards, the USAID/Pakistan Technical Representatives will review and approve the final proposed methodology.

Per USAID’s evaluation policy, USAID/Pakistan will identify opportunities to evaluate its overall programs, rather than solely focusing at the project level. Generally, the evaluations will assess the combined performance and impacts of multiple assistance projects and will adhere to the greatest extent possible to the criteria outlined for impact and performance evaluations. USAID/Pakistan expects that the Contractor’s evaluations will support the assessment of the efficacy of the entire assistance package in a particular sector.

Consistent with international evaluation best practices, the Contractor will adopt a participatory approach when conducting evaluations. Thus, the Contractor will involve USAID implementing partners and stakeholders in the design stage of relevant evaluations and in other stages, as appropriate. For all evaluations, the Contractor will provide sufficient human and technical resources for team planning meetings at the beginning of the evaluation as well as for sufficient team preparation prior to fieldwork. In particular, the Contractor will provide sufficient human and technical resources to assist USAID/Pakistan in determining the specific decisions that each evaluation will influence in its final use. The Contractor will employ methodologies that ensure systematic stakeholder input at appropriate stages of evaluation planning and implementation. This includes a review of the qualifications of the proposed field teams and the provision of methodological tools and input from requesting Mission technical staff. The Contractor will budget sufficient time for both data collection and analysis. Insufficient time and attention to data analysis and development of conclusions and recommendations will lead to poor utilization of evaluation findings. The Contractor will provide sufficient human and technical resources for drafting quality reports and presentations of conclusions and recommendations. The Contractor must have the capacity to maintain professional ethics and business code of conduct for the performance of fieldwork by consultants and standards for reports.

The Contractor’s evaluations of G2G awards may utilize specialized approaches. G2G activities require a close working partnership with government officials; therefore, evaluations of these activities must support rather than hinder this relationship. Further, the Contractor must consider the use of host government systems for data collection, but remain prepared to supplement this data if systems can yield high-quality information.

The Contractor will manage the logistics associated with executing the evaluations, including but not limited to, arranging plane, train, rental cars, visas, etc.—including field visits to remote or insecure areas.

Specific evaluation services-related tasks will include, but are not limited to:

C.2.2.1 Performance Evaluations

ADS Chapter 203 generally requires that performance evaluations focus on descriptive and normative questions: what a particular project has achieved (either at an intermediate point in execution or at the conclusion of an implementation period), how it is being implemented, how it is perceived and valued, whether expected results are occurring, and other questions that are pertinent to program design, management and operational decision making. Performance evaluations often incorporate before-after comparisons, but generally lack a rigorously defined counterfactual. The Contractor will conduct a majority of the evaluations as mid-term or final performance evaluations.

C.2.2.2 Impact Evaluations

Impact evaluations measure the change in a development outcome attributable to a defined intervention and inputs; thus, impact evaluations are based on models of cause and effect and require a credible and rigorously defined counterfactual to control for factors other than the intervention that might account for the observed change. Impact evaluations in which comparisons are made between beneficiaries that are randomly assigned to either a treatment or control groups provide the strongest evidence of a relationship between the intervention under study and the outcome measured. The Contractor will advise on the appropriateness of when or whether to conduct impact evaluations and compare the advantages of impact evaluations for different interventions.

The Contractor will design and implement impact evaluations using experimental or quasi-experimental designs. Experimental design will generate treatment and control groups by randomly allocating intervention among eligible participants. Quasi-experimental designs will generate a comparison that emulates the randomization of treatment. Examples of expected approaches include propensity score matching, difference-in-difference, and regression discontinuity. Contractor will coordinate impact evaluation planning, design, and implementation with development assistance implementers—especially incorporating planning and the collection of baseline data from the very beginning of the project design stage.

Where feasible and necessary, USAID/Pakistan will work with the Contractor to design and conduct impact evaluations across the development portfolio, utilizing the results from baseline, mid-line, and end-line data to evaluate the outcomes of USAID/Pakistan programs, projects, and activities—including the effects on beneficiaries, communities and local organizations.

C.2.3 Component 3: Assessment Services

The Contractor will provide high-quality, timely, and useful performance management assessments of USAID/Pakistan’s development program. These assessments will support the implementation of the MSF. Some assessments will directly relate to data collection on indicators (e.g., baseline, mid-line or end-line data collection) as contained in the MSF. Assessments will also include support for Mission analyses, especially for analytical frameworks that underpin cross-cutting objectives and key MSF topics, or the assumptions in project logical frameworks.

In addition, the Contractor will conduct assessments on specific sectors or selected themes. These assessments will provide information to guide new USAID/Pakistan programming or refine existing USAID/Pakistan approaches. As part of special topic assessments, the Contractor will conduct the Stability Index and Early Grade Reading Assessment (“EGRA”). See Section J. 5 and Section J.6, respectively, for previously conducted assessments.

These assessments will advance USAID/Pakistan’s learning agenda concerning effective development approaches and interventions with relevant, useful, timely, and cost effective monitoring, evaluation and analytical products. The Technical Representatives will share the learning agenda with the Contractor upon its completion. In the meantime, the MSF narrative document includes a summarized version.

C.2.3.1 Assessments

Assessment tasks will include, but are not limited to:

• Interviews or group discussions at the household or community level, especially for MSF indicators;

• Collecting and collating context or benchmark indicator data to support Mission analyses of priority MSF results or topics;

• Perform recurring assessments (e.g., Stability Index and EGRA); Knowledge, Attitudes and

Perceptions (“KAP”) assessments; gender assessments; and sectoral assessments, among others as requested by the PERFORM COR.

C.2.4 Component 4: Learning Support Services

The Contractor will provide high-quality, timely, and useful learning support services to enhance USAID/Pakistan’s learning and adapting process in the implementation of the MSF. The Contractor will support USAID/Pakistan’s learning and adapting process in the management of the MSF by focusing on the learning agenda, the analysis and use of geospatial and other data, and strengthening performance management skills through integrated capacity building. The learning support services and the provision of high-quality development-related information will support USAID/Pakistan’s evidence-based decision-making concerning its management of development programs, projects, and activities.

C.2.4.1 Learning Agenda

USAID/Pakistan’s Learning Agenda consists of a plan for applying the principles of collaborating, learning, and adapting throughout the USAID Program Cycle during MSF implementation.

USAID/Pakistan’s Learning Agenda includes three components: (1) Identification of Knowledge Sources;

(2) Assessing and Addressing Knowledge Gaps; and (3) Utilizing Knowledge to Adapt programming and implementation.

The Contractor will support USAID/Pakistan with the implementation and updating of the Learning Agenda. The Contractor will also support the implementation of cross-cutting and other tasks required to manage the MSF and its PMP. The Contractor will also support a USAID/Pakistan-led process to fine tune and operationalize the Learning Agenda, particularly with regard to stakeholder engagement, filling of knowledge gaps, and adapting programming.

USAID/Pakistan may institute an iterative process for identifying learning based on evidence and integrating and adapting to this learning with support from the Contractor. This will require an on-going collaborative process between key USAID staff and stakeholders through a process designed between the PERFORM COR and the Contractor.

Collaboratively identifying and utilizing local knowledge will fill knowledge gaps to better utilize USAID resources. The Contractor will assist USAID/Pakistan as it systematically examines indicator data, evaluation findings, and other evidence to analyze and determine how best to apply lessons learned to the design and implementation of projects and activities.

C.2.4.1.1 Learning Agenda Tasks

Learning Agenda tasks will include, but are not limited to:

• Support collaboration with implementing partners and other stakeholders to discuss findings from monitoring data, evaluations, and/or assessments; and, identify how USAID/Pakistan must accordingly adapt program implementation;

• Organize learning events and platforms as requested in support of USAID/Pakistan’s analytical processes;

• Support the determination of the best approaches to capture learning and knowledge and ways to integrate this learning into programming, monitoring, and evaluating plans, as needed;

• Support an iterative process (by Development Objective, Cross Cutting Objective, geographic focus, or key topic) by analyzing findings, identifying the best approach for applying learning, reassessing learning agenda questions, and developing a plan of action based on evidence;

• Facilitate the process for articulating lessons learned and identifying next steps;

• Identify relevant local knowledge sources and making this knowledge available in a useful form;

and,

• Document and make available in a useful form monitoring data, other analyses, evaluation reports, meeting notes and follow-up from learning engagements.

USAID/Pakistan anticipates the need for the following Learning Agenda-related tasks:

• On-going learning agenda technical assistance for two (2) Development Objective/Cross Cutting Objective teams/year – frequency and timeline for this assistance will be dictated by the needs of the learning agenda;

• Learning Agenda technical assistance for four (4) Development Objective/Cross Cutting Objective teams, one (1) time per quarter;

• Semi-annual meetings with each of the five (5) Development Objective Teams and up to three (3) other teams to address Cross Cutting Objectives, key topics, or geographical areas. Semi-annual meetings are anticipated to be in concert with the mission’s semi-annual reviews/portfolio review of the Mission Strategic Framework (anticipated to be in October and April);

• Four (4) learning events per year.

C.2.4.2 Development and Management of Data and Information Systems

The Contractor will provide and use geospatial methods and information technologies as they are particularly powerful tools for assessing programs and making evidence-based management decisions.

For example, reviewing a map that illustrates where expected irrigation channels will be constructed along with the topography and productivity classification of agricultural lands can better target development interventions. Similarly, mapping all the related interventions in a target geographic area can help identify where programming synergies may occur and help plan for an evaluation sampling plan to investigate if synergies exist.

The Contractor will work with USAID/Pakistan and implementing partners to identify opportunities for use of geospatial data and analysis. The Contractor will ensure that any technology products procured are of sufficiently high quality to complete all tasks within a reliable and timely manner as defined by a process agreed upon with the PERFORM COR. The Contractor must collaborate with USAID/Pakistan to ensure compatibility with USAID systems (e.g., PakInfo) to allow for migration to a USAID system either during the period of performance, if warranted, or as part of close out of this contract.

The Contractor will provide all maps in PDF, JPEG, or Google form as determined by the PERFORM COR in consultation with the Contractor to allow minimal effort in using them in reports or other deliverables. In addition, the Contractor will provide the maps in their original production format (e.g., ArcGIS, AutoCad, etc.). Yet, the Contractor can provide other formats on a case-by-case basis. The PERFORM COR will provide further specifications, as appropriate, but will likely include additional requirements, such as inclusion of metadata and sources.

C.2.4.2.1 Geographic Information System/ Management Information System Tasks

The types of Geographic Information System (“GIS”)/ Management Information System (“MIS”) tasks provided under PERFORM will include, but are not limited to:

• GIS/Cartographic Services: The Contractor will develop and, as requested by the PERFORM

COR, analyze maps that contain the following types of data: project performance data; activity locations; and contextual information, including topography, activity budgets/costs, sample participant locations, infrastructure, borders, and political boundaries. USAID/Pakistan may use the maps for a variety of purposes, including identifying suitability of potential new activity sites;

determining overlap and possible synergies or duplication; planning for monitoring, evaluation, or assessments; supporting learning agenda efforts; or reporting results or investments, among others. The Contractor will coordinate with existing USAID/Pakistan GIS/MIS efforts and require the use of geophysical characteristics of natural resources (e.g., chemical, biological, physical) and socio-economic characteristics related to governance and markets (e.g., sociological, cultural, political, institutional, and economic).

• MIS: The Contractor will provide supplemental MIS services that support the usage of the Mission’s data management system. USAID/Pakistan’s “PakInfo” management information system houses performance data on all MSF indicators. It is expected to also house project and activity level indicators as well as be able to track activity-level progress on work plans.

USAID/Pakistan will not store certain data in PakInfo; thus, USAID/Pakistan occasionally has the need for additional MIS support. The PERFORM COR may require the Contractor to develop a set of tools and procedures in collaboration with USAID/Pakistan to capture this data. For example, USAID developed a dashboard to share data collected from the Stability Index in an interactive manner with key USG stakeholders, which houses all the information and allows for manipulation of data to see specific pieces/disaggregation of data (e.g., number of security incidents occurring in a particular district during a particular time period). The Contractor will need to update and manage this dashboard as additional rounds of data collection occur for the Stability Index. Similarly, the PERFORM COR may require other creative displays of information. As a result, the Contractor will establish standard templates and data transfer procedures whereby USAID/Pakistan contractors and recipients will define methods of storing and verifying data not stored in PakInfo. Prior to development of any such new system, the Contractor will develop a sustainability plan that the PERFORM COR will approve. Similarly, the Contractor will develop a sustainability plan for the future of the Stability Index dashboard.

Illustrative GIS/MIS tasks include, but are not limited to:

• Display in a variety of formats as dictated by USAID and analyze meteorological, hydrological, physical, political, and socioeconomic information pertinent to the Mission Strategic Framework and USAID/Pakistan portfolio;

• Create custom map products for a variety of audiences that are both visually appealing and in compliance with industry standards;

• Work with development partners and USAID/Pakistan staff to acquire a collection of thematic layers and imagery to be used in conjunction with project location data;

• Develop a system that houses and displays geospatial base data for viewing by all staff, the system may be temporarily housed on the Contractor’s system until migrated to USAID;

• Develop a protocol to de-conflict data collection across the Mission; and

• Maintain and update the Stability Index dashboard.

USAID/Pakistan anticipates the need for the following:

• 130 maps developed per year, dependent upon the complexity of the final products (this includes maps requested by the Mission as well as those needed for task implementation and reporting);

• 1 GIS base-data system and ongoing maintenance with updates every 6 months, as needed;

• Stability Index dashboard maintenance and updates – in conjunction with data collection, monthly for some data and two times per year for survey data;

• Up to 2 database systems per year, to be built around specific tasks, and only if the data does not fit into pre-existing systems, namely PakInfo.

C.2.4.3 Integrated Capacity Building for Performance Management

USAID has introduced a number of new policy initiatives and reforms in recent years which have increased a focus on improved monitoring, evaluation, and learning practices. These policy changes have resulted in an increased need for performance management skills among staff and partners, and the capacity of USAID/Pakistan staff and its partners have not kept pace. .

The Contractor will formulate an integrated approach to capacity building to achieve PERFORM’s overall goal and successfully accomplish the tasks. While other USAID/Pakistan contracts and agreements provide general and M&E capacity building to local partners, the training and capacity building under this contract will add value and support other efforts by focusing on the MSF and the

PMP.

The Contractor’s integrated capacity building effort will ensure the provision of quality, comparable data as well as increased analysis and use of related performance management data and information.

Throughout the performance of PERFORM, the Contractor will have potential opportunities to increase the technical skills of relevant USAID/Pakistan staff, implementing partners and their sub-partners, with emphasis on Pakistani nationals. The Contractor will include its partners and sub-partners in this capacity building component.

The Contractor will consider capacity building in this context as an intentional process used to increase an individual’s motivation, knowledge, and skills necessary to enhance an organization’s ability to conduct performance management and/or use performance management tools. The Contractor will work with the PERFORM COR to define a clear approach to integrated capacity building, requiring an intentional and individually-tailored methodology.

This approach must expand skills and experience to conduct high-quality performance management work increasingly independent, and be adaptable to tailor services to meet the unique needs of each group trained. Moreover, the approach will have a particular emphasis on M&E planning and data analysis because these two areas are the weakest for USAID/Pakistan’s partners (while their strengths tend to be in data collection and other fieldwork). Delivery methods may include, but are not limited to, face-to-face training or technical assistance sessions, targeted workshops, distance learning, CD or web-based instruction, and print and web materials.

C.2.4.3.1 Integrated Capacity Building for Performance Management Tasks

Monitoring and evaluation of development assistance requires critical skill sets both within USAID to manage programs and implementing partners to ensure delivery. The Contractor will assist USAID’s Performance Management Unit (“PMU”) to bolster USAID’s internal capacity, and designated implementing partners’ capacity by delivering capacity building services where critical weaknesses are identified. Topics/areas for capacity building are expected to include the following:

• Preparing for and managing evaluations;

• Select appropriate evaluation approaches and methods;

• Track evaluation recommendations;

• Develop and select indicators, assuring data quality, tracking and aggregating data across multiple sources, data analysis and dissemination of findings;

• Define and collect output and outcome indicators for higher or intermediate level results of the

MSF;

• Link budgets and results data;

• Provide performance management in new project or activity design;

• Develop scopes of work for performance management tasks and evaluations and assessments;

• Develop PMPs and project or activity level M&E plans (formerly called PMPs);

• Analyze and understand monitoring and other performance data;

• Perform site visits;

• Plan for, perform, and analyze data quality assessments;

• Plan for, conduct, and use monitoring and evaluation data and information (including baseline data);

• Standardize the data transfer between specific contracts/activities and the Mission-level performance management system;

• Develop performance management database systems to systematically collect, analyze and report on performance data; and

• Use of information technologies utilized by the mission for geospatial data.

As part of the capacity building work, the Contract is expected to (1) provide tailored technical assistance to USAID staff as well as USAID implementing partners or sub-partners that collect data for USAID programs; (2) produce relevant performance management technical guides, tools, and reference materials;

and (3) produce technical guides, tools, and reference materials to support implementing partners to maintain sound M&E systems at the activity level.

C.3 Contractor Coordination with PERFORM COR

The PERFORM COR will coordinate with USAID Technical Representatives and the Contractor on individual activities required by the contract. The Contractor will work closely with the PERFORM COR and the PMU on all relevant coordination issues related to implementation of activities, including capacity building. The Contractor will define a work flow process, which will be finalized with the PERFORM COR upon start up and incorporated in the Annual Work Plan.

The Contractor will coordinate with current Mission staff regarding activities that develop the capacity of relevant local Pakistani organizations, including the Mission’s Assessment and Strengthening Program (“ASP”) and the Training for Pakistan activity.