SOL-114-13-000001_Amend_01.pdf

AMENDMENT OF SOLICITATION/MODIFICATION OF CONTRACT

2. AMENDMENTIMODIFICATION NO 3 EFFECTIVE DATE

000001

6 ISSUED BY CODE

8. NAME AND ADDRESS OF CONTRACTOR (No .. street. county. State and ZIP Code)

CODE FACILITY CODE

1. CONTRACT 10 CODE

4. REQUISITIONIFURCHASE REQ NO

7. ADMINISTERED BY (If other than Item 6)

(x) 9A AMENDMENT OF SOLICITATION NO

30L-114-13-000001

X 9B. DATED (SEE ITEM 11)

11/01/2012 lOA MODIFICATION OF CONTRACTIORDER NO lOB DATED (SEE /TEM 13)

11. THIS ITEM ONLY APPLIES TO AMEND ENTS OF SOLICITATIONS

X The above numbered soliCitation is amended as set forth in Item 14 The hour and date specified for receipt of Offers X is extended, is not extended.

Offers must acknowledge receipt of this amendment prior to the hour and date specified in the solicitation or as amended. by one of the following methods: (a) By completing

Items 8 and 15. and returning 1 copies of the amendment: (b) By acknowledging receipt of this amendment on each copy of the offer submitted; or (c) By separate letter or telegram which includes a reference to the solicitation and amendment numbers. FAILURE OF YOUR ACKNOWLEDGEMENT TO BE RECEIVED AT THE PLACE DESIGNATED FOR THE RECEIPT OF OFFERS PRIOR TO THE HOUR AND DATE SPECIFIED MAY RESULT IN REJECTION OF YOUR OFFER Ifby virtue of this amendment you desire to change an offer already submitted. such change may be made by telegram or letter, provided each telegram or letter makes reference to the solicitation and this amendment and IS received prior to the opening hour and date specified.

13. THIS ITEM ONLY APPLIES TO MODIFICATION OF CONTRACTSIORDERS. IT MODIFIES THE CONTRACT/ORDER NO. AS DESCRIBED IN ITEM 14, CHECK ONE A b~18ECRH~~~~ ~~~E~O~ ISSUED PURSUANT TO: (Specify authority) THE CHANGES SET FORTH IN ITEM 14 ARE MADE IN THE CONTRACT

B. THE ABOVE NUMBERED CONTRACTIORDER IS MODIFIED TO REFLECT THE ADMINISTRATIVE CHANGES (such as changes in paying office, appropriation date. etc) SET FORTH IN ITEM 14, PURSUANT TO THE AUTHORITY OF FAR 43.103(b).

C THIS SUPPLEMENTAL AGREEMENT IS ENTERED INTO PURSUANT TO AUTHORITY OF

D. OTHER (Specify type of modification and authority)

E. IMPORTANT: Contractor is not. is required to sign this document and return copies to the issuing office, The subject RFP is amended as shown (changes noted with changed text and bars in margins) .

Questions and Answers are also provided.

3B Plan: NO

Except as provided herein, all terms and conditions of the document referenced in Item 9A or lOA, as heretofore changed, remains unchanged and in full force and effect

15A. NAME AND TITLE OF SIGNER (Type or print) 16A. NAME AND TITLE OF CONTRACTING OFFICER (Type or print)

15B. CONTRACTORIOFFEROR

(Signature of person authorized to sign)

NSN 7540-01-152-8070

Previous edition unusable

150 DATE SIGNED 160 DATE SIGNED

Issuance Date: November 1, 2012 Clarification Questions Due: November 14, 2012 – 09:00 Local Tbilisi Time Closing Date and Time: December 3, 2012 – 09:00 Local Tbilisi Time December 10, 2012 – 09: 00 Local Tbilisi Time

Subject: Mission Evaluation Mechanism

Request for Proposals (RFP) No. SOL-114-13-000001

The United States Government, represented by the U.S. Agency for International Development (USAID), is seeking proposals from qualified small business companies and organizations interested in providing the services described in the attached solicitation. USAID is contemplating award of a single-award, indefinite quantity contract (IQC) contract with a maximum ceiling of $5,000,000 and a minimum order guarantee of $200,000.

Proposals must be received electronically on or before the closing date stipulated above to provide the services and deliverables specified in the below RFP. Proposals must be sent via e-mail attachments to lmatitaishvili@usaid.gov and rcocaucasus@usaid.gov by the closing date and one hard copy to the Regional Contracting Office in Tbilisi, Georgia postmarked by the closing date and must conform to all requirements outlined in Section L. USAID reserves the right to award the contract subject to availability of funds. The period of performance is five (5) years.

Any questions regarding the RFP’s requirements must be submitted to Elizabeth Colarik via email at ecolarik@usaid.gov no later than 09:00 hours Tbilisi Time, November 14, 2012.

Price proposals will be evaluated as a part of a Best Value determination for contract award.

Sections B through J of the solicitation will become the contract, with blanks completed by the Contracting Officer based on the successful proposal. This solicitation in no way obligates USAID to award a contract, nor does it commit USAID to pay any cost incurred in the preparation and submission of the proposal.

Sincerely, /s/ Sarah R. Bueter Regional Contracting Officer USAID/Caucasus

Table of Contents

PART I – THE SCHEDULE

SECTION B - SUPPLIES OR SERVICES AND PRICES/COSTS

B.1 PURPOSE

B.2 CONTRACT TYPE

B.3 MINIMUM OBLIGATED AMOUNT

B.4 MAXIMUM CONTRACT CEILING

B.5 OBLIGATED AMOUNT/ESTIMATED COST

B.6 TASK ORDER LIMITATIONS

SECTION C - DESCRIPTION/SPECIFICATIONS/STATEMENT OF WORK

C.1 OBJECTIVE AND GENERAL DESCRIPTION OF THE CONTRACT

C.2 BACKGROUND

C.3 TECHNICAL SERVICES TO BE PROVIDED

C.4 WORK REQUIREMENTS

SECTION D - PACKAGING AND MARKING

D.1 BRANDING AND MARKING

D.2 MARKING, AIDAR 752.7009 (JAN 1993)

D.3 BRANDING STRATEGY

SECTION E – INSPECTION AND ACCEPTANCE

E.1 NOTICE LISTING CONTRACT CLAUSES INCORPORATED BY REFERENCE

E.2 INSPECTION AND ACCEPTANCE

SECTION F – DELIVERIES OR PERFORMANCE

F.1 PERIOD OF PERFORMANCE

F.2 PERFORMANCE STANDARDS

F.3 PLACE OF PERFORMANCE

F.4 KEY PERSONNEL

F.5 PERFORMANCE STANDARDS/INDICATORS

F.6 REPORTS AND DELIVERABLES

F.7 TASK ORDER ADMINISTRATION

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

F.8 RIGHT TO PROCURE FROM OTHER SOURCES

F.9 CONTENTS OF TASK ORDERS

F.10 752.242-70 PERIODIC PROGRESS REPORTS (OCT 2007)

F.11 AIDAR 752.7005 SUBMISSION REQUIREMENTS FOR DEVELOPMENT

EXPERIENCE DOCUMENTS (JAN 2004)

SECTION G - CONTRACT ADMINISTRATION DATA

G.1 CONTRACTING OFFICER’S AUTHORITY (IQC AND TASK ORDERS)

G.2 ADMINISTRATIVE CONTRACTING OFFICE

G.3 CONTRACTING OFFICER’S REPRESENTATIVE (COR)

G.4 TECHNICAL DIRECTIONS/RELATIONSHIP WITH USAID

G.5 PAYING OFFICE

G.6 PAYMENT AND INVOICING INSTRUCTIONS

G.7 CONTRACTOR’S PRIMARY POINT OF CONTACT

G.8 ACCOUNTING AND APPROPRIATION DATA

SECTION H – SPECIAL CONTRACT REQUIREMENTS

H.1 AUTHORIZED GEOGRAPHIC CODE

H.2 LANGUAGE REQUIREMENTS

H.3 LOGISTIC SUPPORT

H.4 CONSENT TO SUB-CONTRACT

H.5 INSURANCE AND SERVICES

H.6 EXECUTIVE ORDER ON TERRORISM FINANCING (FEB 2002)

H.7 REPORTING OF FOREIGN TAXES (JULY 2007)

H.8 USAID DISABILITY POLICY - ACQUISITION (DECEMBER 2004)

H.9 FOREIGN GOVERNMENT DELEGATIONS TO INTERNATIONAL

CONFERENCES

H.10 PROHIBITION AGAINST DISCRIMINATION (OCT 2011)

H.11 PERSONAL IDENTITY VERIFICATION OF CONTRACTOR PERSONNEL

(July 2007)

H.12 AIDAR 752.225-70 SOURCE AND NATIONALITY REQUIREMENTS (FEB

2012) 41

H.13 AIDAR 752.228-70 MEDICAL EVACUATION (MEDEVAC) SERVICES (JUL

2007) 42

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

H.14 AIDAR 752.7004 EMERGENCY LOCATOR INFORMATION (JUL 1997)

H.15 NONDISCRIMINATION (June 2012)

PART II – CONTRACT CLAUSES

SECTION I – CONTRACT CLAUSES

I.1 NOTICE LISTING CONTRACT CLAUSES INCORPORATED BY REFERENCE .. 45

I.2 52.216-18 ORDERING (OCT 1995)

I.3 52.216-19 ORDER LIMITATIONS (OCT 1995)

I.4 52.216-22 INDEFINITE QUANTITY (OCT 1995)

I.5 752.219-8 UTILIZATION OF SMALL BUSINESS CONCERNS AND SMALL

DISADVANTAGED BUSINESS CONCERNS

I.6 752.227-14 RIGHTS IN DATA--GENERAL (OCT 2007)

I.7 752.228-3 WORKER'S COMPENSATION INSURANCE (DEFENSE BASE ACT)

PART III – LIST OF DOCUMENTS, EXHIBITS, AND OTHER ATTACHMENTS

SECTION J – LIST OF ATTACHMENTS

PART IV – RESPRESNTATIONS AND INSTRUCTIONS

SECTION K – REPRESENTATIONS, CERTIFICATIONS, AND OTHER STATEMENTS

OF OFFERORS

K.1 NOTICE LISTING CONTRACT CLAUSES INCORPORATED BY REFERENCE . 53

K.2 52.204–8 ANNUAL REPRESENTATIONS AND CERTIFICATIONS (MAY 2012)

K.3 52.209-7 INFORMATION REGARDING RESPONSIBILITY MATTERS (FEB

2012) 59

K.4 52.209–9 UPDATES OF PUBLICLY AVAILABLE INFORMATION

REGARDING RESPONSIBILITY MATTERS (FEB 2012)

K.5 52.222-29 NOTIFICATION OF VISA DENIAL (JUNE 2003)

K.6 INSURANCE - IMMUNITY FROM TORT LIABILITY

K.7 AUTHORIZED NEGOTIATORS

K.8 SIGNATURE

SECTION L – INSTRUCTIONS, CONDITIONS, AND NOTICES TO OFFERORS

L.1 NOTICE LISTING SOLICITATION PROVISIONS INCORPORATED BY

REFERENCE

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

L.2 52.216-1 TYPE OF CONTRACT (APR 1984)

L.3 52.233-2 SERVICE OF PROTEST (SEP 2006)

L.4 52.252-1 SOLICITATION PROVISIONS INCORPORATED BY REFERENCE

(FEB 1998)

L.5 GENERAL INSTRUCTIONS TO OFFERORS

L.6 PROPOSAL SUBMISSION INFORMATION

L.7 INSTRUCTIONS FOR THE PREPARATION OF THE TECHNICAL PROPOSAL

L.8 INSTRUCTIONS FOR THE PRICE PROPOSAL (-Task Order)

SECTION M – EVALUATION FACTORS FOR AWARD

M.1 OVERVIEW

M.2 CONTRACT AWARD - BEST VALUE

M.3 TECHNICAL EVALUATION CRITERIA

M.4 EVALUATION OF PRICE PROPSAL

ATTACHMENT 1 – STATEMENT OF WORK

ATTACHMENT 2 – PAST PERFORMANCE QUESTIONNAIRE

ATTACHMENT 3 – LOGFRAME

ATTACHMENT 5 – GUIDELINES FOR PREPARING EVALUATION REPORTS

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

SOL-114-13-000001

Mission Evaluation Mechanism

PART I – THE SCHEDULE

SECTION B - SUPPLIES OR SERVICES AND PRICES/COSTS

B.1 PURPOSE

The purpose of this contract is to provide evaluation services as specified in Section C, Statement of Work, for USAID/Georgia projects. USAID Task Order Contracting Officers (TOCOs) will request the work through the issuance of task orders during the ordering period as specified in Section F of the contract

B.2 CONTRACT TYPE

This is a single-award, Indefinite Quantity Contract (IQC). USAID will issue task orders that are either Firm Fixed Price (FFP) or Cost Plus Fixed Fee (CPFF). The Government intends to make maximum use of Firm Fixed Price task orders. All cost type task orders will be completion form.

The Contractor must perform the work set forth in task orders at prices consistent with Section B of this contract.

B.3 MINIMUM OBLIGATED AMOUNT

The basic contract includes an initial obligation of funds in the amount of $200,000 to cover the minimum order guarantee. USAID is required to order and the Contractor is required to furnish the minimum order amount of services. Following this initial obligation, individual task orders will obligate funds to cover the work required under that task order.

B.4 MAXIMUM CONTRACT CEILING

The maximum amount of services, inclusive of all task orders, which can be ordered under this IQC is $5,000,000. The amount is cumulative of the price of all task orders.

B.5 OBLIGATED AMOUNT/ESTIMATED COST

The basic contract includes an initial obligation of funds in the amount of $200,000 to cover the minimum order guarantee.

The Firm Fixed Price for each Task Order will be negotiated based on the price to complete the work outlined in a Request for Task Order Proposal (RFTOP). After acceptance of a fixed price task order by the Contractor, the task order price will only be adjusted to reflect changes in scope or conditions governed by other clauses.

The Total Estimated Cost-Plus-Fixed-Fee (CPFF) for each task order must be negotiated in accordance with the terms of the IQC contract. In no event may the indirect rates or fixed fee for a task order exceed the ceilings set forth in Section B of this contract. If any cost reimbursement task orders are awarded, Ccost shall be limited to reasonable, allocable, and allowable costs determined in accordance with Federal Acquisition Regulation (FAR) 52.216-7, Allowable Cost and Payment and FAR 52.216-8, Fixed Fee.

Fixed Fee Payment: For any Cost-Plus-Fixed-Fee (CPFF) task order issued under this contract, at the time of each payment of allowable costs to the Contractor, the USAID paying office ordinarily pays the Contractor a percentage of the fixed fee that directly corresponds to the percentage of allowable costs being paid. Two exceptions to paying fixed fee in this manner apply:

(1) If the TOCO determines that this method results in paying a disproportionately higher ratio of fixed fee than the percentage of work the Contractor has completed, then the TOCO may suspend further payment of any fixed fee until the Contractor has made sufficient progress to justify further payment, up to the agreed percentage.

(2) Because the clauses entitled "Allowable Cost and Payment" (FAR 52.216-7) and "Fixed Fee" (FAR 52.216-8) are incorporated into this contract, the terms and conditions of these clauses apply after total payments of fixed fee reach eighty five percent (85%) of the total fixed fee.

B.6 TASK ORDER LIMITATIONS

B.6.A Firm-Fixed-Price (FFP) Task Orders. When issuing FFP task orders, TOCOs will state in the task order the firm-fixed-price, which represents the total amount of the task order and the maximum price the contractor may be paid to perform the services, reports, or other deliverables in the task order.

B.6.B Cost-Plus-Fixed-Fee (CPFF) Task Orders: When issuing CPFF task orders, the TOCO will state in the task order the total estimated cost plus fixed fee, which is the total amount of the task order and the maximum amount the Contractor, may be paid without advance written approval of the cognizant Contracting Officer. This maximum amount represents the prime and subcontractor professional labor salaries, an estimated number of workdays, other direct costs and fixed fee.

B.6.C Minimum Order. When USAID requires services or reports and other deliverables covered by this contract in a Task Order in the amount of less than $25,000, the Contractor is not obligated to accept an order to furnish those services or reports and other deliverables under this contract. However, if the Contractor agrees to furnish services or reports and other deliverables required by USAID in an amount of less than $25,000 and is awarded a Task Order to do so, the

Contractor is required to provide said services and reports/deliverables in accordance with the Contract's terms and conditions.

B.6.D Maximum Order. When USAID requires services or reports and other deliverables covered by this contract in a Task Order amount of more than $3,000,000 the Contractor is not obligated to accept an order to furnish those services or reports and other deliverables under this contract. However, if the Contractor agrees to furnish services or reports and other deliverables required by USAID in excess of $3,000,000 and is awarded a Task Order to do so, the Contractor is required to provide said services and reports/deliverables in accordance with the Contract's terms and conditions.

B.6.E Notwithstanding the above, if issuance of a task order to, and acceptance of a task order by, the Contractor would: (1) result in the Contractor (or its personnel or its subcontractors or their personnel) having an organizational conflict of interest for which restrictions would be placed on the Contractor's (or its personnel's or its subcontractors' or their personnel's) future activities ; or (2) violate the provisions of the Procurement Integrity legislation, i.e., Section 27 of the Office of Federal Procurement Policy Act (41 U.S.C. 423), as amended by Section 814 of Pub. L. 101-189 the Contractor, after written notification to the cognizant Contracting Officer, is not obligated to furnish those services or reports and other deliverables under this contract, and USAID may acquire the supplies or services from another source.

END OF SECTION B

SECTION C - DESCRIPTION/SPECIFICATIONS/STATEMENT OF WORK

C.1 OBJECTIVE AND GENERAL DESCRIPTION OF THE CONTRACT

The purpose of this contract is to provide U.S. Agency for International Development (USAID) Mission to Georgia with services of conducting external/independent performance and impact evaluations over the course of five years (in parallel to the Country Development Cooperation Strategy (CDCS)1 in line with USAID evaluation policy, based on USAID requirements and through building the local capacity in the field of evaluation.

The contractor must provide evaluation and assessment services under the CDCS Development Objectives (DOs). While the evaluation and assessment work may focus on these sectors, there might be evaluations which cut across sector and technical areas. The contractor may also be asked to implement assessment or analytical studies under the DOs.

By its nature, the project will be cross cutting and will support all of USAID’s DOs and intermediate results (IRs).

C.2 BACKGROUND

USAID/Caucasus has developed a new CDCS for the period of FY 2013-2017 that will continue to support the U.S. Government’s priority goals for Georgia. The DOs focus on democratic checks and balances and accountable governance enhanced; inclusive and sustainable economic growth; and increasingly stable, integrated and healthy society.

USAID/Caucasus is committed to the key principles and practices that foster a performance-oriented culture and will continue to manage for results under its new strategy. The Mission has continually sought to improve its performance management and will continue to do so to meet the Agency’s revised requirements.

Starting in 2010, as part of the Agency’s ongoing USAID Forward reforms, several key policies and guidance pieces had been issued, as embodied in USAID’s Policy Framework 2011-2015 and the USAID Forward initiative: USAID’s Evaluation Policy, Project Design Guidance, and Program Cycle overview with monitoring and evaluation (M&E) being one of its four building blocks emphasizing once more its importance. ADS series 200 - Operations Policy - has also been revised to capture the changes brought by the Agency’s revised or new policies.

USAID/Caucasus needs to make sure that it operationalizes these reforms by integrating them into its everyday work on the ground.

1 The full text of the CDCS is available at: http://georgia.usaid.gov/node/1140 .

USAID’s Evaluation Policy was approved in January 2011. The document is intended to provide clarity to USAID staff, partners and stakeholders about the purposes of evaluation, the types of evaluations, and the approach for conducting, disseminating and using evaluations. Intended primarily to guide staff decisions regarding the practice of evaluation within projects managed by USAID, it also serves to communicate to implementing partners and key stakeholders a new approach to evaluation. The evaluation policy requires missions around the world to implement evaluations for their “large projects”2 as well as “pilot” or “innovative” activities. The policy also defines the two types of evaluations that USAID will engage in - performance evaluations and impact evaluations.

In order for USAID/Georgia to be able to meet the evaluation policy requirements, ensure the quality of implemented evaluations and be able to solicit and implement number of evaluations each year (five on average), the Mission intends to set up a mechanism locally. This will enable the Mission to obtain quality evaluation and assessment services in a timely manner. In addition, in line with USAID forward initiative, local organizations/consultants will be included in each evaluation that will contribute to building long-term capacity for evaluation services in Georgia.

C.3 TECHNICAL SERVICES TO BE PROVIDED

All tasks under this contract must be performed in compliance with the ADS Chapter 203 Assessing and Learning; Mission Order # 203 Monitoring & Evaluation; and USAID Evaluation Policy3.

The contractor must provide services to enable USAID/Caucasus to plan and implement high quality evaluations that will generate answers to management questions on the validity of development hypotheses, unintended impacts, expected progress, stakeholder needs, and lessons learned. The contractor must also provide services to plan and implement assessments when needed to define the future directions of USAID’s assistance to Georgia.

Evaluations in USAID have two primary purposes: accountability to stakeholders and learning to improve effectiveness. Evaluations may be undertaken at any level of a Mission’s Results Framework, from an individual mechanism, to a project or its component, to SUB-IR or IR level, and to the development objective, or the goal. Evaluations are initiated and SOWs developed by the Mission. During the design phase of each new project, the Mission will give consideration to the evaluations that will be undertaken, and identify key evaluation questions at the outset. The Mission also maintains the evaluation plan detailing the list of evaluations to be implemented

2 a “large project” is one that equals or exceeds in dollar value the mean (average) project size for the operating unit

– Evaluation Policy, page 10.

3USAID Evaluation Policy, January 2011: http://www.usaid.gov/evaluation/USAIDEvaluationPolicy.pdf each fiscal year and relevant information on their type, cost, etc. This evaluation plan including key evaluation questions will become part of the Mission’s Performance Management Plan (PMP) and will be kept updated through the current contract.

Assessments are distinct from evaluations. Assessments must be designed to examine country or sector context to inform project design, or an informal review of projects. Assessments will also be initiated by the Mission.

The contractor must provide evaluation and assessment services in the development fields under USAID/Caucasus’ CDCD DOs, IR and sub intermediate results (SUB-IRs)4.

For each evaluation, it is required by the policy that in-house peer review as well as stakeholder consultation is organized for the evaluation of SOWs and later for each evaluation report.

USAID/Caucasus’ Program Office will facilitate in-house peer reviews, while the contractor will be responsible for organizing stakeholder reviews.

Evaluations must use methods that generate the highest quality and most credible evidence that corresponds to the questions being asked, taking into consideration time, budget, and other practical considerations.

C.4 WORK REQUIREMENTS

The Contractor must provide the following services:

Evaluations:

1. Assemble teams with the appropriate (to the SOW developed by the Mission) methodological and subject matter expertise to conduct high quality evaluations.

2. Engage local consultant/s and/or organization/s of relevant expertise in each evaluation team, thus contributing to building the local capacity in the evaluation field in Georgia.

3. Conduct performance evaluations and impact evaluations, with performance evaluations comprising the majority. One impact evaluation opportunity will be identified per DO during the life of the CDCS (however not all identified opportunities will be implemented). USAID/Caucasus expects to implement an average of five high quality

4 CDCD Results Framework is attached to this SOW evaluations per year plus maximum of three impact evaluations5 during the life of this contract.

4. Organize and lead presentations to communicate evaluation plan and/or findings to multiple stakeholders.

5. Ensure collection and submission to the Mission of materials such as conflict of interest forms signed by each evaluation team member and information collection forms: all data sets, quantitative data and code books, interview questionnaires, focus group transcripts, etc. for submission to a central database.

6. Submit evaluation reports that meet criteria defined by the evaluation policy, and make it available to the public on-line in a fully searchable form by submitting to the Development Experience Clearinghouse (DEC) www.dec.usaid.gov within a week of receiving a Mission approval on final report. The evaluation report template will be provided by the Mission.

7. Ensure quality and timely submission of all deliverables. The deliverables for each evaluation at a minimum will be: evaluation design plan (including the work plan); in brief and out brief with the mission; draft evaluation report; and final evaluation report.

Assessments:

1. Conduct approximately five sector assessments and/or other analytical tasks (report writing, case studies, etc.) through the life of the project for the Mission’s, other donors’ and Government of Georgia’s use, as directed by USAID.

2. Perform secondary data review, analyses and synthesis.

A. Task Orders Already Identified

Note: this list is subject to change based on USAID/Caucasus priorities.

1. Performance Evaluations of Access to Mechanization (AMP) Project and the Economic Prosperity Initiative (EPI) Project. This is an end-of-project evaluation for

5 Since impact evaluations, as defined by the evaluation policy, will run in parallel of projects and will be implemented over several years, it might not be possible to complete them within the timeframe of this mechanism.

In such case/s the mission will decide, in consultation with the contractor, how to proceed with the remaining parts of impact evaluation/s.

AMP and a mid-term evaluation for EPI. A joint SOW has been developed for these two projects and is attached to this SOW, to be issued as Task Order #1. The evaluations will be implemented by separate teams of relevant field and evaluation experts.

2. Performance Evaluation of the USAID Judicial Independence and Legal

Empowerment (JILEP) Project. This will be a mid-term performance evaluation.

3. Impact Evaluation of Georgia Primary Education (GPriEd) Project. This will be an impact evaluation which will involve setting the baseline of students’ outcomes in reading and math – the skills that GPriEd is aiming to improve among school children in Georgia. The first component of the impact evaluation will be implemented in FY 2013.

END OF SECTION C

SECTION D - PACKAGING AND MARKING

D.1 BRANDING AND MARKING

USAID policy is to require exclusive branding and marking in USAID direct acquisitions using any source of funds. “Exclusive Branding” means that the program is positioned as USAID’s, as showcased by the program name (e.g., “The USAID/Basic Education Program”). “Exclusive Marking” means contractors may only mark USAID-funded programs, projects, activities, public communications, and commodities with the USAID Standard Graphic Identity and, where applicable, the host-country government or ministry symbol or another U.S. Government logo (see ADS 320.3.4.1 and 320.3.4.2). It is USAID’s policy that contractors’ and subcontractors’ corporate identities or logos must not be used on USAID-funded program materials. The Principal Officer may approve exceptions to this policy, but only in extraordinary circumstances and after the Senior Advisor for Brand Management (LPA) clears the exception. Marking is not required on contractor vehicles, offices, and office supplies or other commodities used solely for administration of the USAID-funded program (see ADS 320.3.5).

The Contractor must comply with the requirements of the policy directives and required procedures outlined in USAID Automated Directive System (ADS) 320.3.2 “Branding and Marking in USAID Direct Contracting” (version from January 8, 2007) at http://www.usaid.gov/policy/ads/300/320.pdf and USAID "Graphic Standards Manual" (http://www.usaid.gov/branding/USAID_Graphic_Standards_Manual.pdf ) or any successor branding policy.

D.2 MARKING, AIDAR 752.7009 (JAN 1993)

(a) It is USAID policy that USAID-financed commodities and shipping containers, and project construction sites and other project locations be suitably marked with the USAID emblem.

Shipping containers are also to be marked with the last five digits of the USAID financing document number. As a general rule, marking is not required for raw materials shipped in bulk (such as coal, grain, etc.), or for semi-finished products which are not packaged.

(b) Specific guidance on marking requirements should be obtained prior to procurement of commodities to be shipped, and as early as possible for project construction sites and other project locations. This guidance will be provided through the cognizant technical office indicated on the cover page of this contract, or by the Mission Director in the Cooperating Country to which commodities are being shipped, or in which the project site is located.

(c) Authority to waive marking requirements is vested with the Regional Assistant Administrators, and with Mission Directors.

(d) A copy of any specific marking instructions or waivers from marking requirements is to be sent to the Contracting Officer; the original should be retained by the Contractor.

D.3 BRANDING STRATEGY

In accordance with Automated Directives System (ADS) 320.3.2.1, Contractor must prepare a Branding Implementation Plan (BIP) and Marking Plan (MP) to address the Branding Strategy.

This is to ensure that the successful offeror’s Branding Implementation Plan and Marking Plan under this contract are in compliance with the USAID Graphics Standard Manual available at http://www.usaid.gov/branding and any successor branding policy, as detailed in ADS Chapter 320.

USAID policy is to require exclusive branding and marking in USAID direct acquisitions.

“Exclusive Branding” means that the project is positioned as USAID‘s, as showcased by the project name (e.g., the USAID Quality Basic Education Project). “Exclusive marking” means contractors may only mark USAID-funded programs, projects, activities, public communications, and commodities with the USAID Standard Graphic Identity and, where applicable, the host-country government or ministry symbol or logo. It is USAID’s policy that contractors and sub-contractors corporate identities or logos may not be used on USAID-funded program and communications materials.

Objective: To provide prospective contractors with areas to be addressed in the development of the Branding Implementation Plan and the Marking Plan to deliver the message that activities are supported by the American People.

Project Name: USAID/Caucasus Mission Evaluation Mechanism or until a final name is agreed to with the Contractor.

Positioning: The USAID/Caucasus Mission Evaluation Mechanism will provide the mission with services of conducting external/independent performance and impact evaluations over the course of five years (in parallel to the Country Development Cooperation Strategy (CDCS) in line with USAID evaluation policy, based on USAID requirements, and through building the local capacity in the field of evaluation.

The contractor must provide evaluation and assessment services under the CDCS Development Objectives (DOs). While the evaluation and assessment work may focus on these sectors, there might be evaluations which cut across sector and technical areas. The contractor may also be asked to implement assessment or analytical studies under the DOs.

The Contractor will have the responsibility to position USAID’s name in each activity to be supported to ensure that people recognize and identify that those activities are implemented by the generous contribution of the U.S. government and the American people.

Public Outreach: The Activity audience will be diverse and impact at national, provincial, district and local levels. Project messages and actions will be addressed to different actors within the government of Georgia and civil society. The following categories of public audiences will be reached by the project:

Public officials at national, provincial, district, and local levels Civil society organizations, key social leaders Experts in the areas covered by USAID/Caucasus CDCS Private sector Media

Level of Visibility: The mechanism will ensure a high level of USAID visibility in most of the activities among the stakeholders of each project to be evaluated through this mechanism. When a sensitive situation needs to be considered, the project will strictly follow USAID recommendations.

Anticipated Elements of Marking Plan: Deliverables to be marked include: products, equipment, and inputs delivered; places where project activities are carried out; external public communications, studies, reports, publications, and informative and promotional products; and workshops, conferences, fairs, media related activities, and any such events. Publications authored by contractors or other non-USAID employees must include the following disclaimer on the title page:

“The author‘s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government.”

Threats and restrictions to the security of the project need to be identified and assessed in order to request any necessary exception from the marking requirement in accordance with ADS 320.3.2.

USAID’s web page contains the electronic version of the Graphic Standards Manual that is compulsory for all contractors. Evaluation reports produced by the contractor will follow USAID’s guidelines for preparing evaluation reports (Attachment 5).

END OF SECTION D

SECTION E – INSPECTION AND ACCEPTANCE

E.1 NOTICE LISTING CONTRACT CLAUSES INCORPORATED BY REFERENCE

The following contract clauses pertinent to this section are hereby incorporated by reference (by Citation Number, Title, and Date) in accordance with the clause at FAR "52.252-2 CLAUSES INCORPORATED BY REFERENCE" in Section I of this contract. See FAR 52.252-2 for an internet address (if specified) for electronic access to the full text of a clause.

NUMBER TITLE DATE

FEDERAL ACQUISITION REGULATION (48 CFR Chapter 1)

52.246-4 INSPECTION OF SERVICES – FIXED PRICE AUG 1996

E.2 INSPECTION AND ACCEPTANCE

USAID inspection and acceptance of services, reports, and other required deliverables or outputs should take place at:

USAID/Georgia 11 George Balanchine Str Tbilisi 0131 Georgia or at any other location where the services are performed and reports and deliverables or outputs are produced or submitted. The Task Order COR will be delegated authority to inspect and accept all services, reports, and required deliverables or outputs.

END OF SECTION E

SECTION F – DELIVERIES OR PERFORMANCE

F.1 PERIOD OF PERFORMANCE

The period of performance is five years from the effective date of award.

F.2 PERFORMANCE STANDARDS

Evaluation of the Contractor’s overall performance should be conducted for each task order in accordance with the performance standards established under each individual task order, must be conducted jointly by the COR and the Contracting Officer, and shall form the basis of the Contractor's permanent performance record with regard to this contract as required in FAR Part

42.15 and AIDAR 742.15.

F.3 PLACE OF PERFORMANCE

The Contractor’s primary place of performance will be in Georgia.

F.4 KEY PERSONNEL

(a) The key personnel whom the Contractor must furnish for the performance of this contract are as follows:

Position:

IQC Manager* Evaluation Specialist*

* Note, this will be removed upon award. The IQC Manager and Evaluation Specialist could be the same person. The Evaluation Speciialist may be removed if the winning offeror provides an acceptable pool of evaluation speciliasts as described in Section L.

(b) The key personnel specified above are considered to be essential to the work being performed hereunder. Prior to replacing any of the specified individuals, the Contractor must immediately notify both the Contracting Officer and USAID Contracting Officer’s Representative reasonably in advance and must submit written justification (including proposed substitution) in sufficient detail to permit evaluation of the impact on the program. No replacement of key personnel must be made by the Contractor without the written consent of the Contracting Officer.

(c) The IQC Manager Position will be funded through indirect costs, except as they are assigned to and paid directly under specific Task Orders. The Contractor must not bill USAID directly for IQC management costs under this IQC or under task orders. Contractors should define a centralized management structure that allows for recovery of IQC management costs as part of its indirect costs.

(d) The Contractor must furnish key personnel as stated in individual Task Orders.

(e) The key personnel specified in Task Orders are considered to be essential to the work being performed hereunder. Prior to replacing any of the specified individuals, the Contractor must immediately notify both the Task Order Contracting Officer and USAID Task Order Contracting Officer’s Representative reasonably in advance and must submit written justification (including proposed substitution) in sufficient detail to permit evaluation of the impact on the program. No replacement of key personnel must be made by the Contractor without the written consent of the Task Order Contracting Officer.

F.5 PERFORMANCE STANDARDS/INDICATORS

The services described in this contract will be delivered according to the defined performance standards below. If the contractor fails to meet performance standards indicated below, except as adjusted in individual cases by mutual consent of the contractor, the USAID/Regional Contracting Officer and the COR, the contractor will be out of compliance until the discrepancy is corrected to the satisfaction of the COR.

Indicator (i): % of evaluations conducted by the contractor and their final reports meeting “high quality” criteria Standard: The contractor’s ensures that implemented evaluations and submitted evaluation reports meet the criteria defined by USAID/Washington.

Data Source: The contractor’s reports to the COR.

Acceptable Quality Level: The contractor reports meet quality criteria defined by USAID/Washington/PPL. The final report must in summary meet the following criteria: be thoughtful, well-researched, address all evaluation questions in SOW, include SOW and data collection instruments in annex, methodology explained in detail, assess outcomes and impacts on males and females, disclose limitations, present findings as analyzed facts and evidence, sources identified and listed in report’s annex, recommendations supported by findings and are action-oriented).

Surveillance Method: The COR reviewing of evaluation reports from the contractor.

The COR organizing peer reviews of contractor reports.

Site visits.

Frequency: As established between the COR and the contractor.

Indicator (ii): # of completed quality evaluations Standard: The contractor ensures implementation of the target number of both performance and impact evaluations in a timely and quality manner.

Data Source: The contractor’s reports.

Acceptable Quality Level: As defined by USAID/Washington/PPL (attached to this SOW).

In summary, implement evaluations that have limited and focused evaluation questions, that are relevant to future decisions; uses methodology that is sound, appropriate to the evaluation questions and explained in detail, including limitations; the evaluation scope of work and the draft report are each peer reviewed (in-house as required in the policy, and/or by external experts as appropriate);

and the final report meets all pre-defined criteria.

Surveillance Method: The COR reviewing evaluation plan from the contractor, and organize peer review.

Frequency: As established between the COR and the contractor.

Indicator (iii): The contractor ensures assembling and preserving the necessary skills sets of the highly professional team of evaluators for each evaluation requested by USAID

Standard: The contractor proposes the evaluation team composition to have the skill set and experience necessary for each Task Order.

Foe impact evaluations, the contractor also ensures that it is preserved throughout the evaluation contract life (unless the change is necessary due to low quality work); in case of unavailability of one or more consultants during the entire period, the contractor ensures substitution of expert/s with similar level qualifications. COR will need to approve any changes to the team.

Data Source: The contractor’s communication to the COR.

Acceptable Quality Level: The contractor’s suggested team composition gives the COR acceptable assurance of meaningful results.

Surveillance Method: The COR reviewing reports and organizing peer reviews

Site visits and direct communication with the contractor.

Frequency: As established between the COR and the contractor.

Indicator (iii): The contractor ensures timely development and submitting of detailed evaluation design plan for each evaluation requested by USAID

Standard: The contractor submits draft detailed evaluation design prior to each evaluation team’s arrival to Georgia. The evaluation design will include a detailed evaluation matrix (including the key questions, methods and data sources used to address each question and the data analysis plan for each question), draft questionnaires and other data collection instruments or their main features, known limitations to the evaluation design, and a dissemination plan. The evaluation design will be finalized based on USAID’s comments and re-submitted to the COR.

Data Source: The evaluation design.

Acceptable Quality Level: To provide very clear plan on how the responses to each evaluation question will be obtained through the study 0 which methodology will be used for each and what will be the data source.

Surveillance Method: The COR reviewing the plan and organizing peer review.

Frequency: Once – draft and final plans.

Indicator (iv): The contractor ensures timely baseline and follow-on data collection (through surveys, focus groups, etc.) and through their local partners when appropriate during each evaluation or component as needed.

Standard: The contractor develops detailed strategies for data collection and survey implementation.

Data Source: The contractor’s communication with the COR. Plan for data collection.

Acceptable Quality Level: The contractor’s suggested plan for data collection as well as reports are justified and of high quality that give the COR acceptable assurance of meaningful results.

Surveillance Method: The COR direct communication with the contractor. Review of Contractor plans and reports.

Site visits.

Frequency: As established between the COR and the contractor.

Indicator (v): # of assessments completed Standard: The contractor ensures implementation of assessments and submission of reports as per USAID’s requirements and the SOW.

Data Source: The assessment reports.

Acceptable Quality Level: The reports comply with USAID’s pre-defined criteria in each assessment SOW.

Surveillance Method: The COR reviewing reports and organizing peer reviews.

Frequency: As established between the COR and the contractor.

F.6 REPORTS AND DELIVERABLES

In addition to the requirements set forth for submission of reports in Sections I and J and in the AIDAR clause 752.242-70, Periodic Progress Reports, the Contractor must submit the deliverables or outputs to the COR specified in Section G.3.

F.6.A Contents of Periodic Progress Reports

F.6.A.1 Performance Monitoring Reports (PMRs): The Contractor must submit performance reports summarizing progress of the major activities in process during the period in relation to the requirements of the contract, indicating any problems encountered, and proposing remedial actions as appropriate. In addition, beginning with the second PMR, and continuing subsequently with even numbered PMRs, the Contractor must include a section which discusses any salient programmatic trends that can be distilled from major activities that are in process or recently completed; and, highlights unresolved or on-going administrative/bureaucratic constraints to the Contractor's optimal performance; an update of which will be used as part of future award evaluations.

F.6.A.2 Contract Financial Report: The contractor must submit a contract financial report including the following:

(i) Notification of new Task Order Report Content:

(1) Task Order number,

(2) Mission/Bureau contracting the task order,

(3) Period of Performance,

(4) CO,

(5) COR,

(6) Ceiling Price, and

(7) Initial Obligated Amount.

(ii) Modifications to Existing Task Orders Report Content: A short description of any of the following changes to existing task orders:

(1) Incremental funding,

(2) Time extensions,

(3) Change of CO and/or COR, and

(4) Completion of work.

F.6.A.3 Performance reports must be submitted within 30 days of the three-month periods (calendar quarters) ending on March 31, June 30, September 30, and December 31.

4. The contractor must submit the reports to the COR identified in Section G of the Schedule, who will forward the reports to the responsible Contracting Officer.

5. The contractor must promptly notify the Contracting Officer and COR of any problems, delays, or adverse conditions which materially impair the contractor's ability to meet the requirements of the contract.

F.6.B Accrual Reports

The contractor must submit an estimated accrual report including the following information for all task orders:

(1) Total amount obligated,

(2) Total amount invoiced for,

(3) Total amount expended but not yet invoiced for,

(4) Remaining unexpended funds.

The contractor must submit these reports to the COR identified in Section G of the Contract on March 31, June 30, September 30, and December 31.

F.6.C Deliverables for each assessment/evaluation

All reports and other deliverables must be in the English language.

1. Performance Monitoring Plan (PMP): within the first 60 days after signing the contract, the contractor will submit the PMP based on the illustrative logframe (Attachment 3).

2. Detailed research (evaluation and/or assessment) design and the work plan for each task order: The research design must be an integral part of each proposal, and must explain in details methodologies that will be used to collect required information. For evaluations, the design must outline in details what methods the contractor will use to get answers for each evaluation question. The evaluation design must include a detailed evaluation matrix (including the key questions, methods and data sources used to address each question and the data analysis plan for each question), draft questionnaires and other data collection instruments or their main features, known limitations to the evaluation design, a work plan, and a dissemination plan. The refined design must be sent to the contract COR three days prior to research team’s arrival in-country. This information together with the Mission’s comments will be discussed in detail during the in-brief meeting with USAID and will be finalized within two (2) days of receivingper task order requirements USAID’s comments. The work plan must include the anticipated schedule and logistical arrangements and delineate the roles and responsibilities of members of the evaluation team.

3. In brief with the mission: Within three (3) days of arrival in country, the contractor must present a design plan and a work plan. This will be a maximum of 15 minute presentation of how the questions asked in SOW will be answered. Prior to in brief research teams may have working meeting/s with the contract COR to agree all the details of the design.

4. Out brief: Prior to departure, the contractor must present an outline (in bullets, possibly in power point or as a handout) of the evaluation report with general findings, conclusions, and anticipated recommendations. This will be a maximum 15 minute presentation. Prior to out brief research teams may have working meeting/s with the contract COR to agree all the details of the design.

5. Outline of the report (in bullets, possibly in power point or as a handout to be presented at the out brief) including findings, conclusions and recommendations.

6. Draft Report: The contractor must submit a draft report within seven (7) working days of completing the out brief with USAID. This document should explicitly respond to the requirements of the SOW, should answer the evaluation questions, be logically structured, and adhere to the standards of the USAID Evaluation Policy of January 2011 and the criteria to ensure the quality of the evaluation report. The report should follow USAID’s template attached (Attachment 5).

7. Final Report: The contractor must incorporate USAID’s comments and submit the final report to USAID/Georgia within five (5) working days following receipt of comments on the draft report. Final evaluation report should follow USAID’s template, and should not exceed 25 pages, excluding executive summary and annexes. The contractor will make the final evaluation reports publicly available through the Development Experience Clearinghouse at http://dec.usaid.gov within 30 calendar days of final approval of the formatted report with USAID consent. In case it is determined that the full report includes sensitive information, sanitized version will be produced and submitted to DEC.

8. All records from the evaluation (e.g. interview transcripts and summaries, focus group transcripts, code books, etc.) must be provided to the evaluation COR. All qualitative data collected by the evaluation team must be provided in an electronic file in easily readable format agreed upon with the COR. The data should be organized and fully documented for use by those not fully familiar with the project or the evaluation. USAID will retain ownership of the survey and all datasets developed.

Note: for impact evaluation that will have more than one component reports will be produced separately for each component.

Deliverable Table

Deliverable/Reference Format/#of copies

Date Due

F.6.C.1 Performance Monitoring Plan (PMP) e-mail to

COR

Within 60 calendar days after commencement of the Contract (together with the draft WP) (year 1)

30 calendar days prior to commencement of the next fiscal year (for subsequent years -no later than August 31)

F.6.C.2 Detailed research (evaluation and/or assessment) design and the work plan for each study.