ProgEvalManual DCF ITN 2324 063 CBC.pdf

Effective Date: July 31, 2020

(PMT-10-2021)

State of Florida Department of Children and Families

DCF ITN 2324 063

Community-Based Care Lead Agencies

ITN Programmatic Evaluation Manual

Evaluator Name: __________________________________

Vendor Name: __________________________________

Date of Reply Evaluation: __________________________________

Evaluator Signature: __________________________________

Community-Based Care Lead Agency for Circuit 5

(PMT-10-2021 Page 1

1 GENERAL INSTRUCTIONS

1.1 Each programmatic evaluator will evaluate the programmatic reply for all Vendor replies that pass the mandatory criteria. Each evaluation criterion must be scored. Fractional values will not be accepted. If an evaluator score sheet(s) is missing scores, it will be returned for completion. Scoring must reflect the evaluator’s independent evaluation of the reply to each evaluation criterion.

1.2 Each evaluator shall assign a score for each evaluation criterion based upon his/her assessment of the reply.

The assignment of an individual score must be based upon the following description of the point scores:

IF, in your judgment the reply demonstrates and/or describes… Category …assign points within ...

…extensive competency, proven capabilities, an outstanding approach to the subject area, innovative approaches, practical and effective solutions, a clear and complete understanding of inter-relationships, full responsiveness, a clear and comprehensive understanding of the requirements and planning for the unforeseen.

Exceptional 81-100% of the maximum points for the area.

…clear competency, consistent capability, a reasoned approach to the subject area, feasible solutions, a generally clear and complete description of inter-relationships, extensive but incomplete and a sound understanding of the requirements.

Good 61-80% of the maximum points for the area.

…fundamental competency, adequate capability, a basic approach to the subject area, apparently feasible but somewhat unclear solutions, a weak description of inter-relationships in some areas, partial responsiveness, a fair understanding of the requirements and a lack of staff experience and skills in some areas.

Adequate 41-60% of the maximum points for the area.

…little competency, minimal capability, an inadequate approach to the subject area, infeasible and/or ineffective solutions, somewhat unclear, incomplete and /or non-responsive, a lack of understanding of the requirements and a lack of demonstrated experience and skills.

Poor 21-40 %of the maximum points for the area.

…a significant or complete lack of understanding, an incomprehensible approach, a significant of complete lack of skill and experience and extensive non-responsiveness.

Insufficient 0-20% of the maximum points for the area.

1.3 When completing score sheets programmatic evaluators should record references to the sections of the Invitation to Negotiate (ITN) and the written reply materials which most directly pertain to the criterion and upon which their scores were based. More than one section may be recorded. Evaluators should not attempt an exhaustive documentation of every bit of information considered but only key information. In general, the reference statements should be brief. If the reply does not address an evaluation criterion, evaluators should indicate “not addressed” and score it accordingly.

1.4 Each evaluator has been provided a copy of the ITN, including its appendices, any ITN amendments, and Vendor written inquiries and the written replies provided by the Department. Each evaluator will also be

(PMT-10-2021 Page 2 provided with a copy of each programmatic reply which should be evaluated and scored according to the instructions provided in the solicitation and the evaluation manual.

1.5 Replies shall be independently scored by each member of the evaluation team. No collaboration is permitted during the scoring process. The same scoring principles must be applied to every reply received, independent of other evaluators. Evaluators should work carefully to be as thorough as possible in order to ensure a fair and open competitive procurement. No attempt by Department personnel or others, including other evaluators, to influence an evaluator’s scoring shall be tolerated.

1.6 If any attempt is made to influence an evaluator, the evaluator must immediately report the incident to the Procurement Officer. If such an attempt is made by the Procurement Officer, the evaluator must immediately report the incident to the Inspector General.

1.7 The Procurement Officer will conduct reference checks via telephone interviews.

1.8 Only the rating sheets provided should be used. No additional notes or marks should appear elsewhere in the evaluation manual.

1.9 Evaluators may request assistance in understanding evaluation criteria and replies only from the Procurement Officer and Subject Matter Experts via the Procurement Officer.

1.10 Questions related to the solicitation and the evaluations of the reply should be directed only to:

Alicia Reifinger, Procurement Officer Florida Department of Children and Families E-Mail Address: Alicia.Reifinger@myflfamilies.com

1.11 After each evaluator has completed the scoring of each programmatic reply, the scores are then submitted to the Procurement Officer for compilation. The Procurement Officer will average the total programmatic point scores by each evaluator to calculate the points awarded for each section along with the financial scoring for each Vendor. Financial scoring is conducted by either financial evaluators or a formula. The two scores are added together with the highest scorer being awarded.

1.12 Following completion of the independent evaluations of the replies, the Procurement Officer will hold a meeting to validate evaluator scoring. The purpose of the meeting is to ensure that their individual evaluation scores were captured correctly when preparing the total scores.

2 QUALITATIVE CRITERIA

Evaluators shall assign scores to each of the replies received by the Department based on the following criteria:

• Vendor’s articulation of their project approach and solution, and the ability of the approach and solution to meet the Department’s needs, the requirements of this ITN and Appendix I, Attachment I

• The innovation of the approach and solution to best meet the needs of the local community

• Vendor references and track record implementing similar solutions to the one specified in this ITN

• Experience and skills of proposed staff relative to the proposed approach and solution mailto:Alicia.Reifinger@myflfamilies.com

(PMT-10-2021 Page 3

3 PROGRAMMATIC REPLY POINT VALUES

The maximum score for the Programmatic Reply is 700 points.

Programmatic Criteria Relative Value

Possible Points

• The Vendor’s articulation of their solution approach and the ability of the solution to meet the requirements of services outlined in DEPARTMENT’S SUPPLEMENTAL CONTRACT- EXHIBIT C (APPENDIX IX) and reply requirements of Tab 5: Services Approach and Solutions, including the ability to provide any additional value.

o Services Approach and Solution

35% 350

• The level of innovation within the Vendor’s solution approach, including the identification of best practices, the use of supports and services at the local level, unique, new, or creative solutions to identified areas of need, and the overall depth of the innovative approaches.

10% 100

• Vendor’s organization, ability to complete Scope of Work services, management of Performance Specifications, and means of completing Deliverables as defined in the

DEPARTMENT’S SUPPLEMENTAL CONTRACT (APPENDIX IX).

o Executive Overview

15% 150

• The skills and experience of the Vendor’s leadership team, staff, and resources the Vendor will use in implementing its solution. leadership credentials o Core Team Qualifications 10% 100

TOTAL 70% 700

(PMT-10-2021 Page 4

Reference Programmatic Criteria I- Services Approach and

Solution (Possible Points 350)

Total Possible Points

Points Awarded

Section 4.2.6.

The Vendor shall describe the approach to performing the tasks described in the DEPARTMENT’S SUPPLEMENT CONTRACT- EXHIBIT C (APPENDIX IX) and how it will meet all the Department’s detailed requirements. The Vendor must describe in detail how these subcontracted Vendors will also be capable of meeting the Department’s detailed requirements and the requirements of section 409.988(1)(j), F.S. The Vendor must outline how various services and subcontracts will be managed in offered counties, and how subcontractors will be held accountable if performance standards are not met. The Vendor must describe any proposed innovative approaches and describe how these approaches include the identification of best practices, the use of supports and services at the local level, and/or are unique, new, or creative solutions to identified areas of need.

Safety

Section 4.2.6.

A.1.a.

1. The adequacy of the Vendor’s reply regarding Prevention Services?

(Insufficient – 6; Poor – 12; Adequate –18; Good –24;

Exceptional – 30)

4.2.6.

A.1.b.

2. The adequacy of the Vendors replies regarding Child Protection Tasks?

(Insufficient – 6; Poor – 12; Adequate –18; Good –24;

Exceptional – 30)

Section 4.2.6.

A.1.c.

3. The adequacy of the Vendor’s reply regarding Safety Management and Family Preservation Services?

(Insufficient – 6; Poor – 12; Adequate –18; Good –24;

Exceptional – 30)

Permanency Section 4.2.6.

A.2.a.

4. The adequacy of the Vendor’s reply regarding Adoption Services?

(Insufficient – 5.4; Poor –10.8; Adequate – 16.2; Good – 21.6; Exceptional – 27)

A.2.b.

5. The adequacy of the Vendor’s reply regarding Placement Services?

(Insufficient – 5.4; Poor –10.8; Adequate – 16.2; Good – 21.6; Exceptional – 27)

Section 4.2.6.

A.2.c.

6. The adequacy of the Vendor’s reply regarding Guardianship Assistance Program (GAP)?

(Insufficient – 5.2; Poor – 10.4; Adequate – 15.6; Good – 20.8; Exceptional – 26)

Well-Being Section 7. The adequacy of the Vendor’s reply regarding 70

(PMT-10-2021 Page 5

4.2.6.

A.3.a.

Education?

(Insufficient – 4.6; Poor –9.2; Adequate – 13.8; Good – 18.4; Exceptional – 23)

Section 4.2.6.

A.3.b.

8. The adequacy of the Vendor’s reply regarding Services for Transitioning Youth and Young Adults?

(Insufficient – 4.6; Poor –9.2; Adequate – 13.8; Good – 18.4; Exceptional – 23)

Section 4.2.6.

A.3.c.

9. The adequacy of the Vendor’s reply regarding Health Services?

(Insufficient – 4.8; Poor – 9.6; Adequate – 14.4; Good – 19.2; Exceptional – 24)

Management Section 4.2.6.

A.4.a

10. The adequacy of the Vendor’s reply regarding Licensing Tasks?

(Insufficient – 2.6; Poor – 5.2; Adequate – 7.8; Good – 10.4+2.6; Exceptional – 13)

A.4.b.

11. The adequacy of the Vendor’s reply regarding Quality Assurance (QA) and Continuous Quality Improvement (CQI)?

(Insufficient – 2.6; Poor – 5.2; Adequate – 7.8; Good – 10.4+2.6; Exceptional – 13)

Section 4.2.6.

A.4.c

12. The adequacy of the Vendor’s reply regarding Other Service System Tasks?

(Insufficient – 2.4; Poor – 4.8; Adequate – 7.2; Good –9.6;

Exceptional – 12)

A.4.d.

13. The adequacy of the Vendor’s reply regarding General Management?

(Insufficient – 2.4; Poor – 4.8; Adequate – 7.2; Good –9.6;

Exceptional – 12)

Staffing

4.2.6.

B.1.a.

14. The adequacy of the Vendor’s reply regarding Staffing Requirements?

(Insufficient – 5.5; Poor – 11; Adequate – 16.5; Good – 22; Exceptional – 27.5)

B.1.b.

15. The adequacy of the Vendor’s reply regarding Staffing Changes?

(Insufficient – 5.5; Poor – 11; Adequate – 16.5; Good – 22; Exceptional – 27.5)

TOTAL 350

Reference Programmatic Criteria I- Services Approach and Total Points Awarded

(PMT-10-2021 Page 6

Solution - Innovation (100 Points) Possible Points

Section 4.2.7

The level of innovation within the Vendor’s solution approach, including the identification of best practices, the use of supports and services at the local level, unique, new, or creative solutions to identified areas of need, and the overall depth of the innovative approaches.

4.2.7.1

16. To what extent does the Vendor’s reply display a level of innovation within the Vendor’s solution approach, including the identification of best practices, the use of supports and services at the local level, unique, new, or creative solutions to identified areas of need, and the overall depth of the innovative approaches?

(Insufficient – 20; Poor – 40; Adequate –60; Good –80 Exceptional – 100)

Programmatic Criteria I – Services Approach and Solution - Notes Notes/Rationale:

Reference Programmatic Criteria II – Executive Overview (Possible Points 150)

Total Possible Points

Points Awarded

Section 4.2.4

A brief executive overview demonstrating an understanding of the ITN, ITN purpose, and the needs specified in ITN, as well as, a brief description of the Vendor’s organization, ability to complete Scope of Work services, management of Performance Specifications, and means of completing Deliverables as defined in the DEPARTMENT’S SUPPLEMENTAL CONTRACT- EXHIBIT D

(APPENDIX IX).

(PMT-10-2021 Page 7

Section 4.2.4.1.1.

17. To what extent does the Vendor’s reply describe Vendor’s approach and philosophy, including mission statement, core values, and vision? How effectively does the Vendor’s reply demonstrate understanding of the Department’s goals and principles for this agreement?

(Insufficient – 7.6; Poor – 15.2; Adequate –22.8; Good – 30.4; Exceptional – 38)

4.2.4.1.2.

18. To what extent does the Vendor’s reply describe Vendor’s organization and governance structure, depicting clear lines of authority including corporate affiliations; describe how the structure represents a lean, efficient, and effective administrative model;

describe experience and achievements in developing a governance model is designed to avoid conflicts of interest?

(Insufficient – 6.2; Poor – 12.4; Adequate – 18.6; Good – 24.8; Exceptional – 31)

4.2.4.1.3.

19. To what extent does the Vendor’s reply demonstrate the Vendor’s and subcontractor(s)' ability to successfully complete the work described in the ITN and its appendices, attachments, exhibits, and referenced supporting documentation? The Vendor’s and any proposed subcontractor(s)’ information shall be shown separately.

(Insufficient – 9; Poor – 18; Adequate – 27; Good –36;

Exceptional – 45)

(PMT-10-2021 Page 8

Programmatic Criteria II – Executive Overview

4.2.4.2

20. To what extent does the Vendor’s reply describe the following:

• Full legal name and its associated Federal Employer Identification Number (FEIN), or individual identification number if a FEIN is not required;

• Proof of registration with MFMP;

• Country and state of incorporation;

• Principal place of business;

• Description of the Vendor’s organization, including number of years in business, subsidiaries, parent corporations, officers;

include organization charts and details concerning the number of facilities by geographic location; and

• Names and addresses of all affiliated or related companies, partnerships, or associations (including subcontractor, if any) and a brief description of its relationship to the Vendor.

• Any history of contract termination by a state agency or Lead Agency for the subcontractor.

(Insufficient – 7.2; Poor – 14.4; Adequate – 21.6; Good – 28.8; Exceptional – 36)

TOTAL 150

(PMT-10-2021 Page 9

Programmatic Criteria II – Core Team Qualifications

Reference Programmatic Criteria III – Core Team Qualifications (Possible Points 100)

Total Possible Points

Points Awarded

Section 4.2.5.1.

21. To what extent does the Vendor’s reply describe the qualifications and credentials of their leadership team with an explanation of why the leadership team is qualified to lead their organization in meeting the needs of this ITN? Does the Vendor include résumés for key leadership personnel describing their work experience, education, and training as it relates to the requirements of this ITN and the

DEPARTMENT’S STANDARD CONTRACT AND

SUPPLEMENTAL CONTRACT (APPENDIX VIII and APPENDIX

IX)?

(Insufficient – 15, Poor – 30; Adequate –45; Good –60, Exceptional – 75)

Section 4.2.5.2.

22. To what extent does the Vendor’s reply provide the Vendor’s operational approach to the recruitment, training, supervision, and retention of qualified personnel as described in the

DEPARTMENT’S STANDARD CONTRACT AND

SUPPLEMENTAL CONTRACT (APPENDIX VIII and APPENDIX IX)? Does the reply address all applicable personnel grievance and conflict resolution practices? Additionally, does the reply explain how the Vendor’s organization, subcontractors, and staffing levels will best meet the performance standards required to perform properly? Does the Vendor describe the credentials for human resources, quality assurance, financial, information technology, and other key professional level employees?

(Insufficient – 15, Poor – 30; Adequate –45; Good –60, Exceptional – 75)

TOTAL 100

PROGRAMMATI TOTAL (Out of 700)