Statewide Evaluation SOW.docx

Scope of Work School-Based Evidence-Based Practice Prevention Program Statewide Evaluation October 1, 2025 – September 30, 2026

OVERVIEW

The selected contractor will provide statewide evaluation services to the Division of Mental Health and Addiction (DMHA) and the three (3) Regional school-based vendors contracted with DMHA to provide legislatively mandated school-based evidence-based prevention programs that promote mental health, maximize student success, and prevent substance misuse for students, teachers, parents, caregivers, and community members. The selected contractor will collaborate with DMHA on best practices for effective evaluation of the statewide school-based prevention initiative to promote mental health and wellness and share programmatic impact.

DELIVERABLES

A. PROJECT ACTIVITY: Quarterly Output Key Performance Indicators (KPIs) The selected contractor will compile KPI output data from providers on a quarterly basis. KPIs are quantifiable measurements that help track progress towards a goal and inform decision making. For this project, the KPIs show the reach and breadth of interventions intended to prevent substance abuse, encourage healthy behaviors, and maximize student success.

Contractor Actions:

· Each quarter, the contractor will collect the KPIs from providers and compile them for DMHA, displaying the data by regional provider and aggregated across providers and intervention types.

· The contractor will also determine the evidence base, target population, and appropriate Institute of Medicine (IOM) category for each of more than 30 interventions implemented by the providers and will aggregate the KPI data according to these designations.

· The contractor will work with DMHA to identify other elements in the quarterly report that would be useful for DMHA.

B. PROJECT ACTIVITY: Further Development of KPIs/Common Outcome Instrument The selected contractor will work with DMHA and the regional providers to identify appropriate outcome-oriented KPIs that measure outcomes related to substance abuse prevention, healthy behaviors, and student success. The contractor will also work to develop a common outcome instrument that could be used by a single provider across multiple programs and/or by multiple providers.

Contractor Actions:

· Review the literature, reports, and surveys for appropriate outcomes.

· Develop options for outcome KPIs and a Common Instrument.

· Review options with DMHA and the regional providers.

· If a Common Instrument is agreed upon, program the survey using a secure, online survey platform; collaborate with providers to administer the survey at pretest and posttest; analyze and report survey findings.

C. PROJECT ACTIVITY: Consultation, Training and Technical Assistance The selected contractor will provide consultation, training, and technical assistance to DMHA and/or the regional providers on data- and evaluation-related topics, as needed. Such topics could include the following: logic models, evaluation plans, needs assessments, data collection, surveys, pre- and post-tests, analysis, and reporting.

Contractor Actions:

· Attendance at monthly meetings with DMHA.

· Attendance at monthly group meetings between DMHA and regional providers.

· Attendance at individual meetings between DMHA and regional providers, as requested.

· Attendance at meetings between DMHA and Technical Assistance Provider, as requested.

· Technical assistance and training to DMHA and/or regional providers on data- and evaluation-related topics, as requested.

D. PROJECT ACTIVITY: Annual Report The selected contractor will generate an annual statewide report that documents major project activities of DMHA and the regional school-based prevention providers.

Contractor Actions:

· Document key DMHA project activities and support (including other prevention-focused technical assistance provided to DMHA and providers)

· Collect and compile annual KPIs at the regional level and project level.

· Review all regional provider level reports (annual reports and evaluation reports), summarize outcome highlights, and synthesize outcome information at the provide and project level.

· Review and compile relevant INYS data to inform DMHA about substance use and mental health trends among youth.

Contractor Qualifications:

The selected contractor will have the following experience and skills.

· At least 20 years of experience in evidence-based, substance misuse prevention and mental health promotion strategies.

· At least 20 years of experience collaborating with state and local agencies that administer substance misuse prevention and mental health promotion strategies.

· At least 20 years of experience conducting evaluations for state and local systems.

· At least 20 years of experience developing logic models, evaluation plans, and performance measures for substance misuse prevention and mental health promotion initiatives.

· At least 20 years of experience providing substance misuse prevention and mental health promotion training and technical assistance.

· At least 20 years of experience developing survey instruments and data collection protocols

· At least 5 years of experience working with the state agencies, community providers, and local education agencies.

· PhD or other doctorate degree in social sciences, public health, program evaluation or related fields.