Attachment_C-_Webinar_PowerPoint_(RELs_Peer_Review).pdf

Independent Review and Technical and Logistical Support for Regional Educational Laboratories for NCEE

FISCAL YEAR 2017 TRACKING #IESE170019AP

SOLICITATION NUMBER ED-IES-17-R-0025

Webinar Agenda

• Introductions: The U.S. Department of Education’s

Acquisition Team

• Vendor Collaboration Webinar Protocol

• Overview: Independent Review and Technical and Logistical Support for Regional Educational Laboratories

• Closing Remarks and Next Steps

Introductions

• Liz Eisner, Acting Associate Commissioner, Knowledge

Utilization Division, National Center for Education Evaluation and Regional Assistance (NCEE)/Institute of Education Sciences (IES)

• Amy Johnson, Contracting Officer’s Representative –

(NCEE/IES)

• Veronica L. Price, Sr. Contracting Officer – OCFO/Contracts and Acquisitions Management (CAM)

• Barakat Shakir, Contract Specialist – OCFO/Contracts and Acquisitions Management (CAM)

Motivation

• Section 174 (e) (5) of ESRA requires “peer review” of REL research and publications in order to ensure that products meet IES standards

• IES requires other technical and logistical support for the RELs (note-taking at REL Directors meetings, maintaining REL Intranet, occasional technical input and guidance, etc.)

Peer Review Objectives

1. Create, implement and maintain an application in the IES

Data Center to manage the review and tracking of REL work submitted for review

2. Refine and improve the existing criteria for reviews of REL work

3. Review analytical technical support products and tools produced by RELs

4. Review materials related to research and evaluation projects produced by the RELs, including: project proposals, OMB Clearance packages, data analysis plans, research reports, and restricted use data files and documentation.

5. Provide technical editing, formatting, and production of reports

6. Provide as-needed guidance for improvement of REL products

Logistical and Technical Support Objectives

Logistical:

1. Maintain the REL Intranet, a SharePoint 2013-based application in the IES Data Center

2. Create an online portal for the Stakeholder Feedback Survey, housed in the IES Data Center, for administration of surveys that RELs administer after webinars, events, and technical assistance activities.

3. Logistics and Support for REL Directors Meetings

4. Logistics and Support for Webinars for REL Staff (optional)

5. Update REL Program Brochure and Create REL Posters

Technical:

1. Develop as-needed analytic and methods oriented projects

(optional task)

Central Tasks Task 1: Communication with IES

Task 2: Refine, Improve, and Implement Review Criteria and Processes for REL Work

Task 3: Build and Support a Web-Based Tracking and Review Application for REL Work

Task 4: Technical Editing, Formatting, and Production of Reports

Task 5: As-Needed Guidance for Improvement of REL Products

Task 6: As-Needed Analytic and Methods Oriented Projects (Optional)

Task 7: Logistical Support

Background Information:

Existing Review Criteria

1. Relevance

2. Technical Quality

3. Readability/Writing Quality and Style

4. Utility

Background Information Review Process: Phase I (Proposals and Reports)

REL COR

Review

Peer Review COR Review

Peer Review Team Review

Peer Review COR Final Review

NCEE Associate Commissioner

Review

Background Information Review Process: Phase II

(Reports)

Editing Peer Review COR Review

NCEE Associate Commissioner

Review

NCEE

Commissioner

Review Final Production

Publication on IES Website

Peer Review Team Review

Important Assumptions

• Over the five-year period of this contract, NCEE anticipates up to 450 proposals and reports for descriptive data analyses and technical assistance or research guidance documents and up to 35 proposals and reports for impact evaluations and systematic reviews.

• For each year of the contract, NCEE anticipates up to 150 proposals and reports for descriptive data analyses and technical assistance or research guidance documents and up to 15 proposals and reports for impact evaluations and systematic reviews.

• Note: IES does not expect proposals for research studies during the

5th year of the contract.

Important Tasks to Note in More Detail

Subtask 3.1: Build a Web-Based Tracking and Review Application

• Application will track all stages of a product

• Application should create a work flow that will notify users at each stage that they need to interact with a product

• All systems developed for this contract shall be hosted in the IES

Data Center.

• All websites and web applications must be developed using

ASP.NET (.NET Framework 3.5, 4.5, 4.6, and MVC 3 are currently supported) and SQL Server 2012 Standard Edition on Windows 2012 Servers and comply with IES's web development standards

Subtask 3.3: Manage Proposals and Reports through Temporary Email Process while Application is Being Developed under 3.1

(continued) Subtask 7.1: Maintain REL Intranet

• The contractor shall provide support regarding the maintenance of the REL intranet

• REL Intranet is a SharePoint 2013-based application in the IES Data Center

• Allows RELs to share information about projects to support cross-

REL collaboration, houses an inventory of Ask-A-REL responses, provides a space to upload and store IES Guidance documents and other important REL documents, and has an event calendar

• RELs upload Ask-a-REL responses to the REL Intranet on a monthly basis

7.2 Stakeholder Feedback Survey (SFS) Portal

• The contractor shall develop a portal in the IES Data Center for administration of the Stakeholder Feedback Survey, which REL contractors administer after each of their webinars, events, and technical assistance activities

• The portal will contain a public-facing web form that recipients of REL technical assistance can use to respond to the survey

• A unique URL will be created for each survey administration.

Survey responses will be accessible by the RELs through the REL Intranet

• A report generator shall be developed so SFS results can be tabulated for each event/activity, each REL, and across the program

Task 6: As-Needed Analytic and Methods Oriented Projects (optional)

• The contractor shall design up to three projects throughout the duration of the base period of the contract that provide exemplars of managing complicated analytic tasks or addressing technical issues

• All proposals will be subject to NCEE approval

• The contractor shall design activities that are responsive to immediate REL needs that will help advance the state of knowledge, and that contribute meaningfully to improving the conduct and reducing the cost of education evaluations

Period of Performance Contract Period Purpose

Total Duration (start-end)

Base Period

Refine review criteria; build web-based tracking and review application; use temporary email review system;

conduct peer review; edit and produce REL reports;

provide logistical support to REL Program including developing SFS portal.

24 months (Months 1–24)

Option Year I

Conduct peer review; edit and produce REL reports;

provide logistical support to REL program.

12 months (Months 25–36)

Option Year II

Conduct peer review; edit and produce REL reports;

provide logistical support to REL program.

12 months (Months 37–48)

Option Year III

Conduct peer review; edit and produce REL reports;

provide logistical support to REL program.

12 months (Months 48–60)

Key Expertise, Qualifications IES will require the contractor to possess expertise:

• In designing and conducting rigorous education evaluations and high-quality descriptive research studies

• In providing independent review and evaluation of education research

• In editing and producing engaging reports and tools that communicate technical and complex ideas in plain language

• In designing and implementing a web-based review tracking application similar to the one described in the PWS

• In troubleshooting problems that arise in the implementation and use of a SharePoint system similar in scale and complexity as the REL Intranet

Closing Remarks & Next Steps

• All webinar related questions must be submitted to the CS

& CO by 11:00 AM EST, Tuesday, April 25, 2017

• Responses will be posted on www.FBO.gov on Thursday, April 28, 2017

• Capability Statements are due 11:00 AM EST, Tuesday, April 25, 2017

• RFP’s anticipated release timeframe: May 2017 for the ““Peer Review and Support for Regional Educational Laboratories” (NOTE: New Title) RFP http://www.fbo.gov/