RFQ 75D301-23-R-72670.pdf

PAGES

15A. NAME

AND

ADDRESS

OF

OFFEROR

SEC. PAGE(S) SEC. PAGE(S)

(Date) (Hour)

CALENDAR DAYS

14. ACKNOWLEDGMENT OF AMENDMENTS

(The offeror acknowledges receipt of amend-ments to the SOLICITATION for offerors and related documents numbered and dated:

(Type or Print)

SOLICITATION, OFFER AND AWARD

1. THIS CONTRACT IS A RATED ORDER

UNDER DPAS (15 CFR 700)

RATING

PAGE OF

1 77

3. SOLICITATION NO.

75D301-23-R-72670

4. TYPE OF SOLICITATION

SEALED BID (IFB)

X NEGOTIATED (RFP)

5. DATE ISSUED

6. REQUISITION/PURCHASE

NO.

00HCUCMD-2023-76323

7. ISSUED BY CODE 8219 8. ADDRESS OFFER TO (If other than Item 7)

Centers for Disease Control and Prevention (CDC)

Office of Acquisition Services (OAS)

2900 Woodcock Blvd, MS TCU-4

Atlanta, GA 30341-4004

Approved as to Form and Legality: _____________________________

NOTE: In sealed bid solicitations “offer” and “offeror” mean “bid” and “bidder.”

SOLICITATION

9. Sealed offers in original and copies for furnishing the supplies or services in the Schedule will be received at the place specified in Item 8, or if handcarried, in the depository located in until 2:00p local time 08/30/2023

CAUTION -- LATE Submissions, Modifications, and Withdrawals: See Section L, Provision No. 52.214-7 or 52.215-1. All offers are subject to all terms and conditions contained in this solicitation.

10. FOR INFORMATION

CALL:

A. NAME

Willie Moss

B. TELEPHONE (NO COLLECT CALLS)

AREA CODE NUMBER: EXT:

C. E-MAIL ADDRESS

LSF7@CDC.GOV

11. TABLE OF CONTENTS

(x) DESCRIPTION (x) DESCRIPTION

PART I – THE SCHEDULE PART II – CONTRACT CLAUSES

X A SOLICITATION/CONTRACT FORM 1 X I CONTRACT CLAUSES 54

X B SUPPLIES OR SERVICES AND PRICES/COSTS 2 PART III - LIST OF DOCUMENTS, EXHIBITS AND OTHER ATTACH.

X C DESCRIPTION/SPECS./WORK STATEMENT 6 X J LIST OF ATTACHMENTS 62

X D PACKAGING AND MARKING 38 PART IV – REPRESENTATIONS AND INSTRUCTIONS

X E INSPECTION AND ACCEPTANCE 39 REPRESENTATIONS, CERTIFICATIONS, AND

X F DELIVERIES OR PERFORMANCE 40 X K OTHER STATEMENTS OF OFFERORS 63

X G CONTRACT ADMINISTRATION DATA 42 X L INSTRS., CONDS., AND NOTICES TO OFFERORS 68

X H SPECIAL CONTRACT REQUIREMENTS 4444 X M EVALUATION FACTORS FOR AWARD 75

OFFER (Must be fully completed by offeror)

NOTE: Item 12 does not apply if the solicitation includes the provisions at 52.214-16, Minimum Bid Acceptance Period.

12. In compliance with the above, the undersigned agrees, if this offer is accepted within calendar days (60 calendar days unless a different period is inserted by the offeror) from the date for receipt of offers specified above, to furnish any or all items upon which prices are offered at the price set opposite each item, delivered at the designated point(s), within the time specified in the schedule.

13. DISCOUNT FOR PROMPT PAYMENT

(See Section I, Clause No. 52-232-8)

10 CALENDAR DAYS

20 CALENDAR DAYS

30 CALENDAR DAYS

AMENDMENT NO. DATE AMENDMENT NO. DATE

CODE FACILITY 16. NAME AND ADDRESS OF PERSON AUTHORIZED TO SIGN OFFER

15B. TELEPHONE NO.

AREA CODE NUMBER EXT.

15C. CHECK IF REMITTANCE ADDRESS

IS DIFFERENT FROM ABOVE - ENTER

SUCH ADDRESS IN SCHEDULE.

17. SIGNATURE

18. OFFER DATE

AWARD (To be completed by Government)

19. ACCEPTED AS TO ITEMS NUMBERED 20. AMOUNT

22. AUTHORITY FOR USING OTHER THAN FULL AND OPEN COMPETITION:

21. ACCOUNTING AND APPROPRIATION

10 U.S.C. 2304(c)( ) X 41 U.S.C. 253(c)( )

23. SUBMIT INVOICES TO ADDRESS SHOWN IN

(4 copies unless otherwise specified)

ITEM

24. ADMINISTERED BY (If other than Item 7) CODE 8219 25. PAYMENT WILL BE MADE BY CODE 434

Centers for Disease Control and Prevention (CDC)

Office of Acquisition Services (OAS)

2900 Woodcock Blvd, MS TCU-4

Atlanta, GA 30341-4004

Centers for Disease Control and Prevention (FMO)

PO Box 15580 404-718-8100

Atlanta, GA 30333-0080

26. NAME OF CONTRACTING OFFICER (Type or print)

27. UNITED STATES OF AMERICA

(Signature of Contracting Officer)

28. AWARD DATE

IMPORTANT -- Award will be made on this form, or on Standard Form 26, or by other authorized official written notice.

AUTHORIZED FOR LOCAL REPRODUCTION STANDARD FORM 33 (REV. 9-97)

PREVIOUS EDITION IS UNUSABLE Prescribed by GSA

FAR (48 CFR) 53.214©

K

Section B - Supplies Or Services And Prices/Costs

Base Year Items: 12 Month Period of Performance

ITEM SUPPLIES / SERVICES QTY / UNIT UNIT PRICE EXTENDED PRICE

0001 Data and Technical Assistance Services

Tasks 1: Services in accordance with

Statement of Work

Firm Fixed Price, Non-Severable Services

Period of Performance: September 29, 2023 - September 28, 2024

1 Job

0002 Data and Technical Assistance Services

Tasks 2-5: Services in accordance with

Firm Fixed Price, Severable Services

1 Job

0003 Travel

Travel will be in accordance with/and not to exceed the Federal Travel Regulation rates. Travel costs need to be approved in advance by the COR. The Contractor shall be required to provide their travel policy to the Government for review.

This is a Cost Reimbursement CLIN

1 Lump Sum Not-to-Exceed

($10,000)

Not-to-Exceed

TOTAL $___________

Option 1 Base Year Items: 12 Month Period of Performance

1002 Data and Technical Assistance Services

2024 - September 28, 2025

1 Job

1003 Travel rates. Travel costs need to be approved in advance by the COR. The Contractor shall be required to provide their travel

2024 - September 28, 2025

($15,000)

($15,000)

Option 2 Option Year 2 Items: 12 Month Period of Performance

2002 Data and Technical Assistance Services

2025 - September 28, 2026

2003 Travel rates. Travel costs need to be approved in advance by the COR. The Contractor

2025 - September 28, 2026

($13,000)

($13,000)

Option 3 Option Year 3 Items: 12 Month Period of Performance

3002 Data and Technical Assistance Services

2026 - September 28, 2027

3003 Travel rates. Travel costs need to be approved in advance by the COR. The Contractor

2026 - September 28, 2027

Option 4 Option Year 4 Items: 12 Month Period of Performance

4002 Data and Technical Assistance Services

Tasks 2-6: Services in accordance with

2027 - September 28, 2028

4003 Travel rates. Travel costs need to be approved in advance by the COR. The Contractor

2027 - September 28, 2028

($7,000)

($7,000)

NAICS Code: 541512- Computer Systems Design and Related Services

Contract Type: Firm-Fixed Price

B.2 Recapitulation

Base Year $___________

Option Year 1 $___________

Option Year 2 $___________

Option Year 3 $___________

Option Year 4 $___________

Total Cost $___________

Section C - Description/Specification/Work Statement

Title: WISEWOMAN Data and Technical Assistance Services

C. 1 – BACKGROUND

Cardiovascular disease (CVD) including heart disease, stroke, and other vascular diseases, accounts for about 1 in

3 deaths per year. Around 1 in 5 who die from CVD are younger than 65 years old. Hypertension, a leading risk factor for CVD, is prevalent among non-Hispanic Black and Hispanic women at 56.7% and 36.8%, respectively.

CDC’s Well-Integrated Screening and Evaluation for Women Across the Nation (WISEWOMAN) program is at the forefront of the nation’s efforts to improve cardiovascular health for low-income, uninsured, and underinsured women. Congress authorized the WISEWOMAN program in 1993 to extend the preventive health services offered to participants of the National Breast and Cervical Cancer Early Detection Program (NBCCEDP). The intent is to expand services to address cardiovascular health concerns in a population made vulnerable through social determinants of health.

The current cooperative agreement (2018-2023) funds 30 recipients in 27 states and 3 tribal organizations. It prioritizes activities encouraging women to become informed, active participants in CVD self-management by self-monitoring blood pressure with clinical support, maintaining a healthy diet, engaging in physical activity, and smoking cessation. Given the importance of health equity, WISEWOMAN also addresses social and economic factors to help program participants achieve the best health possible by addressing social needs and the effect of unfair opportunity structures.

C. 2 – PURPOSE

The purpose of this contract is to:

1. Design, develop, construct, test, and operate the WISEWOMAN Data Management System.

2. Maintain and enhance the WISEWOMAN Data Management System.

3. Provide data management technical assistance to CDC and WISEWOMAN recipients.

4. Create reports (e.g., maps and dashboards) that review and assess program effectiveness for

WISEWOMAN recipients and national level.

Data collected through the contract will be used by CDC to assess progress on program activities and outcomes and to routinely report to Congress, CDC leadership, recipients, other stakeholders, and the public.

Recipients collect data on all WISEWOMAN services provided through their programs and submit a subset of these data to CDC in a standardized format twice annually. The data submitted to CDC for WISEWOMAN are referred to as the Minimum Data Elements (MDEs). MDEs are a set of standardized data variables tailored to this cooperative agreement and needed to ensure that consistent and complete information is collected for each

WISEWOMAN participant. The MDEs capture screening, population demographics and social support needs, clinical assessment for CVD risk factors, and healthy behavior support services (i.e., health coaching, evidence-based lifestyle programs, and tobacco cessation).

C. 3 – SCOPE OF WORK

The contractor shall provide all labor, supplies, materials, supervision and perform all services required to:

1. Design, develop, construct, test, and operate a data management and submission system

(WISEWOMAN Data System 50).

2. Maintain and enhance a data management system and prepare associated technical assistance resources to collect, validate and aggregate WISEWOMAN MDEs.

3. Prepare MDE submission data for analysis and reporting to monitor direct clinical services and outcomes.

4. Build, support, maintain, and enhance application software for reporting MDEs.

5. Develop secure websites and content for WISEWOMAN.

6. Provide direct technical assistance to CDC and recipients to support data collection and data management of MDEs.

7. Provide data management and analytical support to special projects.

8. Provide analytic datasets after each MDE submission.

9. Provide updated data dictionaries with CDC-approved data elements annually.

10. Report on progress of all contract activities.

11. Create reports (e.g., maps and dashboards) that review and assess program effectiveness for

WISEWOMAN recipients and national level.

Technical assistance includes a wide range of activities to ensure timely and accurate reporting of standardized data to monitor the program and to provide feedback for program improvement and must be tailored to the specific needs and capacity of individual recipients. Activities include but are not limited to participating in recipient site visits to exchange information for tailored technical assistance, training recipient staff on data reporting requirements and data management practices, developing and disseminating documentation and materials, translating data into information using standardized reporting formats, troubleshooting problems to prevent reporting delays or errors, providing feedback to recipients on each data submission, and providing training and assistance on contractor supported software systems and the export of standardized clinical data from local data systems.

Technical assistance provided to CDC and recipients will require knowledge and understanding of the subject matter, such as program policies and objectives, health equity concepts, co-morbid health conditions of participants, service delivery models implemented across recipients, clinical guidelines and recommendations for

CVD screening and management of abnormal findings, and evidence-based interventions as recommended by the

Guide to Community Preventive Services. This knowledge of clinical and programmatic practice must be translated to coding standards for WISEWOMAN to ensure high quality data.

The Base Year is a 12-month period to provide the design, development, and construction of a data management and submission system (WISEWOMAN Data System 50), while also ensuring to test it for proper operation and use. The Base Year will also focus on data management technical assistance. This will include collecting, submitting, and analyzing data as well as generating reports.

Option Years 1, 2, and 3 are each 12-month periods to provide ongoing maintenance and enhancement of the data system constructed in the base year, while also continually maintaining and enhancing its functionality.

Option Years 1 through 3 will also focus on data management technical assistance. This will include collecting, submitting, and analyzing data as well as generating reports.

Option Year 4 is a 12-month period to provide ongoing maintenance and enhancement of the data system constructed in the base year, while also continually maintaining and enhancing its functionality. Option Year 4 will include collecting, submitting, and analyzing data as well as generating reports on the final year data. Option Year

4 will also be a summary year and include transition and close out activities.

C. 4 – TASKS TO BE PERFORMED

Task 1: Design, develop, construct, test, and operate a data management system (WISEWOMAN Data

System 50), and create associated operating procedures (for the base year 12-month non-severable contract line item) as follows:

At a minimum, the data management system (WISEWOMAN Data System 50) (Deliverable #1.a) must:

1. Contain at least all WISEWOMAN Minimum Data Elements as well as customizable fields for recipient use.

2. Be able to generate reports or graphical representations directly from the WISEWOMAN Data System 50, (e.g., validation reports, regional or national benchmarks) as well as be able to integrate commonly utilized third-party applications (e.g., Tableau, Power B.I, etc.). Such reports can be run on demand by program staff. These may be shared with internal and external stakeholders.

3. Have a customizable interface to ensure compatibility with both the CDC cloud environment and leverage

CDC IT resources and CDC IT synergies as well as varied recipient platforms.

4. All new information systems development or major enhancement tasks supported by the contractor should utilize CDC’s North Star Architecture as a “blueprint” to guide any decisions on technologies and processes and projects must be reviewed and approved by NCCDPHP’s local governance, the CDC

Information Technology and Data Governance (ITDG) Board and the CDC Architectural Review Team

(ART). All IT projects must follow the CDC EPLC framework and methodology, pass each review as appropriate, and meet all conditions outlined during the stage gate, ITDG, and ART reviews. The work must be in accordance with the HHS Contract Closeout Guide (2012). CDC EPLC requirements may be located here: https://www2a.CDC.gov/CDCup/library/other/eplc.htm.

5. Contractors should utilize CDC’s North Star Architecture as a “blueprint” to guide any decisions on technologies and processes. The North Star Architecture is a critical piece to advance interoperability for public health. While the specifics of the North Star Architecture are still in development as of January

2023, the contractor should consult NCCDPHP’s Office of Informatics and Information Resource

Management (OIIRM) on the latest requirements.

6. Contractors should utilize CDC’s Microsoft Azure cloud environment for new IT projects. All services must be FedRAMP authorized. All new projects must align with CDC’s North Star Architecture and receive approval from CDC’s IT and Data Governance before development decisions are finalized.

Offeror shall provide CDC with a project plan and corresponding IT project plan and corresponding project schedule for the design (including requirements gathering), development, construction, testing (including engagement with recipients), and operation of the WISEWOMAN Data System 50. (Deliverable #1.b)

Task 2: Ensure data management system functionality and continually maintain and enhance the system and related operating procedures (for the base year and all option years) as follows:

The Offeror shall ensure the functionality of the data management system and maintain and enhance all software systems and computer programs through the base year and all option years. The functionality includes collection and reporting of quality Minimum Data Elements (MDE) data for all WISEWOMAN recipients through a secure web-based system where data will be stored on a secured CDC server. Computer files, programs and systems provided for CDC or recipient use will be provided using software products that meet CDC standards or as specified by the Government. The Offeror shall:

1. Provide a description of file editing procedures, control systems, quality assurance protocols, automated log procedures, and samples of output data and reports. Procedures must maximize success in processing

MDE data from recipients. (Deliverable #2.a)

2. Maintain documentation on procedures, computer programs, analysis files, MDE data sets and related subsequent reports.

3. Update computer programs and code quarterly, or as needed, to support requirements, functionality, and changes to content or format of the MDEs, validation, submission processes, and other enhancements as specified by the Government.

4. Develop, test, and implement electronic MDE data quality check boxes in the data management system to ensure data quality before the MDE file is submitted by recipients. Once verified the data submission portal will appear.

5. Develop capacity to generate basic electronic reports including but not limited to national and recipient specific executive summaries, reports, and infographics in the CDC data management system for internal and external stakeholders.

6. Maintain data system documentation to allow for easy and prompt changes or resolution of any problems identified. Documentation for CDC users should include at a minimum

a. A design document providing a detailed description of the procedures, and computer programs, analysis files, MDE data sets and MDE reports.

b. A sample of all documents generated by the system.

c. Test data and test results for verification and MDE data quality assurance.

https://www2a.cdc.gov/CDCup/library/other/eplc.htm

d. Create files names which include submission date. These names must be organized by a standard, sequential file naming convention with appropriate version number.

Subtask 2.1: Website Design and Development of data system

1. The Offero shall follow the DHHS Enterprise Performance Life Cycle (EPLC) framework which will provide a standard structure for planning, managing, and overseeing IT projects over their entire life cycle. All IT projects in support of this task must adhere to the EPLC requirements, pass each Stage Gate as appropriate, and must be reviewed and meet all conditions required by CDC Information Technology and Data Governance (ITDG) Board and the CDC Architectural Review Team (ART). More information about EPLC can be found at Policy for Information Technology (IT) Enterprise Performance | HHS.gov.

2. The Offeror shall comply with all relevant Health and Human Services (HHS), Centers for Disease

Control and Prevention (CDC) physical and information technology security policies, standards, and requirements as outlined in the Information Security Requirements.

3. The Offeror shall provide Website design, development, and maintenance services for MDEs, MDE management, MDE data validation tools, MDE reports, and other related tasks. Develop and maintain tools to provide authorized users with easy and timely access to MDE and other relevant information.

Final architecture will be dependent on ART review and ITDG approval. (Deliverable #2.b)

a. All website development by the Offeror shall be designed within the CDC approved template formats. The website services will be conducted using the User-Centered Design methodology to identify and develop/document requirements, user profiles (with different levels of access) and scenarios of use, detailed wire frames, iterative user testing (including study design, data analysis, and design recommendations) and a full range of available features as appropriate.

4. The Offeror shall maintain security of all data on network, web servers, and external medium that meet

CDC standards. The Offeror shall develop and maintain capacity accordingly. Location of data must be accounted for and secured at all times.

a. DATA RIGHTS: The Government has unlimited rights to all documents/material or other products produced under this contract. All documents, materials, or other products, to include the source codes of any software, produced under this contract will be Government owned and are the property of the Government with all rights and privileges of ownership/copyright belonging exclusively to the Government. These documents and materials may not be used or sold by the

Offeror without written permission from the Contracting Officer. All materials supplied to the

Government will be the sole property of the Government and may not be used for any other purpose. This right does not abrogate any other Government rights. Government retains the right to all data and all data must be turned over to the Government at termination as detailed in the

Transition Activities clause

b. General Security Requirements.

The Contractor (and/or any subcontractor) shall comply with information security and privacy requirements, Enterprise Performance Life Cycle (EPLC) processes, and HHS Enterprise

Architecture requirements to ensure information is appropriately protected from initiation to expiration of the contract. The EPLC framework provides a standard structure for planning, managing, and governing IT projects from concept to disposition. The framework consists of ten phases to review the project’s management quality, soundness, and technical feasibility remain adequate, and the project is ready to move forward to the next phase. Within each phase, the activities, responsibilities, reviews, and deliverables are defined. All new information systems development or major enhancement tasks supported by the contractor should utilize CDC’s North

Star Architecture as a “blueprint” to guide any decisions on technologies and processes and projects must be reviewed and approved by NCCDPHP’s local governance, the CDC Information

Technology and Data Governance (ITDG) Board and the CDC Architectural Review Team (ART).

All IT projects must follow the CDC EPLC framework and methodology, pass each review as https://www.hhs.gov/web/governance/digital-strategy/it-policy-archive/policy-for-information-technology-enterprise-performance.html appropriate, and meet all conditions outlined during the stage gate, ITDG, and ART reviews. The work must be in accordance with the HHS Contract Closeout Guide (2012). CDC EPLC requirements may be located here: https://www2a.CDC.gov/CDCup/library/other/eplc.htm.

c. CDC Cloud Smart Strategy Implementation

Contractors should utilize CDC’s North Star Architecture as a “blueprint” to guide any decisions on technologies and processes. The North Star Architecture is a critical piece to advance interoperability for public health. While the specifics of the North Star Architecture are still in development as of January 2023, the contractor should consult NCCDPHP’s Office of Informatics and Information Resource Management (OIIRM) on the latest requirements.

Contractors should utilize CDC’s Microsoft Azure cloud environment for new IT projects. All services must be FedRAMP authorized. CDC offers the Enterprise Data Analytics and

Visualization (EDAV) platform as an enterprise-wide solution for the Agency’s data analytics and visualization needs. EDAV supports a series of tools to prepare, transform, and analyze data as well as ingest, store, and visualize data from a single location. EDAV should be considered first for all data processing. The contractor should consult NCCDPHP’s Office of Informatics and Information

Resource Management (OIIRM) for accessing the EDAV platform and other cloud services. All new projects must align with CDC’s North Star Architecture and receive approval from CDC’s IT and Data Governance before development decisions are finalized.

5. Develop and maintain tools to provide authorized users with easy and timely access to MDE, MDE documentation, MDE Reports, and other relevant information. Authentication of users will leverage current enterprise-based authentication methods.

6. At the request of the COR, the Offerors will provide limited website usability testing that meets OMB

Usability Requirements to assure that DHHS/CDC supported websites are well-engineered, usable (easy, efficient, and effective tools), accessible, meet the needs of its users, and present information in a manner that is easily understood and digested by CDC and its recipients. If deemed more suitable by CDC, the usability testing and resulting design recommendations may be conducted internally, depending on CDC availability of resources.

7. Mobile Viewport Accessibility (Deliverable #2.c)

a. Mobile Viewpoint Accessibility must comply with CDC-related technical and security standards, processes and procedures as stated in the IT Security section of the RFTOP. In addition, the following considerations should be addressed in the proposal:

i. Viewport accessibility through iPhone, iPad, Android, etc.

ii. Approach to 508 compatibility for the platform of choice

Subtask 2.2: Complete Data File Synthesis

1. The data collected by the data management system hosted securely on the web will be stored on secure CDC servers. This data will be compiled by Offerors into complete national datasets which will be sent to CDC Technical Monitor or his/her designee in a secure manner as per federal security standards. Software code used to create data analysis sets will be provided as SAS datasets (.sas7bdat) unless otherwise specified by the Government.

a. After each MDE submission, Offeror shall create and send CDC cumulative MDE SAS analysis files used to create feedback reports and other analysis files as specified by the Government.

Analysis files will contain cumulative data records, edited with corrected and calculated variables, as specified by the Government. Files will be provided as SAS datasets, with labeled and formatted variables, accompanied with a copy of the original SAS program, SAS format library, log and output, and additional information that recipients may have submitted regarding their submission. Analysis files will be provided to CDC within 15 days following the submission deadline. (Deliverable #2.d)

i. Offeror shall provide CDC with a copy of all original unedited files within two weeks following each data submission deadline. During this time period the Offeror delivers all https://www2a.cdc.gov/cdcup/library/other/eplc.htm programs’ raw data files, and combined summary of analysis files, and the submission forms to CDC for initial quality assurance period.

2. Offeror shall maintain documentation on systems, procedures, computer programs, analysis files, MDE data sets noted by sequential file naming conventions and versions approved by CDC. This will extend to the MDE reports which are produced from the MDE data.

3. The preliminary and final MDE files are to be stored separately using a clear file naming convention. Stored MDE files from different submission periods must not be overwritten.

Subtask 2.3: Data Specifications

1. The Offeror shall document algorithms to measure, clean, validate, analyze, and report MDE data, including MDE data, performance measures, ASCVD risk scores, outcome data, and other items deem necessary. Further Offeror shall explain the nuances of missing data, and data anomalies in a data quality report.

a. Offeror shall provide monitoring and resolution for data submission and data quality problems.

i. Resolve data anomalies, inconsistencies and problems, answer data related questions from programs and CDC. Data anomalies may occur at each submission and may require further investigation as requested by the Government.

ii. While most data anomalies, inconsistencies, problems, and data related questions may be resolved with routine statistical analyses and statistical support, some issues may require significantly more intense and sustained statistical analyses and support. Instances requiring major statistical analyses and support are limited to 8 per contract year.

b. The Offeror shall provide, up to quarterly, the MDE Edits Program

Validation tool algorithms through a spreadsheet and this spreadsheet should be in sync with the most current MDE Manual. (Deliverable #2.e)

i. The Offeror shall work with recipients to correct specific errors noted by MDE Edits

Program Validation tool, such as duplicate records, alert values, miscoded values, or other data anomalies prior to creation of data analysis files. Document changes, distribute, or make this information available to CDC and programs.

c. The Offeror shall validate the MDE submission data using the MDE Edits

Program Validation tool. This process must produce a user-friendly data quality report accessible by the recipients and government. (Deliverable

#2.f)

i. Identify, monitor, and evaluate data quality problems and inform CDC of all issues and concerns at the time of or prior to the data submission.

ii. Update MDE edits program when errors have been identified by internal or external stakeholders.

iii. The Validation report must contain elements that help recipients improve their MDEs prior to submission in a user-friendly fashion.

1. The validation report will contain the error score, performance measures, frequency charts or graphs, outcome information, and other mutually agreed upon items.

d. Offeror shall maintain the MDE Edits Program Validation tool and make it available in the data management system. Offeror shall be able to easily facilitate changes to the validation tool. The majority of the range and logic edits evolve directly from the coded responses and the skip patterns specified on the MDE Data Definition Tables. The MDE Edits Program

Validation tool reports the results of the validation by error type (range, logic, and consistency), summary and percentages of errors, and procedures to clean the data of incorrect responses and duplicated screening results.

Subtask 2.4: Creation, maintenance, and enhancement of EMR inventory

1. By the end of the base year, the Offeror shall create an EMR/EHR inventory (Deliverable #2.g). Work on development of the EMR/EHR inventory should progress concurrently with the development of the

WISEWOMAN Data System 50 along with a document that outlines the system’s features and how North

Star Architecture will be leveraged for abstraction.

2. Maintain and update EMR/EHRs system documentation two times per year after each MDE submission to allow for easy and prompt changes or resolution of any problems identified. Documentation for CDC users should include at a minimum:

a. a detailed description of the EMR/EHR

Task 3: Provide Data Management Technical Assistance to CDC and WISEWOMAN recipients for the base year and all option years) as follows:

For the base period and all option periods, technical assistance for data management provided by the Offeror shall help CDC ensure the accuracy of Minimum Data Element (MDE) submissions “by WISEWOMAN recipients. Technical assistance to recipients includes resolving data anomalies, issues with edits in the data validation code or program, identifying inconsistencies and problems in data, answering data-related questions, and submitting documentation twice annually of technical assistance provided in the base period.

Technical assistance for CDC and recipients

By providing the following, the Offeror shall provide immediate and ongoing technical assistance to CDC and its recipients annually:

1. Supporting for the CDC data management system

2. Supporting the data validation code or program

3. Detecting and resolving problems prior to MDE submission.

4. Detecting and resolving problems corrected after MDE submission.

5. Detecting, monitoring, and resolving data quality problems over each year of the project performance period.

6. Support two webinar/conference call training presentations to recipients per year.

Subtask 3.1: Technical Assistance Communication with Recipients

1. The Offeror shall provide proactive or reactive technical assistance to recipients. The Offeror shall provide a summary of meeting agendas, notes, decision logs, and action items for all technical assistance provided.

(Deliverable #3.a) The Offeror shall attempt to resolve as many requests, as possible, with in one working day but take no longer than 10 working days.

a. When phone calls are needed these parameters are to be considered:

i. Annually up to 300 technical assistance calls total across all recipients. Technical assistance meeting agendas, decision logs, and action items are required to be delivered to the COR/technical monitors within three working days of the meeting. The length of these calls should not exceed 30 minutes unless otherwise directed by the COR or designee. Focus of technical assistance calls will include, but not be limited to, assistance with the data system, data management, data collection, data submission, as well as statistical support.

b. In exceptional cases where in-person technical assistance is required allow up to five (1-2 day) site visits with recipients, with at least one contractor staff person, at the request of the COR or designee.

i. Alternatively, at the request of COR these one day visits may be used by contractor to discuss ongoing progress, management reviews, or kick-off meetings.

Subtask 3.2: Technical Assistance Communication with CDC

1. Each month, the Offeror shall provide CDC with an aggregated summary of technical assistance provided to recipients during the previous month. (Deliverable #3.b)

Subtask 3.3: Technical Assistance for Data Quality Assurance After Submission

1. The Offeror shall receive, log and process MDE data submission and related forms from recipients. These submission forms may include important information that impacts data quality. (Deliverable #3.c)

2. Following data submission from recipients, Offeror shall identify all data with missing, blank, ambiguous, or inconsistent recipient data. These issues are aggregated by recipients to produce recipient-specific data quality reports. These reports will be shared with the recipient and may result in re-submission.

(Deliverable #2.f)

a. Minimal or substantial issues may arise, which can require tailored approaches for data quality assurance.

Subtask 3.4: Technical Assistance Summary Document

1. Document all technical assistance contacts in a summary document to CDC no more than two times per contract year. This should include a summary of all emails, all telephone calls, face-to-face conversations, and written technical assistance to recipients. Documentation should include, but is not limited to, the date, contact name, recipient, technical assistance needs, action taken, further action needed, name of person who initiated technical assistance, and identify person who provided technical assistance.

(Deliverable #3.d)

a. Documentation of all technical assistance contacts will be provided to CDC in required Progress

Reports two times per year in a format that is agreed upon with the government.

b. COR approval/disapproval will be provided within 30 days of receipt.

Subtask 3.5: Technical Assistance Materials

Subtask 3.5a. MDE Manual:

1. Offeror shall update on a quarterly basis the MDE manual which should be in sync with the most recent

MDE validation edits spreadsheet indicating the logic of MDE Edits Validation program. The government expects minimal, minor updates to the existing manual. (Deliverable #3.e)

2. Offeror shall provide assistance for the planning and production of a new MDE Manual to support the next edition of the MDE manual.

Subtask 3.5b. Other Technical Assistance Materials

1. Offeror shall develop new technical assistance materials or revise existing technical assistance materials to assist recipients with data related issues. Examples of these materials can be data collection, data submission, data analysis, data reporting, and definitions and performance measures. In the base year, CDC does not expect more than six new technical assistance materials. The Offeror shall submit copies of technical assistance materials to the COR for approval. (Deliverable #3.f)

2. Offeror shall, up to two times per year, at the discretion of the COR, will participate in all-recipient calls to provide MDE related support and/or national MDE updates.

Subtask 3.6: Expectations of Contractor Technical Assistance Staff

1. Technical Assistance staff are expected to participate in:

a. Same-day response CDC requests, when possible.

b. Participate in on-site meetings at CDC when requested, once per year.

c. Participate in recipient meetings when requested by CDC, once per year.

d. Present at recipient webinars or meetings when requested by CDC, four per year.

e. Provide programming and statistical support when requested by CDC up to eight times per year.

Task 4: Create reports (e.g., maps and dashboards) that review and assess program effectiveness for

WISEWOMAN recipients and national level; develop and create presentations and publications to share

WISEWOMAN data (for the base year and all option years) as follows:

Subtask 4.1: Preliminary MDE Reports:

1. Offeror shall develop and produce standard sets of quality assured preliminary MDE reports created in

Microsoft Word (or other appropriate document software) adapting agreed upon formats (such as data visualization, graphics, etc.) after each submission for both national/aggregate data and individual recipient data. (Deliverable #4.a)

a. Draft MDE Reports will be sent to the CDC before the MDE Report is reproduced, and Offeror shall be an active participant in the data quality assurance process for the draft MDE reports.

Offeror shall translate necessary programing code to SAS or another programming language at the government’s request.

i. Up to three, 60 minute screen-sharing meetings/presentation on CDC approved platforms, may be necessary, per MDE submission. (Deliverable #4.b) These could be webinars/conference calls, all–program calls for recipients, or at any other time deemed appropriate by CDC.

b. Reports will meaningfully describe key program metrics, outcome information, program performance, and other items deemed necessary by the government. These reports will be electronic, and a series of double-sided infographics which are user-friendly.

i. The Offeror shall include national/aggregate data, individual recipient data, and as appropriate, a comparison of data across programs/recipients

c. These reports will be produced for government (national report) and each recipient (recipient reports). Initial reports are considered to be preliminary.

d. Preliminary reports are to be posted on the data management system within 90 calendar days after the end of the submission period.

2. Develop a dissemination plan for MDE related findings that includes strategies via peer review, non-peer review, professional conferences, and/or other documents that focus on building a stronger evidence base for specific WISEWOMAN Program strategies and interventions. (Deliverable #4.c)

Subtask 4.2: Final MDE Reports:

1. Offeror shall prepare quality assured final MDE reports using finalized data within 90 calendar days of the end of the cooperative agreement after the final MDE submission. These reports are expected to be identical to the preliminary reports. (Deliverable #4.d)

Subtask 4.3: Ad hoc Reports and Presentations

1. Offeror shall periodically be asked to provide no more than two ad hoc reports for aggregate/national data

(Deliverable #4.e) and one type of recipient-specific ad hoc analysis report for each recipient

(Deliverable #4.f) per base year and all option years, which are of value to the government.

2. Create one presentation and co-present on a mutually agreeable topic related to data. These could be webinars/conference calls, all–program calls for recipients, or at any other time deemed appropriate by

CDC. (Deliverable #4.g)

Subtask 4.4: Publications

1. Offeror would contribute to publishable quality articles for peer-reviewed journals. These publications will be led by CDC staff or led by CDC identified recipients.

2. Articles published during contract year will be subject to CDC clearance protocols. Revisions may be deemed necessary.

Task 5: Management or Operational Activities for Tasks 1, 2, 3, and 4. Develop and maintain adequate project management systems in support of the contract deliverables and tasks (for the base year and all option years) as follows:

1. Offeror shall create and submit monthly updates for required Gantt Charts containing tasks and deliverables. A Gantt chart illustrates the start and finish dates of the terminal elements and summary elements of a contract period. (Deliverable #5.a)

2. The Offeror shall provide, at the conclusion of each month, a monthly progress report(s) that contain, at minimum: a) progress made during the month; b) problems encountered during the month; c) problems resolved and the resolution; d) work planned for next month; e) timeline issues to be addressed; f) funding report including: funds expended to date; funds remaining; anticipated funds expended during the next 60 days and projected cost overruns; g) deliverables submitted; and h) actions/items required by the

Technical Monitor(s). These monthly progress reports will be submitted along with each monthly invoice.

(Deliverable #5.b)

3. Offeror shall develop and implement quality assurance processes to support high quality, accurate products.

4. Offeror shall develop quick response systems to support and address CDC requests and concerns.

5. Offeror shall provide ongoing consultation to CDC.

6. Offeror shall participate as a member of the CDC Data Team.

a. The CDC Data Team expects to communicate with the Offeror regularly. This could be primarily through telephone and email correspondence which could vary in frequency from daily to weekly.

b. Communication will be scheduled in advance or initiated by the Government or offeror.

c. Contracting staff must include all necessary personnel requested by the COR. This includes, but is not limited to, Program Manager/administrative support, statistical support, web develop and hosting support, and technical assistance staff.

d. Offeror shall prepare meeting agendas, keep a decision log, and provide written meeting minutes which include action items from data conference calls. (Deliverable #5.c)

i. Offeror shall deliver the agenda at a minimum of 24 hours prior to a meeting

ii. Offeror shall document participation in meetings and consultation with CDC technical staff about key issues.

iii. Offeror shall deliver the decision log and meeting minutes with action items to the

COR and Technical Monitor(s) within 5 working days following the data conference calls.

7. Offeror shall participate in on-site CDC meetings up to two times annually, for a one day visit at the request of the COR for management reviews and to discuss progress on new and ongoing projects.

8. Offeror may travel up to five times, annually, for 1 to 2 days visits to provide technical assistance to recipients for data technical assistance.

a. The Government reserves the right to require Offeror to make additional trips if and when required.

Task 6: Transition Activities (for option year 4) as follows:

1. Submit electronically to CDC on a format as specified by CDC:

a. If not already submitted prior to option year 4, Offeror shall provide any additional original, unedited data, as well as final materials (e.g., files, resources, program reports, program report templates and code, detailed description of EHR/EMR used, technical assistance documentation, technical assistance logs, data system software, etc.) across Tasks 1, 2, 3, 4, and related subtasks.

All materials will be sorted, as applicable, by recipient and date of report. (Deliverable #6.a)

b. Preliminary and final files of all edited and analyzed MDE data as .sas7bdat files. (Deliverable

#6.b)

c. Quality assured final MDE reports using finalized data within 90 calendar days of the end of the cooperative agreement after the final MDE submission. These reports are expected to be identical to the preliminary reports. (Deliverable #6.c)

2. All programming code for computer based reports and web-based applications, including but not limited to MDE Edit Program, WISEWOMAN Data System 50, and EPLC disposition requirements as directed by CDC. (Deliverable #6.d)

a. Surrender the WISEWOMAN website name, address, and all related content to the Government.

3. The Offeror shall provide a technical assistance summary report for the duration of the period the Offeror has provided technical assistance before the end of the cooperative agreement. This report should include a cumulative summary of the technical assistance issues, their priority hierarchy, and resolution as well as recommendations going forward. (Deliverable #6.e)

4. At the conclusion of the recipient project period Offeror shall provide one final five-year national/aggregate MDE report, one final five-year national/aggregate executive summary, and one final five-year national/aggregate infographic to CDC within 30 days of contract closeout. (Deliverable #6.f)

C. 5 – GOVERNMENT FURNISHED MATERIALS

There will be no government furnished materials or property.

C. 6 – PERIOD OF PERFORMANCE

The performance period is 09/29/2023 – 09/28/2028.

Data and Technical Assistance Services + Travel

Base Year: 9/29/23 – 9/28/24

Option Year 1: 9/29/24 – 9/28/25

Option Year 2: 9/29/25 – 9/28/26

Option Year 3: 9/29/26 – 9/28/27

Option Year 4: 9/29/27 – 9/28/28

C.7-PLACE OF PERFORMANCE:

This work is to be performed off-site at the contractor’s remote location(s). For certain work-related activities or meetings, select contract staff will need to be in person at an Atlanta-area CDC campus.

C.8 – DELIVERABLES/REPORTING SCHEDULE

The Contractor shall furnish the Government the following items in the quantities and during the time period listed below. All deliverables are to be provided to the CDC COR or designee. Deliverables are provided electronically in a format specified by the delivery schedule table or as requested by the COR.

Where indicated in the schedule below, deliverables are also provided to all WISEWOMAN recipients.

One copy of the Quarterly Progress Report shall be submitted to the CDC Contracting Officer.

Base Year through Option Year 4

Deliverables, SOW Reference Quantity Delivery Date

Task #1: Design, develop, construct, test, and operate a data management system (WISEWOMAN Data System

50), and create associated operating procedures (for the base year 12-month non-severable contract line item)

a. WISEWOMAN Data System

b. IT project plan and a corresponding project schedule

a. 1 to COR/Technical Monitors

b. 1 to COR/Technical Monitors

a. By the end of the base year

b. At least 14 calendar days prior to commencing work on IT system in the base year Task #2: Ensure data management system functionality and maintain and enhance the system and related operating procedures (for the base year and all option years)

a. Description of file editing procedures, control systems, quality assurance protocols, automated log procedures, and samples of output data and reports.

b. WISEWOMAN Data

Management System 50 web-based user interface tools (i.e., website design, development, hosting, etc.)

c. Mobile Viewport Accessibility

d. Aggregate MDE analysis files

e. Spreadsheet of MDE Edits

Program Validation tool algorithms

f. Data quality report

g. EMR/EHR inventory a – g. 1 to COR/ Technical

Monitors exception is f. 1 report for recipient per MDE submission and 1 to

COR/Technical Monitors

a. Within 180 calendar days after the start of the WISEWOMAN cooperative agreement

b. By the end of the contract base year

c. By the end of the contract base year

d. Within 15 calendar days following the MDE submission deadline

e. Submitted concurrently with updated MDE Manual version

f. Within one week of MDE submission

g. By the end of the contract base year and updated up to two times per contract year after

MDE submission

Task #3: Provide Data Management Technical Assistance to CDC and WISEWOMAN recipients (for the base year and all option years)

Deliverables, SOW Reference Quantity Delivery Date

a. Documented technical assistance communication with recipients (i.e., related meeting agendas, decision logs, and action items from conference calls)

b. Summary of recipient technical assistance

c. Data validation document for data quality assurance

d. Technical Assistance Summary

Document

e. MDE Manual

f. Develop new technical assistance materials or revise existing technical assistance materials New tools will be limited to three per submission period/up to six

a. 1 to COR/Technical Monitors and to all participating recipients

b. 1 to COR/Technical Monitors and 1 to Contract Officer

c. 1 to COR/Technical Monitors

d. 1 to COR/Technical Monitors

e. 1 to COR/Technical Monitors

f. 1 to COR/Technical Monitors of each material developed

a. Agenda is to be provided a minimum of 24 hours prior to weekly phone conference.

Decision log and meeting minutes provided within 3 working days of the meeting.

Through the entirety of the contract.

b. Monthly

c. Within 14 calendar days after the MDE submission. Through the entirety of the contract.

d. 2 per year for the entirety of the contract

e. Creation of MDE Manual within 3 months of the contract award. Updated MDE Manual annually thought the entirety of the contract.

f. 4 weeks prior to MDE submission date

Task #4: Create reports (e.g., maps and dashboards) that review and assess program effectiveness for

WISEWOMAN recipients and national level; develop and create presentations and publications to share

WISEWOMAN data (for the base year and all option years)

a. Recipient and aggregate reports

(e.g., executive summaries, dashboards, MDE reports, etc.)

b. Presentations per MDE submission

c. MDE Dissemination Plan

d. Final Aggregate MDE report

e. National/aggregate ad hoc reports

f.…