Special Notice 75N91020Q00137.pdf

Title: Development of Educational Materials that Showcase Concepts for Mapping Statistical Estimates with Reliability Information

Document Type: Special Notice

Solicitation Number: 75N91020Q00137

Posted Date: 08/18/2020

Response Date: 08/28/2020

Classification Code: R499 – Support-Professional: Other NAICS Code: 541990 – All Other Professional, Scientific, and Technical Services

Contracting Office Address:

Department of Health and Human Services, National Institutes of Health, National Cancer Institute, Office of Acquisitions, 9609 Medical Center Drive, Room 1E136, Bethesda, MD

20892, UNITED STATES.

Description:

The Surveillance Research Program in the Division of Cancer Control and Population Sciences (DCCPS) at the National Cancer Institute (NCI) requires services to develop educational materials that showcase the class separability classification method used in the SEER Choropleth Mapper (SEER*CMapper) tool.

Since mapping is a popular means to visualize and analyze health statistics, both the public and the public health community need to be well informed about basic map classification concepts and concepts related to spatial data uncertainty. With these basic understandings, DCCPS can demonstrate the utilities of the class separability method to map estimates with error, particularly the SEER*Stat data and other health statistics. As NCI is one of the major government agencies in disseminating large quantity of health and population data to the public and the globe, the NCI portals will be appropriate and effective venues to demonstrate and promote good mapping practices dealing with spatial data uncertainty

The Office of Acquisitions (OA) plans to procure, on a sole source basis, support services to develop materials to educate the public about the class separability classification method and to showcase its utilities from the COMStar Computing Technology Institute (12978 Tory Gate Court, Haymarket, VA 20169).

The response close date of this notice for this requirement is in accordance with FAR 5.203(a)(1). This acquisition will be processed under FAR Part 12 – Acquisition for Commercial Items and will be made pursuant to the authority in FAR 13.106-1(b)(1)(i) using simplified acquisition procedures for commercial acquisitions and is exempt from the requirements of FAR Part 6. The North American Industry Classification System code is 541990 – All Other Professional, Scientific, and Technical Services.

One award will be issued under this solicitation.

BACKGROUND

Health statistics, including various morbidity and mortality rates, are often displayed and analyzed with choropleth maps. However, traditional choropleth mapping practice assumes that mapped values are relatively accurate, ignoring the error statistics (such as standard error or margin of error) associated and reported with the estimate. The class separability method was developed to determine class breaks in choropleth maps. These class breaks produce the maximum levels of separability between estimates in different classes by also considering the error associated with each estimate. DCCPS implemented the classification method in a stand-alone program, SEER Choropleth Mapper (or SEER*CMapper) to support choropleth mapping of data downloaded from SEER*Stat.

Error in spatial data have been a prominent research topic since early 1990s. But the impacts of estimate error on mapping has not been discussed systematically until early 2010. However, the public, even academics are not well aware of the negative ramifications of mapping data without considering estimate error. Therefore, there is a need to educate the public, especially those users of health statistics employing maps to present data or conduct spatial analysis, about the detrimental impacts of ignoring estimate error in the processes.

SCOPE

The scope of this contract shall include 1) developing materials to illustrate choropleth mapping and basic map classification concepts; 2a) demonstrating the repercussions of failing to consider estimate error in compiling choropleth maps; 2b) illustrating how the class separability classification method can map estimates by considering their error statistics; 3) submitting all materials to the NCI Technical Point of Contact (TPC) for dissemination via the NCI web-based SEER tools and platform; and 4) providing the NCI TPC with all back-end information necessary to ensure web-formatting compatibility of the class separability classification method on the NCI web-based SEER tools and platform and reporting on the work performed.

CONTRACT REQUIREMNETS

Independently, and not as an agent of the Government, the Contractor shall furnish all necessary labor, materials, supplies, equipment, and services not otherwise provided by the Government to perform the following tasks:

Task 1: Compile materials to show basic choropleth mapping principles and map classification concepts

To target the public and public health community, the Contractor shall compile basic choropleth mapping principles and concepts on map classification. Besides concisely explaining these principles and concepts, the Contractor shall use NCI-managed SEER data and other health data examples to illustrate these principles and concepts.

Task 2a: Demonstrate the potential problems of mapping without considering estimate error

Maps are often used to reveal spatial patterns to support qualitative analyses. Using NCI-managed SEER data and other health data, the Contractor shall develop several examples to show how ignoring estimate error when compiling choropleth maps, the resultant maps may mislead the readers to believe that something is true but in fact it may not.

Task 2b: Illustrate how the class separability classification method can consider estimate error in mapping

Although the class separability classification method is documented in the literature, the concept may be beyond the comprehension of the public and many public health researchers. The Contractor shall compile comprehensible materials, including examples to illustrate how the classification method can produce informative choropleth maps, acknowledging the error in data and providing certainty information about the mapping results.

Task 3: Organize and submit the materials completed for tasks 1 & 2 to the NCI Technical Point of Contact (TPC) to be disseminated through the selected NCI web-based SEER tools and platform

The Contractor shall assemble and submit all materials developed for tasks 1 & 2 to the NCI Technical Point of Contact (TPC). Following review and acceptance by the TPC, the submitted materials will be hosted by the NCI web-based SEER tools and platform and thus educational information will be disseminated to the public.

Task 4: Provide the NCI Technical Point of Contact (TPC) with all back-end information necessary to ensure web-formatting compatibility of the class separability classification method on the NCI web-based SEER tools and platform and reporting on work performed.

To ensure web-formatting compatibility of the class separability classification method on the NCI web-based SEER tools and platform, the Contractor shall provide the NCI TPC all necessary back-end information, such as algorithms and the source codes of SEER*CMapper. The TPC shall manage the incorporation of materials into the existing NCI web-based SEER tools and platform. The Contractor shall support the NCI TPC during the implementation process by being responsive to all requests for input on the design of interfaces, map rendering designs, and annotating the results. The consultation may start whenever the NCI TPC is ready. The TPC is the final determining voice for all design and implementation decisions regarding the NCI web-based SEER tools and platform. The Contractor shall report to the Technical Point of Contact on all work performed as outlined in the deliverable schedule.

DELIVERABLES AND DELIVERY SCHEDULE

DELIVERABLE DELIVERABLE DESCRIPTION DUE DATE

Task 1: Draft Digital Tutorial

A draft Digital Tutorial that shall highlight basic principles of choropleth map and explain the concepts of popular map classification methods as outlined in Task 1.

The draft tutorial is subject to Technical Point of Contact (TPC) review and commentary.

The Contractor shall perform subsequent edits until the draft is approved by the TPC

The draft shall be an electronic document.

Acceptable formats include Microsoft Word, Excel, or PowerPoint; or Adobe PDF.

Submit to Technical Point of Contact (TPC) 90 days After Receipt of Order (ARO).

Subsequent comments on the draft must be addressed within 2-weeks of receipt from TPC

Task 2a: Draft Examples that Demonstrate Ignoring Estimated Error

A draft set of studies or examples of maps using SEER*Stat data and other health statistics to show the misleading results when estimate error is ignored when compiling the maps as outlined in Task 2a.

The draft set of examples is subject to Technical Point of Contact (TPC) review and commentary. The Contractor shall perform subsequent edits until the draft is approved by the TPC

The draft shall be an electronic document.

Acceptable formats include Microsoft Word, Excel, or PowerPoint; or Adobe PDF.

Submit to Technical Point of Contact (TPC) 150 days After Receipt of Order

(ARO).

set of examples must be addressed within 2-weeks of receipt from TPC

Task 2b: Draft Examples that Demonstrate Application of Class Separability Method

A draft set of studies or examples of maps using SEER*Stat data and other health statistics with the class separability method applied to produce informative results as outlined in Task 2b.

The draft set of examples is subject to Technical Point of Contact (TPC) review and commentary. The Contractor shall perform subsequent edits until the draft is approved by the TPC

The draft shall be an electronic document.

Acceptable formats include Microsoft Word, Excel, or PowerPoint; or Adobe PDF.

Submit to Technical Point of Contact (TPC) 180 days After Receipt of Order

(ARO).

set of examples must be addressed within 2-weeks of receipt from TPC

DELIVERABLE DELIVERABLE DESCRIPTION DUE DATE

Task 3:

Finalized Digital Tutorial from Task 1 and Finalized Sets of Examples from Tasks 2a & 2b

The Finalized Digital Tutorial from Task 1 and Finalized Sets of Examples from Tasks 2a and 2b shall reflect all changes, edits and comments made by the TPC. The final versions shall be the ones that received TPC finalized approval.

The finalized documents shall be an electronic document. Acceptable formats include Microsoft Word, Excel, or PowerPoint; or Adobe PDF.

Submit to Technical Point of Contact (TPC) 5-business days after TPC approval of finalized draft documents.

Task 4: Provide back-end web information and design input

The Contractor shall be in regular communication with the NCI Technical Point of Contact (TPC) via meetings, phone calls, and email in order to provide all necessary back-end information to ensure web-formatting compatibility, as described in Task 4.

The Contractor shall be responsive to all requests for design input from the TPC.

Contractor design input is subject to Technical Point of Contact (TPC) review and commentary. The TPC is the final determining voice for all design and implementation decisions regarding the NCI web-based SEER tools and platform.

The Contractor’s back-end web-formatting information and design input shall be provided to the TPC via acceptable electronic formats such as Microsoft Word, Excel, or PowerPoint; or Adobe PDF

Monthly Progress Reports shall be submitted to TPC immediately After Receipt of Order. First Progress Report shall be a Kick-Off Report.

Quarterly Summary Reports shall be submitted to TPC starting 90 days After Receipt of Order.

Contractor back-end web info and/or design input shall be provided no more than 2-weeks after initial request from TPC.

Subsequent comments from the TPC must be addressed within 2-weeks of receipt.

Task 4:

Reporting

Final Report summarizing all work completed by the Contractor during the Period of Performance.

The Final Report shall be an electronic document. Acceptable formats include Microsoft Word, Excel, or PowerPoint; or Adobe PDF.

Final Report submitted to TPC on last day of Period of Performance.

TYPE OF ORDER

This will be issued as a non-severable Firm Fixed-Price Purchase Order.

PERIOD OF PERFORMANCE

The period of performance shall be for twelve (12) months from the date of award.

PLACE OF PERFORMANCE

Service shall be performed at the Contractor’s site.

COMStar Computing Technology Institute is uniquely qualified to perform the services outlined in the statement of work. COMStar has specialized experience with the class separability classification method, which is the key methodology applied in this project. Collaborators from COMStar have performed the work as PI and Co-PI on research projects funded by NIH, CDC, and US Census Bureau that model, quantify, and communicate uncertainty in maps. In addition, COMStar publishes maps and related risk factor data broadly. They are experienced with the variation in statistical estimates that are widely recognized but rarely presented on maps.

Given their specialized experience with the class separability classification methodology, the experts at COMStar Computing Technology Institute are uniquely qualified to lead outreach to the consumers of cancer statistics data, software, and tools, and provide education in the area of separability classification method. COMStar Computing Technology Institute has the unique and specific qualifications for performing the work requested by NCI. No other organization meets these requirements to NCI’s knowledge. Therefore, any efforts to identify the required skills and expertise through outside sources would pose variations in statistical data that would delay and add extra cost in the project.

This notice is not a request for competitive quotation. However, if any interested party, especially small businesses, believes it can meet the above requirement, it may submit a capability statement, proposal, or quotation, which shall be considered by the agency. The statement of capabilities and any other information furnished must be in writing and must contain material in sufficient detail to allow the NCI to determine if the party can perform the requirement. Responses must be received no later than 4:00PM EST, August 28, 2020. All responses and questions must be in writing and emailed to Lena Lee, Contract Specialist, via electronic mail at lena.lee@nih.gov. A determination by the Government not to compete this proposed requirement based upon responses to this notice is solely within the discretion of the Government. Information received will be considered solely for the purpose of determining whether to conduct a competitive procurement. No collect calls will be accepted. In order to receive an award, Contractors must be registered and have valid, current Entity Record, including current Representations and Certifications, in the System for Award Management (SAM) through SAM.gov. Reference: 75N91020Q00137 on all correspondence.

mailto:lena.lee@nih.gov