SB1341-15-RQ-0389_Attachment_1_Health_IT_Performance_Work_Statement.pdf

PDF 240 KB Posted Jun 9, 2015

Attached to: Health IT Standards and Testing
Solicitation number: SB1341-15-RQ-0389
Issued by: Department of Commerce National Institute of Standards and Technology

About this file

From the source

SB1341-15-RQ-0389_Attachment 1_Health IT Performance Work Statement

View the file

Other files

File	Type	Posted
SB1341-15-RQ-0389_Health_IT_Standards_ _Testing_FBO_CS-S_(Ref._15-02776)_2015-06-09.pdf	PDF	Jun 9, 2015
SB1341-15-RQ-0389_Attachment_2_Proposed_CLIN_Structure.pdf	PDF	Jun 9, 2015

On GovTribe

Work with this file

Download the original file
Contacts named in this file
Similar government files
Ask GovTribe AI about this file

Try for free Login

Text version

The file's text, extracted by GovTribe without its formatting.

Performance Work Statement Request for Quotation: SB1341‐15‐RQ‐0389

Meaningful Use Conformance Tools and Imaging Analysis for Health IT

Performance Work Statement

A. BACKGROUND

The mission of the National Institute of Standards and Technology (NIST), Software and Systems Division (SSD) is to develop software testing tools and methods that improve quality, conformance to standards and correctness. The Division also participates with industry in the development of forward‐looking standards relative to the healthcare industry. The Division's programs also respond to industry, consortia, and standards groups’ needs by concentrating on key areas at the forefront of technology and assisting in the transfer of technology and expertise to industry.

Biological research today is conducted with high‐throughput instruments that generate massive amounts of images that serve as raw data for scientific discovery. The sheer volume of images prohibit manual analysis; therefore computational methods are necessary to automate analysis and enable scientific discovery. Computational techniques have been used to identify trends or to conduct qualitative analysis. However, there are many imaging processing and analysis techniques from which to choose, all of which yield different results. This lack of robustness across a set of seemingly similar approaches remains a challenge to biological experiments, and brings into question any scientific discoveries based upon this type of analysis. Furthermore, the challenges related to high‐throughput experimentation, from image acquisition and sampling, to processing and analyses, are inherent in all imaging applications, and in particular, to the Biosciences, Materials Science, and Forensics initiatives.

To address quantitative imaging, an Imaging Testbed has been established as a collaborative effort among NIST, academia and industry to help ensure that software‐based measurement methods utilize validated, state‐of‐the‐ art capabilities while ensuring the technologies developed can be readily transferred to industry.

The initial Imaging Testbed has been developed to characterize the factors that affect quantitative measurements within the imaging acquisition and analysis pipeline. The initial testbed has been instrumental in understanding the parameters that characterize the scientific discovery information pipeline. The initial impact of image acquisition protocols, image stitching techniques, background correction, sampling, segmentation, data quality, object separation, image similarity, and tracking have been assessed for NIH 3T3, A10, and vascular smooth muscle cells.

More detailed examination of the parameters and additional cells lines that represent more challenging cell‐based discovery need to be developed and characterized. The discovery has to include stem cell research in 2D and 3D by examining various imaging modalities.

A key goal of these efforts is the development of validated software‐based measurements, associated test metrics and performance visualization to enable and expedite scientific discovery, and to contribute to the larger BIG DATA effort. To achieve this goal, NIST SSD, MML, NIH, The International Society for Advancement of Cytometry (ISAC), and the World Wide Web Consortium (WWW) are working to ensure that accurate, validated software‐based 2D and 3D measurements are well‐characterized and available to the cell science community and the broader imaging community.

This requirement seeks to contribute to the healthcare industry by advancing healthcare information standards that are complete, testable and by providing the necessary conformance tests, tests tools and techniques where appropriate. There is a real need for formal and informal coordination of these efforts to leverage the synergy of the various efforts, to harmonize vocabularies, to enable interoperability, and to promote consistent testing and certification programs across and within organizations.

The NIST SSD requires project leadership and technical staff support from the Contractor in the areas of standards and technology development and adoption, measurement, and development of software testing tools to improve the quality and correctness of software used in our nation’s critical infrastructures, such as Healthcare. This task order focuses on testing for the 2017 Edition of Meaningful Use of Healthcare technologies. The Health IT Standards Testing is a collaborative effort to help ensure interoperability among all healthcare providers, hospitals, clinical laboratories, pharmacies, payers, and others via the meaningful use criteria. NIST has developed testing tools to support the meaningful use testing.

B. PROPOSED RESEARCH AREAS AND TASKS

1. Task 1: Advanced Imaging Metrology for Scientific Applications in Health IT The NIST SSD, which has been working with the NIST Biosciences Division on this project, is requesting project leadership and technical staff support from the Contractor in the area of technology development and adoption, measurement, and development of software and hardware testing tools to improve the quality and correctness of microscopy imaging standards and adoption. The project focuses on NIST’s efforts to build computational measurement capabilities that will enable quantitative imaging for the sciences.

The demand for accurate validated imaging measurements is critical to improving our nation’s scientific discovery process such as in the Biosciences and Forensics. This research project seeks to contribute to the general state of the art for software and hardware imaging protocol standards, by advancing the development of imaging protocol standards that are complete and testable and by providing the necessary tests, tests tools and techniques where appropriate. There is a real need for formal and informal coordination of these efforts to leverage the synergy of the various efforts, to enable interoperability, and to promote consistent testing across and within organizations.

NIST SSD is collaborating with other NIST divisions in MML, industry, standards organizations, and academia to build tools and prototypes to advance the adoption of accurate software‐based measurements for imaging, and for overall efforts in BIG DATA.

The Contractor shall support NIST SSD in the collaboration with NIST MML, industry, related standards organizations, and academia to build tools and prototypes to advance the adoption of software‐based measurements for advanced imaging. Specific objectives include:

Collaborating with NIST CS‐BIO‐MET and NIH National Cancer Institute in developing software‐based measurements for imaging, metrics, and associated tests, as part of a larger NIST Imaging Testbed. Providing technical leadership in Image Acquisition and Adaptive Microscopy Measurements, 2D and 3D Data Segmentation, and Image Stitching components of the NIST Imaging Testbed.

The Contractor shall develop software‐based measurements, metrics, and associated tests for the NIST Imaging Testbed. The Contractor shall research and develop a methodology for 2D segmentation and tracking of cell interactions at multiple levels of complexity, and 3D image segmentation and stitching algorithms. The Contractor shall also develop a prototype solution for adaptive microscopy measurements based on a micromanager library that provides an easy to use interface that lets biologists run their microscopy‐based experiments.

1.1. Task 1A: Traceable image feature extraction

Design image feature extraction software that generates traceable feature values and can be integrated into a unifying framework for image measurements.

We have identified the need for designing and delivering a framework for image measurements. These image measurements denoted as features consist of software, input data, input parameters, formulas documenting measurements, and the computed image feature values. The Contractor shall design image measurements applicable to cell biology and material science microscopy images. These image features together with existing libraries of image feature extractions shall become integrated into a framework that provides access to computations and delivers feature value with traceable information about the measurement process.

Deliverables:

Command‐line executables of image feature extraction Mechanisms for integrating third party software from https://github.com/wnd‐charm/wnd‐charm and http://murphylab.web.cmu.edu/services/SLF/features.html into a unifying framework Software mechanism for monitoring execution progress Software mechanism for handling execution errors Web documentation of image features

1.2. Task 1B: Microscope control and detection of 3D objects

Automated control of confocal laser scanning microscopes (CLSM) that is followed by detection of 3D cellular objects.

There is a need to collect cellular measurements in 3D in order to simulate in‐vivo conditions. The process of collecting 3D cell data is very time consuming and automation is needed. The Contractor shall design scripts for automating confocal laser scanning microscopes by using the Micromanager library of plugins.

3D cells shall be detected in course resolution images to identify the high resolution imaging parameters [x_min to x_max y_min to y_max, z_min to z_max].

Deliverables:

Scripts that are developed using Micromanager software and operate with NIST Zeiss and Leica confocal laser scanning microscopes Methodology for computing detection accuracy and uncertainty of cellular objects summarized in MS ppt slides.

1.3. Task 1C: 3D image stitching

Design an image stitching algorithm that can be applied to 3D microscopy images

There is a need to collect cellular measurements in 3D at high resolutions. For these high resolution experiments, one cell is imaged with multiple fields of view (FOV) to include the entire cell in a data set.

The Contractor shall design an algorithm that can stitch multiple overlapping 3D images into a mosaicked 3D volume. The stitching algorithm should be explored for 3D images that are obtained by moving a microscope stage in x‐y plane and in all three x‐y‐z directions. The Contractor shall prepare for this work by performing a survey of stitching algorithms, and evaluating submissions to the stitching challenge as one part of the 2015 BioImage Informatics conference. The Contractor shall also initialize the research on optimal filtering of 3D images to maximize stitching accuracy and the research on 3D stitching evaluation.

Deliverables:

Survey of stitching algorithms for 3D images in MS Word format Evaluation of the stitching challenge submissions to the 2015 BioImage Informatics conference Software and recommendations for optimal filtering parameters to improve stitching results Software implementation for stitching 3D images from confocal laser scanning microscopy. Research methodology for evaluating accuracy of 3D image stitching.

Note: The Contractor will receive guidance from Statistics Division in the Information Technology Laboratory (ITL) and from the Cell Systems Science Group in the Material Measurement Laboratory (MML) at NIST.

2. Task 2: Implementation Guide Authoring Tool and Immunization Tool Development The demand for correct, reliable, robust and interoperable software is crucial to our nation’s infrastructures such as healthcare. In particular, online medical information and simplified, standardized methods to access healthcare information and services is crucial in making healthcare safe and available to all. Appropriate standards for healthcare information systems provide the cornerstone to achieving a healthy healthcare infrastructure. This research project seeks to contribute to the general state of the art for trustworthy software as well as to the healthcare industry specifically, by advancing healthcare information standards that are complete and testable and by providing the necessary conformance tests, tests tools and techniques where appropriate. There is a real need for formal and informal coordination of these efforts to leverage the synergy of the various efforts, to harmonize vocabularies, to enable interoperability, and to promote consistent testing and certification programs across and within organizations.

C. GENERAL REQUIREMENTS

NIST SSD is collaborating with industry, standards organizations, consortia, and government agencies to build tools and prototypes to advance the adoption of Information Technology (IT) within healthcare systems.

As requested, the Contractor shall support NIST SSD in the collaboration with industry, healthcare informatics‐ related standards organizations, consortia, and government agencies to build tools and prototypes to advance the adoption of IT within healthcare systems. Specific objectives include:

• Collaborating with Health Level Seven (HL7) members to help ensure that HL7 messaging and Electronic Heath Record systems' conformance can be defined and measured at an appropriate level.

• Providing technical leadership on 'Integrating the Healthcare Enterprise' (IHE) projects, in particular the Information Technology Infrastructure (ITI) profiles and medical device‐related profiles.

• Providing technical leadership to build a common web‐based tool set that integrates testing tools/activities of various SDOs, consortia and other organizations.

D. SPECIFIC REQUIREMENTS:

Task 2A: Maintain, update, and improve the HL7 V2 Test Tool User Interface and Execution Engine.

The Test Engine includes message generation and validation, communication, test agents, test framework, and associated support classes. The Contractor shall provide support to projects that incorporate the core services including IHE PIX/PDQ pre‐connectathon and connectathon testing, Meaningful Use Testing, Patient Care Devices (PCD) testing, NwHIN, V2 message validation and generation web applications and web services, the test case authoring and management tool (TCAMT), and the implementation guide authoring and management tool (IGAMT).

Description of Tasks:

I. Develop new features for the test tools GUI and test execution engine that supports all of the

HL7 V2, HL7 V3, and ePrescibing test tools

II. Update/Maintain/Support the HL7 test tool GUI and Test Execution

I. MU‐2 Syndromic

II. MU‐2 ELR

III. MU‐2 LRI

IV. MU‐2 Immunization

V. PIX/PDQ

VI. PCD

III. Develop/Apply GUI and test execution engine to the following new test tools:

I. MU‐3 Syndromic

II. MU‐3 ELR R2

III. MU‐3 LRI

IV. MU‐3 Immunization

V. MU‐3 LOI

VI. MU‐3 eDOS

IV. Tool Deployment and Server Support

I. Build and deploy all tools as necessary

II. Maintain deployment servers (internal and external)

Deliverables:

The deliverables for the tasks under Task 2A are:

1) Monthly Software updates implementing functionality described above

2) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

3) Build new versions of each tool and re‐deploy monthly.

4) Maintain servers for 24/7 access by industry (Software Only)

Task 2B: Lead the design and development of the HL7 V2 Implementation Guide and Authoring and Management (IGAMT) tool.

Description of Tasks:

I. Provide programming support for the Implementation Guide Authoring Tool (IGAMT) o Lead Designer/developer of the profiling component for IGAMT o Refactor source code to support a user login and database model o Develop GUI and infrastructure code for the IGAMT Profile Component o Provide integration code for users of IGAMT profile component o Provide utility to export all artifact as XML, JSON, PDF as appropriate o Provide NIST validation compatible XML and JSON Conformance Profile

II. Presentation o Provide user demonstration of tool capabilities and use o Provide on‐line help features

III. Deployment o Deploy tool on NIST Server o Provide capabilities and instructions for local download and installation

The deliverables for the tasks under Task 2B are:

1) Monthly Software updates implementing functionality described above

2) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

3) Build new versions of the tool and re‐deploy monthly.

As the program and tasks evolve, deliverable schedules may change (with the consent of all parties) to more accurately address NIST needs.

Deliverables created by the Contractor shall be presented by the Contractor at national and international forums as directed by NIST.

Task 2C: Lead the design and development of the HL7 V2 Immunization Testing Framework Prototype.

Description of Tasks:

I. Design bi‐directional Test Framework to support Immunization messaging testing o Design/improve test framework based on existing NIST PIX/PDQ test framework o Framework to support bi‐directional messaging o Support content testing (within and across messages) o Support functional testing o Support transport (CDC WSDL/SOAP Protocol)

II. Test Cases o Work with NIST developers and SMEs to incorporate Test Cases and Test Data o Incorporate associate artifacts (test stories, example message, test data specification, and message content) into user interface III. User Interface/Control o Develop the user interface o Develop the test engine to execute the test cases o Develop reporting capabilities

IV. Deployment o Deploy tool on NIST Server

The deliverables for the tasks under Task 2C are:

1) Monthly Software updates implementing functionality described above

2) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

3) Build new versions of tool and re‐deploy monthly.

As the program and tasks evolve, deliverable schedules may change (with the consent of all parties) to

Task 3: Test plan development for the family of HL7 V2 family of laboratory standards

As requested, the Contractor shall support NIST SSD in the collaboration with industry, healthcare informatics‐related standards organizations, consortia, and government agencies to build tools and prototypes to advance the adoption of IT within healthcare systems. Specific objectives include:

• Collaborating with Health Level Seven (HL7) and the Standards and Implementation Framework members to help ensure that HL7 messaging and Electronic Heath Record systems' conformance can be defined and measured at an appropriate level.

• Providing technical leadership to build a common web‐based tool set that integrates testing tools/activities of various SDOs, consortia and other organizations.

Task 3A: Create a web‐based portal for accessing the suite of HL7 v2 conformance and interoperability test tools and associated documents.

Description of Tasks:

I. Develop an interactive web‐based interface portal for describing and accessing the suite of HL7 v2 conformance and interoperability test tools and associated documents o Design interface (hover‐over design) o Design template (with metadata) for describing tool/artifact o Collect links and documents o Convert write‐ups provided by NIST to web‐based form o Create portal

The deliverables for the tasks under Task 3C are:

1) Design document (PPT)

2) Tool/Artifact Template (XML/WORD)

3) Web‐based Portal

Task 3B: Support development of the HL7 V2 Implementation Guide and Authoring and Management (IGAMT) tool.

Description of Tasks:

I. Provide programming support for the Implementation Guide Authoring Tool (IGAMT) o Development of the following components for IGAMT

User login User Preferences Message Profiling Segment Profiling Data Type Profiling Value Set Profiling Message Comparison Message Profile Comparison Artifact import/export (json, xml, pdf) o Develop GUI and infrastructure code for the IGAMT Profile Component o Provide integration code for users of IGAMT profile component o Provide utility to export all artifact as XML, JSON, PDF as appropriate o Provide NIST validation compatible XML and JSON Conformance Profile

II. Testing o Develop unit testing for each component described in I.

o Develop scenario test case that combines various workflows o Perform testing and create tickets/task on findings

The deliverables for the tasks under Task 2 are:

1) Monthly Software updates implementing functionality described above

2) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

As the program and tasks evolve, deliverable schedules may change (with the consent of all parties) to more accurately address NIST needs.

Task 3C: Support the development of the HL7 V2 Immunization Testing Framework Prototype.

Description of Tasks:

I. Design and develop communication infrastructure for the Test Framework to support Immunization messaging testing o Design/improve communization test framework o Support transport (CDC WSDL/SOAP Protocol)

II. Analyze SOAP standard and provide report o Review CDC SOAP standard for immunization transport o Provide a report on the findings of the CDC SOAP standard review

The deliverables for the tasks under Task 3 are:

5) Monthly Software updates implementing functionality described above

6) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

7) Report of SOAP standard review

As the program and tasks evolve, deliverable schedules may change (with the consent of all parties) to

Task 4: Conformance Toolkit and Prototype for Healthcare

This task order seeks to contribute to both the Healthcare and MGI communities by developing Registry/Repository infrastructures and associated conformance tools. The NIST SSD requires project leadership and technical staff support from the Contractor in the areas of registry/repository development and development of software testing tools to test registry/repositories. This task order focuses on extending the existing current NIST work on Artifact Repositories for Healthcare and developing a prototype Registry server for MGI that will access existing repositories. The contractor shall assist NIST in extending test tools for Healthcare Registry/Repositories to the Material Genome Registry/Repository

Task 4A: Support the XDS Toolkit Toolkit core:

Research and build a prototype for a machine readable test execution engine

Build a prototype for a graphical test case builder based on a machine readable test engine Proxy support:

Research SSL proxy interface

Add support dynamic port management

Integrate with the Simulator engine Log Browser:

Improve user experience and provide tool maintenance for the toolkit user group

Deliverables:

The deliverables for the tasks under Task 4A are:

1) Monthly Software updates implementing functionality described above

2) PowerPoint Presentation to be presented to the NIST Project Leader on the progress of the software upgrades on a Monthly basis

3) Build new versions of each tool and re‐deploy monthly.

E. PERIOD OF PERFORMANCE

Period of Performance is 15 September 2015 through 30 October 2016.

F. CONTRACTOR QUALIFICATIONS

All Contractor Key Personnel must meet the following minimum qualifications per stated for the specified task. It is estimated that at least one Key Personnel contractor employee will be required for each of the four respective tasks.

Task 1: Research Scientist Contractor Personnel assigned to this task shall possess the following minimum qualifications:

PhD, or seven years’ experience, in Mechanical Engineering and/or Robotics, or Computer Science

Proven recent research experience of five or more years in computational science, image segmentation, cell tracking, image stitching, and microscope control.

Knowledge of simulation, optimization, finite element analysis, and numerical analysis

Advanced Matlab expertise

Task 2: Research Scientist Contractor Personnel assigned to this task shall possess the following minimum qualifications:

6 years’ experience in Web Development: Spring, Primefaces, JSF2, JSP, HTML, JQuery, Tomcat

6 years’ experience in Web Services Development: Axis 2, JAX‐WS, Apache CXF

6 years’ experience in Development Process: JUnit, Maven, Hudson, Redmine, Design Pattern.

6 years’ experience in XML: XML Schema, XML Beans, XPath, XSLT

Minimum of 6 years of experience as a HL7 V2 and V3 expert

Minimum of 6 years of experience as a Senior Java Developer

Minimum of 6 years of experience in V2 conformance profile (structure, datatypes, value sets, ER7) and V3 schemas

Minimum of 4 of experience in V2 Vocabulary

Minimum of 6 years of experience in protocols MLLP and SOAP.

Minimum of 6 years of experience in HL7 v2 and v3 message validation and generation.

Minimum of 6 years of experience in IHE PIX/PDQ domain.

Minimum of 6 years working with NIST Core Messaging Validation Tool

Minimum of 2 years of experience in immunization and lab results IGs

Minimum of 3 years of experience in test case development

Prior Experience with AngularJS is required

Prior Experience with MongoDB is preferred

Minimum of 6 years in SDLC (Software Development Life Cycle)

Spring framework Certification is required

Minimum of 6 years in Agile Methodologies

Minimum of 6 years with Object Relational Mapping technologies such as JPA, Hibernate.

Task 3: Research Scientist Contractor Personnel assigned to this task shall possess the following minimum qualifications:

2‐3 years' experience in the areas of related solution definition, solution engineering and/or solution delivery

2‐3 years' experience in SDLC (Software Development Life Cycle) Minimum of 3 years of experience in standard development, algorithm implementation, test case development 2‐3 years' experience in Development Process: JUnit, JIRA, Bugzilla, Design Pattern.

2‐3 years' experience in XML and open standards: XML Schema, XML Beans, XPath, XSLT, Python (2 & 3) 2‐3 years' experience with Graphical User Interface (GUI) design Prior experience with Web Development: Spring, JSF2, JSP, HTML, JQuery, Tomcat, Django Prior experience with Web Services Development: JAX‐WS(SOAP), JAX‐RS (REST) Prior experience with Object Relational Mapping technologies such as Hibernate, iBatis Prior experience with database management systems MySQL, SQL Server Minimum of a Bachelor of Science Degree

Task 4: Research Scientist Contractor Personnel assigned to this task shall possess the following minimum qualifications:

3 years’ experience in Web Development: Spring, Primefaces, JSF2, JSP, HTML, JQuery, Tomcat, GWT

3 years’ experience in Web Services Development: Axis 2, JAX‐WS, Apache CXF

2 years’ experience in Development Process: JUnit, Maven, Hudson, Redmine, Design Patterns.

3 years’ experience in XML: XML Schema, XML Beans, XPath, XSLT

Minimum of 3 years of experience as a Senior Java Developer

Minimum of 3 years of experience in protocols REST and SOAP.

Minimum of 3 years of experience in protocol testing.

Minimum of 3 years of experience in IHE XDS domain.

Minimum of 3 years working with NIST XDS Validation Tool

Minimum of 3 years of experience in test case development

G. DELIVERABLES

Task

Number Description Format Qty.

Due Date / Frequency

Task 1A Traceable image feature extraction

12 months from award

Web documentation of image features

HTML

Command‐line executables of image feature extraction Matlab

Integrated third party software

Matlab, C++, Python

2 sets

Software mechanism for monitoring execution progress

Matlab 1

Software mechanism for handling execution errors

Matlab

Task 1B Microscope control and detection of 3D objects from award

Micromanager scripts that operate with NIST Zeiss and Leica confocal laser scanning microscopes scripting language

Methodology for computing detection accuracy and uncertainty of cellular objects

MS PPT slides

Task 1C 3D image stitching from award

Survey of stitching algorithms for 3D images MS Word

Evaluation of the stitching challenge submissions to the 2015 BioImage Informatics conference

PPT slides

Code and recommendations for optimal filtering parameters to improve stitching results

Matlab, Software implementation for stitching 3D images

Matlab

Research methodology for evaluating accuracy of 3D image stitching.

Task2A Maintain, update, and improve the HL7 V2 Test Tool Interface and Execution Engine

Software and Power Point Presentation

Monthly

Task 2B Lead the design and development of the HL7 V2 Implementation Guide and Authoring and Management (IGAMT) tool.

Software and Power Point Presentation

Monthly

Task 2C Lead the design and development of the HL7 V2 Immunization Testing Framework Prototype.

Software and Power Point Presentation

Monthly

Task Number

Description Format Qty.

Due Date / Frequency

Task 3A Create a web‐based portal for accessing the suite of HL7 v2 conformance and interoperability test tools and associated documents

Design document

(PPT)

Tool Template

(XML/WORD)

Source Code

Incrementally:

4 weeks after award

8 weeks after award

6 months after award

Task 3B Support development of the HL7 V2 Implementation Guide and Authoring and Management (IGAMT) tool.

Report (PPT) Source Code

December 30, Task 3B Support the development of the HL7 V2 Immunization Testing Framework Prototype.

Report (PPT)

December 30, Task 4 Conformance Toolkit and Prototype for Healthcare Report (PPT)

September 30, H. PLACE OF PERFORMANCE

The majority of the distributed development team is located at NIST, Gaithersburg, MD, and the Contractor staff are required to be physically located at NIST.

I. INSPECTION AND ACCEPTANCE CRITERIA

As duties and responsibilities are completed, the Contractor shall request review and inspection by the NIST COR. Tasks completed in an unacceptable manner may require corrective action by the Contractor. Within five

(5) business days of receipt of deliverables, the NIST COR shall provide the Contractor of any required revisions or deliverable acceptance.

J. GOVERNMENT FURNISHED PROPERTY AND RESPONSIBILITIES

The Government will provide to the Contractor through the NIST COR:

1. Office space to include desk and chair

2. All computing hardware, software and networking resources.

3. Access to NIST campus during working hours; non‐working hour access may be granted on an as needed basis.

K. EXHIBITS AND ATTACHMENTS

None.

L. TRAVEL

Task1 – No travel Task 3 – No Travel Task 2 ‐ Contractor shall attend the HL7 January 2016 Working Group Meeting. The contractor shall demonstrate the IGAMT at minimum to the conformance, tooling, Immunization, and order and observations working groups; obtain feedback and modify accordingly. Additionally, the contractor shall present Immunization bi‐directional test tool to the public health working group. (2 CONUS Trips)

The contractor shall assist the on‐boarding of immunization registries using the Immunization bi‐directional test tool described in task 3. This will include on‐site visits (TBD) to various state immunization registries sites. (Plan for 2 CONUS Trips) Task 4 – No Travel

M. QUALITY ASSURANCE SURVEILLANCE PLAN

The purpose of this plan is to provide a quality assurance surveillance plan for the work to be conducted under this contract. The plan provides a basis for the NIST COR to evaluate the quality of the Contractor's performance. The oversight outlined in this plan will help to ensure that the topics and assessment are maintained at the required levels through the Period of Performance. Further, this plan provides the NIST COR with a proactive way to avoid unacceptable or deficient performance.

Performance Standards:

1. Quality Level: By monitoring the Contractor, the NIST COR will determine whether the Performance Standards set forth in the Purchase Order have been attained. Performance Standards for all tasks are specified in the Performance Requirements Summary of the Performance Work Statement.

2. Frequency: During the performance of this Purchase Order, the NIST COR takes periodic measurements (i.e., conduct surveillance), as specified, and will analyze whether the frequency of measurement is appropriate for the work being performed. Adjustments shall only be made by a modification to the Contract.

3. Management Responsiveness: The NIST COR will determine whether the Contractor has managed the Contract effectively and efficiently with successful completion of the topics and assessment as specified in the Performance Standards set forth in the Performance Requirements Summary.

N. PERFORMANCE REQUIREMENTS SUMMARY

Task 1A: Traceable image feature extraction Desired Output: Software that generate traceable image features. Software that provides capabilities to handle execution error and report execution progress (verified by the Technical Point of Contact ‐ TPOC).

Performance Standard: Software and documentation evaluated by the COR. The Contractor responds promptly to phone calls and emails and is in attendance at meetings. Any written communication is in grammatically correct English and delivered on time. The software management is functionally correct, well‐documented and easy to use. The software management system is in‐line with industry‐acceptable practices and techniques.

Source code and software release will be made publicly available.