AHRQ-11-10006-Attachment 6-Performance Requirement Summary.pdf

Attachment 6 – Performance Requirements Summary *unless otherwise noted, these performance factors apply to the base period and all option periods

Task Standards/SOW Reference Acceptable Quality Level Surveillance Method

COTR

Score

COTR

Score Totals

Task 1: Content (30%)

Relevant integration of experts in content tasks and/or project direction (1.1, 1.2, 1.3)

100% appropriate recruitment of Editorial Board and Expert Panel on time;

conference calls and meetings are timely and productive; mtg. materials are relevant and high quality

Project Office (PO) monitoring;

User feedback (info emails, customer satisfaction survey results); 508 audits

Develop and/or revise and consistently apply inclusion criteria for innovations and tools (1.4)

100% of published innovation profiles and tool summaries show inclusion and exclusion criteria consistently applied;

electronic log of actions is accurate and updated

Develop and maintain a system to obtain, publish, update, innovations, tools and other content (1.5)

1 novel approach to stimulating submissions is used

100% of outdated innovations and tools are moved to archive

Written copyright permissions (if needed) obtained and maintained from all innovators for life of the project

Language used to convey information about innovations and tools is plain and at appropriate level for audience

Naming convention for innovations and tools is consistently applied

Publish 75 - 80 new and updated innovations, and 100 - 110 new and updated tools. Of the 75 - 80 innovations, publish 20 - 25 policy innovations as stated in task 1.4

50% of published innovations represent vulnerable populations and/or efforts at disparities reductions

Approved annual verification process is applied upon contract award and consistently thereafter

All data and content project artifacts delivered at close of contract Validated system to index and abstract innovations and tools (1.6)

Content to be searched and browsed is consistently indexed and tagged with UMLS and other vocabularies

Prepare necessary OMB clearance for innovators interview within time limits

An AHRQ-approved conflict of interest policy is implemented within two months of EDOC and consistently applied

No more than 5% of abstracted content requires major rework following verification by the innovator

Task 2:

Enhancements (15%)

Thoughtful development of recommendations for enhancement submitted to AHRQ along with justification and implications to budget, timeline, risk, and configuration

Enhancements reflect users’ needs and changes of interest to AHRQ and are submitted on time – due at 6 months EDOC and yearly thereafter

Approved enhancements are implemented

PO

monitoring and AHRQ feedback management (2.1, 2.2, 2.3) as agreed upon

Task 3:

Information Technology (20%)

Throughout the life cycle of the project, the resource conforms to Federal and DHHS requirements in laws, policies, and directive for IT, capital planning and investment, and internet information management and the security of Agency information and systems (3.1, 3.11)

The HCIE system consistently operates in a FISMA-compliant environment and only with an approval to operate (issued by

AHRQ)

PO

monitoring;

AHRQ IT

Migration of existing resource into new environment is completed on time (3.2) *only applicable during the base year

Receipt of Approval to Operate is obtained to affect transition on time.

The HCIE back end and front end are completely migrated into new environment and are fully operational no later than 4 months EDOC.

Failure to migrate on time will result in zero points for the information technology task.

Database requirements are fulfilled (3.4)

Search and browse render result sets that are accurate, relevant and complete (less than 5% of user feedback is negative about results and irrelevant content)

Parent-child relationships are supported for policy/public health type innovations and these relationships are apparent to users in 100% of appropriate instances

Sib-sib relationships are supported for instances when innovations and tools are correlated; relationships apparent to users

100% of the instances

Web site requirements are fulfilled (3.5)

• The HCIE site is maintained as an AHRQ.gov resource

• Redesigned sites undergo usability testing

• Web analytics provide information useful to team and AHRQ

• Web sites that are in full compliance with all relevant sections of section 508

AHRQ specifications are mapped to content and functionality of redesigned site

Site URL is a third level domain

Usability testing is conducted, and appropriate adjustments are made to the design, and captured clearly in systems documentation

Web analytics indicate users are obtaining the information of interest to them when they seek it (provided that content is present)

100% of content is accessible to audience members with disabilities

Hardware requirements are fulfilled (3.6)

System bandwidth is sufficient and uptime (24 x 7 near full availability) is achieved for content developers and for public Web visitors

Change/configuration management protocols are followed (3.8)

100% of the changes to IT infrastructure are AHRQ-approved and are managed through AHRQ-approved change management protocol

Systems documentation and checklists are delivered (3.10)

Systems documentation and checklists are complete and accurate (requiring little to no rework) and submitted on time

Technical assistance is offered to HCIE system users (3.12)

All technical assistance requirements regarding linking to HCIE, help feature of the site, FAQs, description of technical specifications, how to contact the HCIE, and replying to HCIE inquiries are met

Task 4:

Learning and Networking (15%)

Provide learning and networking opportunities to accommodate different learning styles, communicate venues geared toward adult learners, drive users to the Innovations Exchange, ensure interactions and learning amongst users (4.1)

Use of social media and Web

2.0 tools adheres to policy (4.1)

A plan is submitted that offers learning and networking opportunities and addresses implementation, post-implementation monitoring, monthly assessment and reporting and evaluation of proposed activities

Learning and networking opportunities reflect AHRQ’s and the Innovations Exchange’s mission and brand

Learning and networking opportunities receive high ratings on participant evaluations

Social media and/or Web 2.0 technologies are used in at least one learning or networking opportunity and comply with HHS & AHRQ requirements

PO

monitoring and AHRQ feedback;

Participant

Task 5:

Project Management (20%)

Effective and efficient management of the technical, administrative, logistical, and support functions (5.1)

Best practices are applied

Resources (staff, IT and other) are managed for the benefit of the project

PO and CO monitoring;

AHRQ IT

Estimates of resources needed for both cost and schedule are complete and accurate such that no significant cost or schedule overruns or underruns are incurred (significant is when the cost or schedule exceeds the Contractors estimates as detailed in the annual PWP and a request is made to AHRQ for more funds or more time)

Communication to AHRQ of cost, schedule, and quality issues is timely, complete and accurate

Monthly Management Meetings (5.4)

Meetings are held on time and preceded by an agenda

Submit all required reports and relevant systems documentation (5.6, 5.7, 5.8, 5.9, 5.10)

Monthly progress reports, annual work plans, annual reports, and systems documentation are of high quality (documentation is relevant, accurate, appropriately formatted), is logically packaged, submitted on time and include those topics set forth in the SOW, and as requested by the COTR

Draft close-out plan/transition is submitted four (4) months before the contract expires. Final close-out transition plan is included as part of the final report