SAE SON-Usability Testing Platform-5Aug2024-v2.pdf

STATEMENT OF NEED v1, 2024/04/24

Capability: Usability Testing Service

2024 Statement of Need (SON) - Usability Testing Service, v1 Page 1 of 3

PURPOSE

SAE requires a service for usability testing of web properties. The tool must have an easy set-up process and a user-friendly graphical user interface (GUI) to conduct user testing on websites or other digital products. Key features must include the ability to set up a usability test with a remote subject;

the ability to record (both voice and screen) the test session; the ability to use our own test subjects and also to employ test subjects provided through the service.

SCOPE/MISSION

SAE’s mission is to provide a systematic approach to requirements, satellite architecture planning, strategic planning, and systems engineering. This approach is used to provide critical business information and analysis to support NOAA and NESDIS’ strategic observing system investment planning. To this end, SAE needs to accelerate our nation’s environmental information services by designing and developing the next generation of Earth observation and data information systems. A more comprehensive set of requirements and preferred specifications has been laid out in the sections below.

Currently, NESDIS does not have a mechanism to execute robust, documented usability testing of our digital offerings (websites, products, etc.) as part of the development process. Usability testing is a key best practice to validate that our products and services are serving users successfully, and it provides actionable information that can be used to improve products and services. This software provides a way for NESDIS developers to execute usability testing at minimal cost and at a reduced burden for both staff and user test subjects. SAE plans to work with STAR, NCEI, OSPO (and others in NESDIS) to conduct trials of usability testing using the software to determine whether this is a beneficial solution and, if so, how best to implement it on a wider scale.

IMPACT ASSESSMENT

The time to conduct robust, professional usability testing on NESDIS products and services is long past due. Through this testing, we will be able to avoid costly mismatches between digital products and customer expectations and needs. We will be able to better ensure that the products and services we provide can be successfully used by customers and suit their needs. Usability testing reduces risk (of failed products and services) and helps to point developers in the right direction to maximize value to our users.

SPECIFICATIONS

General Specifications - Required:

● Ability to set up a test of a website or digital product with a remote user

● A variety of available templates for setting up the usability test

● Access to a wide pool of service-supplied test subjects

2024 Statement of Need (SON) - Usability Testing Service, v1 Page 2 of 3

● Ability to record (both voice and screen) the test session

● Ability to use our own test subjects

● Ability to use platform to recruit participants

● Ability to test a wide range of digital products

● Ability to provide a written transcript and add time-stamped comments to the test session recording

● Ability to schedule testing

● Ability to assess usability for SAE-owned Google Sites

● Access for at least 10 admins and 50 collaborators

Technical Specifications - Highly Preferred:

● Live (moderated) testing capabilities

● Unmoderated testing capability, including basic usability tests, card sorting, tree testing, and click tests

● Advanced analytics with executive-level display

● Proprietary machine learning model that can be applied to test results to surface key insights

(reducing work of analysis)

● Professional services, including test planning and development, test moderation, and analysis and reporting

● No code deployment required--compatible with many environments (such as JIRA) and/or any digital prototype available through a link.

● Ability to test non-digital prototypes as well

● Support for a wide range of testing methodologies and approaches that go beyond task testing

● Customer experience surveys and tracking

● Testing templates and processes that are consistent with agile testing processes

SPECIAL REQUIREMENTS for IT COMPLIANCE:

● Computing systems shall be IPv6 capable and capable of being configured to utilize PIV -compliant smart card authentication in accordance with HSPD-12. Specifically, in order to comply with FIPS PUB 201, agencies are required to purchase only approved personal identity verification products and services.

Approved products and services may be acquired from the GSA, Federal Supply Schedule 70, Special Item Number (SIN) 132-62, HSPD-12 Product and Service Components, in accordance with ordering procedures outlined in FAR Subpart 8.4.

● In addition, Internet Protocol Version 6 (IPv6) requirements from FAR part 11.002 (g) are hereby incorporated, specifically: This requirements specification document requires compliance with the technical capabilities defined in the USGv6 Profile (NIST Special Publication 800-119) and the corresponding declarations of conformance defined in the USGv6 Test Program (see also OMB Memorandum M-05-22 dated August 2, 2005).

2024 Statement of Need (SON) - Usability Testing Service, v1 Page 3 of 3

Recommendation/ITCAC Security Checklist Header:

● System: NESDIS HQ LAN/NOAA5006

● Description: Provide the name of the preferred product and/or vendor, plus 1 descriptive sentence about what the product does: