DRAFT - RFI v2023.06.27 - WindowsDesktopAutomationTool.docx

REQUEST FOR INFORMATION

Test Automation Tool for Windows Desktop Applications RFI #254-24 / COMMBUYS Bid # BD-24-1206-MBTA-MBTA-110023

MASSACHUSETTS BAY TRANSPORTATION AUTHORITY

Test Automation Tool for Windows Desktop Applications

REQUEST FOR INFORMATION 254-24

Commbuys Bid # BD-24-1206-MBTA-MBTA-11023

Contact Person:

Name: Mellissa O’Connor Title: Sourcing Manager Massachusetts Bay Transportation Authority 10 Park Plaza Boston, MA 02116 Moconnor2@mbta.com

Please Note: This is a single document associated with a Request for Information (RFI) that can be found on www.COMMBUYS.com. Interested parties are responsible for reviewing and adhering to all information, forms and requirements for the RFI. Bidders may also contact the COMMBUYS Helpdesk at COMMBUYS@state.ma.us or the COMMBUYS Helpline at 1-888-MA-STATE. The Helpline is staffed from 8:00 AM to 5:00 PM Monday through Friday Eastern Standard or Daylight time, as applicable, except on federal, state and Suffolk county holidays.

ISSUE DATE: 11/20/2024

1. Description or Purpose of Procurement:

Through this Request for Information (RFI), the MBTA is seeking information regarding available tools for developing automated test scripts specifically for validating Windows Desktop Applications. The MBTA manages a variety of Windows Desktop Applications that are critical to our operations. These and future applications are each implemented using their independent technology stacks and may require adaptability of an automation tool that supports various technologies. Additionally, the robustness and efficiency of integrating this tool within an overall Quality Testing Framework that includes reporting and analysis of test results is an important consideration.

To enhance our testing processes, we are exploring tools that can streamline the creation, execution, and management, and maintenance of automated test scripts. Our goal is to improve testing efficiency, accuracy, and overall software quality. This RFI aims to gather insights on potential solutions, including features, capabilities, and best practices for implementing automated testing within our IT environment.

The objectives of this RFI are to:

· Identify tools that support automated testing for Windows Desktop Applications.

· Understand the features and functionalities of the proposed tools.

· Understand integration capabilities with other development and testing environments.

· Gather information on licensing, pricing, and support options

2. Requested Information (RFI Response):

Please formulate a response of not more than 20 pages. Material such as a title page, table of contents, and supplemental material or appendices are not included in that limit.

Response should be submitted in COMMBUYS and should address the following topics:

Tool Overview Name of the tool and vendor.

Description of the tool’s primary functions and features.

Technical Capabilities Which Windows versions and development architectures are supported by the tool?

Does the tool support automation for other platform technologies besides Windows Desktop Applications (e.g. Macintosh, Mobile (iOS, Android), Web Applications/Service)?

Is there support for creating/generating performance/load tests that simulate many users?

Which automation programming/scripting languages are supported (e.g., C#, Python, etc).

Provide any additional technical information that distinguishes from competitors.

Automation Features:

Does the tool support configuration and customization?

Does the tool support recording and playback of test scripts.

Does the tool require access to the application source code?

Can test cases and suites be executed in parallel for expanding test execution efficiency?

Can the test be executed from a remote test controller or does the execution need to be triggered on the test system where the application is installed?

Can the tool function without access to the internet? Please describe any limitations.

Does the solution incorporate AI technologies and methods for improving test creation, maintenance, or assessment of automated tests?

Test Data Management Is there Test Management organization of tests into test case, test suite, test plan?

Is test case version tracking available?

Does tool provide organization of automation libraries, configs, run time data, results, etc?

How are test results saved (in a DB, exportable to a DB or other file type as Excel, CSV)?

Indicate any reporting capabilities that are available with the system.

Integration:

Indicate compatibility/integration with any test management/execution frameworks.

Can the tool be integrated within a CI/CD delivery model?

Describe integrations and/or compatibilities with other reporting systems.

Describe any API and command line integrations that may be available.

Does platform integrate LDAP or other Identity Management mechanisms for users?

Installation/Operation Is the tool available as SaaS, Installed, other?

Can solution be deployed in cloud environments (e.g., AWS or Azure) or alternatives?

Provide the pre-requisites and minimum specifications for systems/hardware.

Describe major steps, resource requirements, and timing needed to implement the system?

Please describe operational availability and any limitations if loss of connectivity.

Support and Maintenance:

What is the fix and/or enhancement release cycle and frequency?

What SLA do you support for uptime/production support/break-fix/service requests?

Are Professional Services required/provided when installing the tool?

Information Security Briefly describe your information security controls and processes.

What types of Information Security certifications/attestations does your platform support/provide?

Does the solution allow for managing user role permissions, and any impact on licensing?

Describe security elements related to Data Storage (include SaaS and Cloud installations), Encryption (in transit, and at rest), password protocols, any other exposures and protections.

Software Accessibility Is your solution and included documentation compliant with the following: Web Content Accessibility Guidelines (WCAG) version 2.1, levels A and AA? If not, in what areas is the solution noncompliant?

Does your solution have a completed Accessibility Compliance Report (ACR) from the latest version of the VPAT 2.1 (Voluntary Product Accessibility Template) or equivalent? If so, does the ACR include reporting for WCAG 2.1 levels A and AA (AAA optional) and Functional Performance Criteria (Section 508 requirements)?

Financial Considerations Is your solution available through software resellers? If yes, please indicate the resellers that you currently work with. If no, please indicate if you would consider working with a reseller.

Please describe your license model including types of licenses.

What are your cancellation and renewal terms?

If cloud based, how is cost applied for usage time, data storage, and users defined?

Please provide representative pricing information for your solution. Example scenarios below.

a. 1 Users (include 1 Admin, 1 Test Developers, 1 Report Designers, 1 test exec/reviewer); Execute 1000 tests per month; System Usage about 12 hours per day

b. 3 Users (include 1 Admin, 3 Test Developers, 3 Report Designers, 3 parallel test exec/reviewers); Execute 3000 tests per month; System Usage about 12 hours per day

c. 8 Users (include 2 Admin, 4 Test Developers, 4 Report Designers, 8 parallel test exec/reviewers); Execute 10000 tests per month; System Usage about 12 hours per day What is your model for implementation and training, and what are representative implementation and training costs?

What additional information have we not inquired about that your company feels would derive business value for the MBTA?

3. Next Steps Upon receipt of responses, the MBTA may request additional information or demonstration of system capability through email or virtual meeting.

Responses to this RFI will be used to understand current capabilities and determine the merits of moving forward with a Request for Proposal (RFP). If the decision is to move forward, the MBTA will develop and refine business requirements by March 2025. Any RFP will be posted on COMMBUYS, and the MBTA will endeavor to notify all companies that respond to this RFI.

4. Procurement Calendar

Bidders are required to monitor COMMBUYS for changes to the procurement calendar for this Bid.

5. Online Questions (Bid Q&A) Written Questions must be entered by pressing the “Bid Q&A” tab for the Bid in COMMBUYS no later than the Questions Due date and time indicated in the Procurement Calendar (above). The MBTA reserves the right not to respond to questions submitted after this date. It is the Bidder’s responsibility to verify questions were successfully posted on COMMBUYS.

Written Responses to Questions will be posted on the Bid Q&A Tab in COMMBUYS on or about the “Response to Questions Posted Online” date indicated in the Procurement Calendar (above).

6. RFI Attachments List attachments here (if applicable)