ESBD_378130_1729808643686_304-25-1299KW IDE Test Automation SW Q&A Response.pdf

RFO # 304-25-1299KW IDE Test Automation SW & Svcs Page 1 of 4 CPA’s Official Response to Questions from Potential Respondents

Request for Offers RFO No. 304-25-1299KW

Integrated Development Environment (IDE) Test Automation and DevOps Software License and Related Services

CPA’s Official Responses to Questions from Potential Respondents October 24, 2024

1. We noticed a similar RFO was issued in 2023, and we submitted our proposal for the said RFO. Could you please clarify why you have not released any update and/or evaluation result regarding that submission?

CPA RESPONSE: Solicitation posting and status, including “Awarded,” for RFO 304-23-1299KW are posted to the ESBD at https://www.txsmartbuy.gov/esbd. Regarding results of the evaluation of one or more Offers: all Offers become the property of CPA and may be subject to release to any requester under the provisions of the Texas Public Information Act (chapter 552 of the Texas Government Code). After the award and execution of a contract for a particular procurement, offers submitted shall be presumed to be public information and subject to disclosure unless a specific exception to disclosure under the Texas Public Information Act applies.

2. If the previous RFO was cancelled, would you be able to provide us with the reason for the cancellation? We would greatly appreciate any insights you can share.

CPA RESPONSE: See Response to Question 1.

3. Could you explain why the RFO has been re-released this year? We are curious to understand the changes or updates that led to this decision.

CPA RESPONSE: Reference Section II, Part B (Background) of the RFO. The existing contract for the IDE and DevOps software applications currently used by CPA will soon expire; CPA has identified a continuing need for using IDE Test Automation and DevOps software applications.

4. Is there any incumbent? If yes, please provide the name and share the current challenges.

CPA RESPONSE: The incumbent vendor for Katalon® products and services used by CPA is Acachi LLC. There are no current challenges.

5. On page 24 #27 mentioned that “If requested by CPA, Successful Respondent will provide delivery on-site at CPA”.

Is CPA ok if vendor provides delivery from onshore?

CPA RESPONSE: Reference Section II, Part D.5.f) (Location of CPA Data) of the RFO; CPA Data is required to remain at all times within the continental United States. Reference Section V, Part 77 (Use of State Property) of the RFO; Successful Respondent may not use any computing device to access CPA’s network or e-mail while outside of the continental United States. Reference Section II, Part Q (Respondent Exceptions) of the RFO.

6. Can the vendor utilize hybrid onshore-offshore resource model deliver the project?

CPA RESPONSE: See CPA Response to Question 5.

7. The RFO document does not state any budget for the proposed project. Has CPA established any budget for the same? If yes, please share the budget or budget range that CPA would expect the offer to be in the range.

RFO # 304-25-1299KW IDE Test Automation SW & Svcs Page 2 of 4

CPA RESPONSE: Reference Section II, Part A (Introduction). CPA’s objective is to obtain the Services that represent the best value for CPA and the State of Texas, and All Respondents are encouraged to offer the best pricing at all times.

8. What level of test recording capabilities are you seeking? Are you interested in the software's ability to automatically capture and record test steps, or do you prefer more manual control over test script creation?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) for specifications related to automated tests, test recording, reports, and test scripts. CPA prefers manual control over test script creation.

9. Do you have particular preferences or stipulations for mobile applications on both iOS and Android platforms? This includes support for native apps, hybrid apps, or web apps. Additionally, could you specify any devices or emulators you intend to use for mobile testing?

CPA RESPONSE: Not applicable; the reference to mobile applications in Section II, Part D.2.c. is removed.

10. Could you provide additional details about the specific analysis reports you require from the licensed software?

What specific data and insights are you aiming to extract from the test results?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements); CPA utilizes default test results from function test suite collections.

11. Can you provide more information about the usage of Command Line Interface (CLI) mode for executing automation tests? Are there any particular requirements or integrations you have in mind that depend on CLI?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) and Part D.3.c) (Implementation Services;

Training Services) of the RFO.

12. Do you have any special requirements for testing APIs without the need for additional integrations? Are there particular API testing frameworks or standards you need to adhere to?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) of the RFO..

13. Are there any specific native integrations you are seeking with products like Git, or would you be open to exploring third-party integrations if necessary?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) of the RFO.

14. Could you clarify if the licensed tool should support the seamless import of existing Katalon test scripts, considering the assumption that there are scripts already developed in Katalon?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) of the RFO.

15. On Page 6, D.2.C., can you provide more information on the specific platforms for which CPA is looking for testing.

For example- desktop, web, mobile, etc.

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) of the RFO.

16. On Page 6, D.2.E, can you provide more information on what CPA means by API testing in this RFO? Our understanding is that this does not mean performance testing. Please confirm.

CPA RESPONSE: Reference Section II, Part B (Background), Part C (Definitions and Acronyms) and Part D.2 (Requirements) of the RFO.

17. Page 6, D.2.F, can you please provide more information about what CPA intend to accomplish with Git.

CPA RESPONSE: CPA uploads automation scripts to GIT for purposes of tracking and recording changes made to files.

18. Does [sic] all licensee’s need to create and execute tests? Please confirm?

CPA RESPONSE: Reference Section II, Part D (Scope of Services), including, but not limited to, Subpart D.2 (Requirements) applicable to the Licensed Software.

19. Can you provide the information on how many total Katalon test scripts need to be imported?

RFO # 304-25-1299KW IDE Test Automation SW & Svcs Page 3 of 4

CPA RESPONSE: CPA uses Katalon software applications for automating test scripts. Reference Section II, Part D.2 (Requirements); Respondent’s Licensed Software must be able to import Katalon test scripts. Reference Section II, Part D.3.c)1) (Implementation Services) for minimum requirements of Implementation Services. Regression test automation scripts are created for multiple projects. Scripts can vary from 100s to 1000s.

20. Can you please confirm if green screen is being tested?

CPA RESPONSE: Not applicable.

21. Can you please confirm what kinds of applications are being tested? Are those in-house developed applications or vendor applications?

CPA RESPONSE: Reference Section II, Part B (Background) of the RFO; CPA uses IDE and DevOps software applications to automate and regression test in-house developed applications.

22. If vendors applications involved, can you kindly provide information on the specific vendors?

CPA RESPONSE: See CPA Response to Question 21.

23. Does the product have to be selenium based, given that many product-agnostic solutions are much more efficient in managing changes to applications vs. having to rewrite all scripts?

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) of the RFO.

24. How many developers are involved in the process of creating and maintaining automated scripts?

CPA RESPONSE: 20.

25. Are there any applications that cannot currently be automated due to limited technology support?

CPA RESPONSE: Yes.

26. Are there any Flutter or React Native mobile applications requiring testing?

CPA RESPONSE: No.

27. Is there any need for service virtualization due to incomplete or inaccessible APIs?

CPA RESPONSE: No.

28. What is the size of the Katalon repository? Does the scope of implementation include importing the tests into the proposed solution?

CPA RESPONSE: See CPA Response to Question 19.

29. Will CPA be looking for implementation partner to perform the installation on their own or looking for support over screen share to perform the installation & configuration?

CPA RESPONSE: Reference Section II, Part D.3.c) (Implementation Services; Training Services) of the RFO.

30. What other SDLC tools are currently implemented at CPA?

CPA RESPONSE: In addition to Katalon IDE and Test Automation applications, CPA uses X-ray and Jira.

31. What integrations, if any, are required to be configured for the scope of implementation?

CPA RESPONSE: Reference Section II, Parts D.2 (Requirements) and D.3.c (Implementation Services; Training Services) of the RFO.

32. Are there any requirements CPA has with respect to staffing, onsite, offshore, etc.

CPA RESPONSE: Reference Section II, Part D.2 (Requirements) and Part D.3.c) (Implementation Services;

Training Services) of the RFO. Also see CPA Response to Question 5.

RFO # 304-25-1299KW IDE Test Automation SW & Svcs Page 4 of 4

33. How many trainees will be attending the training sessions?

CPA RESPONSE: Up to 20. Reference Section II, Part D.3.c)2) (Training Services) of the RFO.

34. When does the licensing for current tools set expire?

CPA RESPONSE: The existing contract term for the IDE and DevOps software applications currently used by CPA is through November 27, 2024.

35. Is there a desired timeline for implementing the solution?

CPA RESPONSE: Reference Section II, Part D.3.c)1) (Implementation Services) of the RFO. See CPA Response to Question 34. CPA desires implementation of a solution to be completed prior to expiration of the existing contract term or as soon thereafter as practical.

36. Will you be able to accepts multiple bids from a single Respondent if they are with different vendors or will you only be able to accept one bid per partner?

CPA RESPONSE: CPA will accept only one Offer from a Respondent. CPA’s objective is to obtain the Services that represent the best value for CPA and the State of Texas, according to the terms and conditions of the RFO.

Reference Section II, D.8 (Optional Features, Products or Services), Section III.B (Offer Content and Format), and Section IV (Mandatory Price Sheet), including the instructions for Respondent to clearly identify Respondent’s offered products and services. While Respondent’s Offer may include multiple products and services, Price Schedule 2 (Optional Features, Products, or Services) will not be considered in evaluation under Section I, Part 17 (Evaluation of Offers under Best Value Standard) of the RFO.