ESBD_514827_1778621327702_Joint Tech - Technical Review with AI Questions v 51226.pdf

PDF 112 KB Posted

Attached to
Point-of-Care Ultrasound Equipment
Solicitation number
RFP-2026-05-001
Issued by
Travis County, Austin City, Texas

About this file

Technical Review Document with AI Assessment Framework

This is a technical review document prepared for a Texas state and local contract opportunity, incorporating artificial intelligence-based evaluation questions and criteria. The document outlines a comprehensive assessment framework designed to evaluate bidder proposals through both traditional technical review methods and AI-enhanced questioning protocols. The scope encompasses evaluation of vendor capabilities, technical approach, implementation methodology, and qualifications relevant to the contract requirements. The document establishes structured criteria for scoring and ranking proposals, with particular emphasis on how artificial intelligence tools and methodologies will be integrated into the technical evaluation process. The framework includes predetermined question sets, evaluation rubrics, and scoring guidelines to ensure consistency and objectivity across the technical review phase of the procurement process.

The document provides detailed guidance on application of AI-assisted review techniques to assess proposal quality, vendor experience, technical feasibility, and organizational capacity. It establishes weighting methodologies for various evaluation criteria and outlines the comparative analysis approach for multiple submissions. The framework addresses how AI questioning protocols will supplement traditional technical review elements while maintaining compliance with state procurement regulations and ensuring equitable treatment of all bidders. Specific attention is given to documentation requirements, evaluation panel protocols, and the integration of automated assessment tools alongside human expert review to enhance the overall quality and consistency of proposal evaluation.

View the file

Other files

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

Version 5/12/2026

CATEGORY QUESTION

NO. QUESTION OFFEROR'S COMMENTS

1 Describe data center security standards for the hosted solution.

2 Describe data center compliance with those standards, including independent audit results or certifications.

3 Attach a security architecture diagram.

4 Attach a copy of the most recent data center SOC audit or other self-attestation regarding security and compliance.

5 Describe data center tier rating(s) and resiliency for redundancy and failover.

6 Describe the physical locations of data centers that will host our data, including those for redundancy. If the actual locations cannot be revealed, describe them geographically in terms of distance.

7 Describe any locations that are off-shore from the Continental United States.

8 Describe failover design.

9 Describe disaster recovery protocols and how data is restored.

10 Describe the thresholds and protocols to notify the customer when disaster recovery protocols are triggered.

11 Is there a dedicated Information Security Officer or CISO responsible for security architecture and operations?

12 Describe incident response protocols and how security events are investigated and remediated.

13 Describe Risk Management and Risk Assessment protocols, including any 3rd party Risk Assessments.

14 Describe Penetration Testing protocols including frequency.

15 Describe physical security controls for any facilities in which our data may be processed.

16 Are internal systems protected with dedicated firewalls and anti-virus software?

17 Describe security within your development lifecycle - are DAST or SAST tools implemented?

18 Describe State and Federal Security Audit Certifications obtained such as TX-RAMP, FedRAMP, StateRAMP, FISMA, etc.

DATA CENTER

SECURITY &

COMPLIANCE

REDUNDANCY &

DISASTER RECOVERY

SECURITY

OPERATIONS

19 Describe any SSO or Federation capabilities.

20 Describe any MFA or 2FA capabilities.

21 Describe any other integration capabilities.

22 Describe the backup process, including but not limited to, frequency and method (e.g., incremental/full, onsite/offsite).

23 If the backup process involves a third party network/server/vendor, please identify the third party(ies).

24 Describe routine and emergency maintenance protocols.

25 Describe up-time.

26 Describe the protocol for monitoring services.

27 Describe Service Level Agreement.

28 Describe data retention protocols.

29 If data is not retained indefinitely, describe the alternatives for storage and destruction.

30 Describe scalability for growth of data.

31 Describe our ownership rights to the data while under contract and in the event the contractual relationship is terminated.

32 Is data used for any other purpose other than our stated purpose?

33 Is data encrypted during transit?

34 Is data encrypted at rest?

35 Describe measures or architecting strategies to protect health-related data for HIPAA compliance.

36 Describe data separation environment and/or shared computing resources so that we fully understand the physical or virtual machine environment that supports its data.

37 Describe the protocol to notify customers of security breaches.

38 Is this a web-based application? If not, describe the application such as locally installed on computers or on-premise environment.

39 Identify all compatible operating systems.

40 Identify all compatible browsers.

41 Identify all compatible devices, such as PC, laptops, tablets, etc.

42 Is there a mobile app? If yes, describe whether it is available for iPhones, Windows, Android.

43 Describe the service desk support process and resources, including but not limited to customer portal, hours of operation, escalation paths.

44 If available, describe the various levels of support plans and their cost.

SUPPORT, ON-GOING

ADMINISTRATION &

TALENT

AVAILABILITY,

MONITORING &

ALERTS

PROTECTED HEALTH

INFORMATION /

HIPAA

WEB-BASED, OS &

BROWSER

COMPATABILITY

BACK-UP,

MAINTENANCE

AUTHENTICATION

DATA PROTECTION,

RETENTION & USE

45 Describe recommended certifications to properly administer the services from the customer side.

46 Describe training and continuous learning resources to properly administer the services from the customer side.

AGREEMENTS 47 Attach a copy of, or provide an online link, to the following documents:

a. All Terms and Conditions which may include, but not be limited to,

i. Business Associate Agreement

ii. End User License Agreement and/or all other licensing agreements

iii. Service Level Agreement

iv. Support and Warranty Agreements

b. All other documents and/or agreements not listed above that will require signature or attestation by Central Health in order to secure a contract.

AI (If Applicable) 48 Technical: Describe the end-to-end architecture for the solution

49 Technical: Does the AI "learn" from our patient data? If so, how do you ensure PHI isn't leaked ?

50 Technical: Where is the processing happening? Is any data being sent to third-party LLM providers? If so, do you have a BAA in place?

51 Technical: HITL (Human-in-the-Loop) what is the confidence score threshold for straight-through processing?

52 Technical: Does the solution support active learning or feedback-based improvement? If so, describe: (a) the mechanism by which corrections or user feedback are incorporated; (b) how model updates are validated before redeployment (including regression testing); (c) the approval process for model retraining using our data;

and (d) how Central Health is notified of material model changes.

53 Technical: How does the system handle unstructured data?

54 Explainability: If an application is rejected, can the system generate a "Reason Code" or a natural language explanation ?

55 Bias Mitigation: Have you tested the model for bias in general? How have you tested the model for bias against certain demographics ? Is there any documented bias testing performed?

56 Model Versioning: How do you manage "Model Drift"? If the new document needs to be added or format of existing document changes, how quickly can the model be updated and re-validated?

57 Auditability: Does the system maintain a thread of evidence? Can an auditor see, for example, exactly which part of a scanned document the AI used to extract a specific data point?

58 Hallucination Prevention: What specific guardrails are in place to prevent the AI from "hallucinating" a date or address when the scan is unreadable?

59 Input Validation: How does the system handle "adversarial" inputs or fraudulent documents?

60 AI Model Training: Copy of the policy of the AI model training data usage

61 Incident Response Plan: Copy of the plan documented

62 Business continuity/disaster recovery plan documented

DPA Data Processing Agreement (DPA) (if applicable) CJIS CJIS Security Addendum (If applicable) Insurance Certificates

Cyber Liability and E&O

Regulatory Regulatory: Has this AI solution been assessed for classification as Software as a Medical Device (SaMD) under FDA guidelines? If applicable, describe any FDA submissions, clearances, or 510(k) exemptions. Does the solution comply with ONC HTI-1 regulations regarding AI-generated clinical decision support (effective 2025)?

File details come from the government source that posted it. Updated .