10-RFP-26-00336 AI Security Questionnaire.xlsx

XLSX spreadsheet 53 KB Posted

Attached to
Integrated Technical Resources Hub
Solicitation number
RFP-26-00336
Issued by
Hillsborough County, Florida

About this file

This is an AI Vendor Security Questionnaire developed by Hillsborough County, Florida for evaluating vendors proposing solutions for an Integrated Technical Resources Hub project. The questionnaire is structured across eight primary categories—Document Requests, Asset Management, Governance, Life Cycle Management, Data and Model Integrity, AI Security, Privacy, and AI Incident Management—with a total of 93 detailed questions designed to assess the security, compliance, and operational controls of AI-based solutions. The County seeks vendors who can demonstrate alignment with industry standards including NIST AI Risk Management Framework (AI RMF), OWASP guidelines for AI/LLM applications, and FedRAMP certifications where applicable. The questionnaire requires vendors to provide supporting documentation such as SOC 2 audit reports, penetration test results, data flow diagrams, model cards, and evidence of security controls across the entire AI system lifecycle.

The questionnaire emphasizes critical security and governance requirements including data classification schemes, isolation of County operational data from training data, detection mechanisms for adversarial data poisoning, incident response procedures specific to AI threats, and transparency controls for automated decision-making. Vendors must address how they protect sensitive information from disclosure and model theft, implement authentication and authorization controls, conduct bias testing and mitigation, maintain audit trails, and monitor for model drift or degradation. Responses are categorized as "Yes," "No," "Partial (Please explain)," or "Not applicable (Please explain)," with vendors required to attach relevant documentation directly into the response form. The questionnaire was initially established in version 1.0 on March 16, 2026, and updated to version 1.1 on May 5, 2026, with revisions focused on removing policy jargon and requiring more detailed explanations beyond simple yes/no answers.

View the file

Other files

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

AI Questionnaire_v1.1

AI Vendor Security Questionnaire
Vendor to complete vendor identification section and then respond to all questions. If documents are requested, please use "Insert object" to attach the document directly into the Vendor Comments cell.
Vendor Name:e.g. ACME Inc.
Completed By:Name of person responding
Date Completed:
#QuestionVendor ResponseVendor Comments
1Document Requests
1.2Please attach a copy of any relevant audit reports that cover information security controls (e.g. SOC 2).
1.3Please attach a copy of your latest penetration test and/or vulnerability assessment report.
1.4Provide a data flow diagram that illustrates the end-to-end lifecycle of County data. This must include how data is ingested, where it is processed (including any third-party AI sub-processors like OpenAI), and where it is stored at rest. Additionally, specify how long data remains 'in memory' during AI inference and your process for purging it once the task is complete.
1.5Please attach copies of Model Cards or Transparency Cards. If you don't have them, explain why?
2Asset Management
2.1Do you maintain an inventory of all hardware and software,AI/ML, and data(training,operational or other assets, including ownership?
2.2Do you have an information classification scheme and process designed to ensure that information is protected according to its confidentiality requirements?
2.3How does your system distinguish between and protect different types of data? Specifically, describe how you ensure the County’s live operational data is kept separate from any data used to train or improve your AI models.
2.4Describe your data classification schema for this AI system. How is each category of data (training, input, output, and metadata) secured to prevent unauthorized disclosure or co-mingling with other customers' data?
2.5Do you adhere to OWASP guidelines for application security, including the OWASP Top 10 for AI/LLM applications?
2.6Are AI-specific gaps identified and documented?
2.7Are parameter values tailored for AI system risks?
3Governance
3.1Have you documented your AI risk management approach in alignment with NIST AI RMF core functions (Govern, Map, Measure, Manage)?
3.2Can you provide evidence of controls for privacy, security, and resilience as per NIST AI RMF guidance?
3.3Do you have a process for reviewing your information security policy?
3.4How do you define and measure 'fairness/transparency' for your product/tool, and who in your organization is ultimately accountable if the AI produces biased or inaccurate results? Describe the process for a county manager to review the 'transparency logs' to verify that an automated decision was made correct.
3.5Have you designated an individual, who is at least at a manager level, who is responsible for information security activities?
3.6Do you have a process designed to monitor changes to regulations and ensure compliance with relevant security requirements?
3.8How do you ensure that the data our staff uploads or interacts with hasn't been tampered with or 'poisoned' to give us false results?

Describe the alerts or safeguards that notify a county manager if the AI starts producing inconsistent or suspicious outputs.

3.9Is model versioning documented with traceability of updates?
3.10Are availability requirements defined for the AI system?
3.11Are backup/restore procedures for model artifacts implemented and tested?
3.12Is the AI system explainable and transparent to stakeholders?
3.13Are safeguards in place for bias, fairness, and harmful output?
3.14Describe processes for bias testing and mitigation in AI models
3.15Are adverse events or misuse incidents tracked?
3.16Are mechanisms in place to detect model drift or degradation?
4Life Cycle Management
4.1Is an AI system lifecycle defined from design to decommissioning?
4.2Has AI ownership and accountability been defined across the lifecycle?
4.3Have you implemented controls aligned with the NIST AI Risk Management Framework (AI RMF) for managing AI-related risks across the lifecycle?
4.4Are prompt restrictions or output filtering mechanisms implemented?
4.5For agent systems, is supervision and oversight defined?
4.6Are periodic performance and security reviews conducted?
4.7Are AI system logs and audit trails maintained?
5Data and Model Integrity
5.1Do any AI components train on Hillsborough County data? If yes, describe isolation and consent controls.
5.2Where is AI training performed (region, cloud provider)?
5.4Are training data sources validated for accuracy, integrity, and provenance?
5.5Are controls in place to detect adversarial data poisoning or manipulation?
5.6Do you mitigate prompt injection and insecure output handling in your AI applications? Please explain how?
5.7Is model versioning documented with traceability of updates?
6AI Security
6.1Does the AI system fall into a high‑risk category
6.2Does your information security policies include content on AI security?
6.3Are security measures implemented to safeguard AI systems from external threats, such as cyberattacks or unauthorized access?
6.4Does your AI system have a FedRAMP instance/environment with the necessary security standards, that provides a framework for agencies/local governments to determine if the cloud service falls within the required FedRAMP level? What impact level is it certified?
6.5Are you outsourcing any AI processing to a 3rd party? If yes, do you have an agreement that holds them accountable for the data protection?
6.6Does your incident response plan include AI incidents in their scope?
6.7Do you perform periodic testing on your AI system/components that includes but is not limited to penetration testing and red-teaming?
6.8Do you implement input validation and sanitization measures to ensure user input adheres to defined limits and filters out malicious content?
6.9Do you have appropriate authentication practices in place, such as OAuth 2.0, to implement effective authorization and access control to AI systems?
6.10Do you enforce privilege control on LLM access to backend systems and follow the principle of least privilege by restricting the LLM to the minimum level of access required for its intended use?
6.13Do you enforce containerization on all mobile devices that may contain organizational data, including email, whether those devices are owned by the organization or by employees?
6.14Do you have the capability of deleting all organizational data from mobile devices, whether owned by the organization or by employees, in the event that the device is lost or stolen?
6.15Does the AI system process sensitive data and is it properly protected? If yes, how do you protect against sensitive information disclosure and model theft?
6.16Are outputs reviewed for unintended disclosure of sensitive information?
6.17Are model weights and configurations encrypted at rest and in transit?
6.18Are third-party AI components subject to contractual cybersecurity requirements?
6.19Are third-party model dependencies assessed for vulnerabilities?
6.20Are vendor updates tested for security impact?
6.22Is access to model artifacts restricted by authentication and authorization?
6.23Is the AI deployment environment secured (patching, segmentation, monitoring)?
7Privacy
7.1Do you have a data retention policy and process that is designed to meet relevant privacy regulations?
7.2Do you maintain an inventory and mapping of where all personal data is stored that includes cross-border data flows?
8AI Incident Management
8.1Are security configuration baselines defined and implemented for all endpoints and network devices?
8.2Do you segregate your network into zones based on trust levels and control the flow of traffic between zones?
8.3Does your incident response plan include AI-specific threats (prompt injection, model compromise)
8.4How does your incident response playbook specifically address adverse events?

Provide evidence of how you classify, track, and report unauthorized use of personal data or synthetic media misuse to ensure the County meets its citizen's obligations.

8.5Are all AI security incidents recorded, classified, and tracked?
8.6Are forensic investigations conducted as part of incident response?
8.7Have you deployed automated tools to collect, correlate, and analyze security event logs from multiple sources for anomalies?
8.8Are security alerts monitored 24/7?
8.9Are interactions via APIs or prompts monitored for misuse?

Change Log

VersionDateUpdated ByChange SummaryNotes
v1.03/16/26Michael FarrInitial version block added; no question content changed.Baseline established.
v1.15/5/26Michael FarrUpdated questions: 1.4, 3.4, 3.8,8.4Policy jargon removed. More detailed questions. Moving away from yes/no answers.

Baseline

AI Vendor Security Questionnaire
Vendor to complete vendor identification section and then respond to all questions. If documents are requested, please use "Insert object" to attach the document directly into the Vendor Comments cell.
Vendor Name:e.g. ACME Inc.
Completed By:Name of person responding
Date Completed:
#QuestionVendor ResponseVendor Comments
1Document Requests
1.2Please attach a copy of any relevant audit reports that cover information security controls (e.g. SOC 2).Attached
1.3Please attach a copy of your latest penetration test and/or vulnerability assessment report.Attached
1.4Please provide AI architecture diagram illustrating end-to-end AI workflows, including data ingestion, processing, model interaction, and output layers, with emphasis on data flow, governance, and security controls.Attached
1.5Please attach copies of Model Cards or Transparency Cards. If you don't have them, explain why?Attached
2Asset Management
2.1Do you maintain an inventory of all hardware and software,AI/ML, and data(training,operational or other assets, including ownership?Partial (Please explain)
2.2Do you have an information classification scheme and process designed to ensure that information is protected according to its confidentiality requirements?Yes
2.3Do you maintain an inventory or map of data flows between both internal and external information systems?No
2.4Do you classify each data type (training, operational or other data) used by the AI systemsYes
2.5Do you adhere to OWASP guidelines for application security, including the OWASP Top 10 for AI/LLM applications?
2.6Are AI-specific gaps identified and documented?
2.7Are parameter values tailored for AI system risks?
3Governance
3.1Have you documented your AI risk management approach in alignment with NIST AI RMF core functions (Govern, Map, Measure, Manage)?Yes
3.2Can you provide evidence of controls for privacy, security, and resilience as per NIST AI RMF guidance?Not applicable (Please explain)
3.3Do you have a process for reviewing your information security policy?Partial (Please explain)
3.4Do you conduct regular risk assessments for fairness, transparency, and accountability as outlined in NIST AI RMF?Partial (Please explain)
3.5Have you designated an individual, who is at least at a manager level, who is responsible for information security activities?No
3.6Do you have a process designed to monitor changes to regulations and ensure compliance with relevant security requirements?Yes
3.8Are controls in place to detect adversarial data poisoning or manipulation?
3.9Is model versioning documented with traceability of updates?
3.10Are availability requirements defined for the AI system?
3.11Are backup/restore procedures for model artifacts implemented and tested?Partial (Please explain)
3.12Is the AI system explainable and transparent to stakeholders?
3.13Are safeguards in place for bias, fairness, and harmful output?
3.14Describe processes for bias testing and mitigation in AI models
3.15Are adverse events or misuse incidents tracked?
3.16Are mechanisms in place to detect model drift or degradation?
4Life Cycle Management
4.1Is an AI system lifecycle defined from design to decommissioning?
4.2Has AI ownership and accountability been defined across the lifecycle?
4.3Have you implemented controls aligned with the NIST AI Risk Management Framework (AI RMF) for managing AI-related risks across the lifecycle?
4.4Are prompt restrictions or output filtering mechanisms implemented?
4.5For agent systems, is supervision and oversight defined?
4.6Are periodic performance and security reviews conducted?
4.7Are AI system logs and audit trails maintained?
5Data and Model Integrity
5.1Do any AI components train on Hillsborough County data? If yes, describe isolation and consent controls.”
5.2Where is AI training performed (region, cloud provider)?
5.4Are training data sources validated for accuracy, integrity, and provenance?
5.5Are controls in place to detect adversarial data poisoning or manipulation?
5.6Do you mitigate prompt injection and insecure output handling in your AI applications (OWASP LLM01 & LLM02)? Please explain
5.7Is model versioning documented with traceability of updates?
6AI Security
6.1Does the AI system fall into a high‑risk category
6.2Does your information security policies include content on AI security?
6.3Are security measures implemented to safeguard AI systems from external threats, such as cyberattacks or unauthorized access?
6.4Does your AI system have a FedRAMP instance/environment with the necessary security standards, that provides a framework for agencies/local governments to determine if the cloud service falls within the required FedRAMP level? What impact level is it certified? Level(1-6)
6.5Are you outsourcing any AI processing to a 3rd party? If yes, do you have an agreement that holds them accountable for the data protection?
6.6Does your incident response plan include AI incidents in their scope?
6.7Do you perform periodic testing on your AI system/components that includes but is not limited to penetration testing and red-teaming?
6.8Do you implement input validation and sanitization measures to ensure user input adheres to defined limits and filters out malicious content?
6.9Do you have appropriate authentication practices in place, such as OAuth 2.0, to implement effective authorization and access control to AI systems?
6.10Do you enforce privilege control on LLM access to backend systems and follow the principle of least privilege by restricting the LLM to the minimum level of access required for its intended use?
6.13Do you enforce containerization on all mobile devices that may contain organizational data, including email, whether those devices are owned by the organization or by employees?
6.14Do you have the capability of deleting all organizational data from mobile devices, whether owned by the organization or by employees, in the event that the device is lost or stolen?
6.15Does the AI system process sensitive data and is it properly protected? If yes, how do you protect against sensitive information disclosure and model theft (OWASP LLM06 & LLM10)?
6.16Are outputs reviewed for unintended disclosure of sensitive information?
6.17Are model weights and configurations encrypted at rest and in transit?
6.18Are third-party AI components subject to contractual cybersecurity requirements?
6.19Are third-party model dependencies assessed for vulnerabilities?
6.20Are vendor updates tested for security impact?
6.22Is access to model artifacts restricted by authentication and authorization?
6.23Is the AI deployment environment secured (patching, segmentation, monitoring)?
7Privacy
7.1Do you have a data retention policy and process that is designed to meet relevant privacy regulations?
7.2Do you maintain an inventory and mapping of where all personal data is stored that includes cross-border data flows?
8AI Incident Management
8.1Are security configuration baselines defined and implemented for all endpoints and network devices?
8.2Do you segregate your network into zones based on trust levels and control the flow of traffic between zones?
8.3Does your incident response plan include AI-specific threats (prompt injection, model compromise)? Provide playbook excerpts.
8.4Are all AI security incidents recorded, classified, and tracked?
8.5Are forensic investigations conducted as part of incident response?
8.6Have you deployed automated tools to collect, correlate, and analyze security event logs from multiple sources for anomalies?
8.7Are security alerts monitored 24/7?
8.8Are interactions via APIs or prompts monitored for misuse?

3. Lists (Hidden)

Data Entry Lists
This tab controls the lists that are used for the data entry tab. Hide this tab when not in use.
Valid responses for document request questions
Attached
Not attached (Please explain)
Not applicable
Valid responses for all other questions
No
Partial (Please explain)
Yes
Not applicable (Please explain)

File details come from the government source that posted it. Updated .