Final Big Data Extration RFI.pdf
PDF 371 KB Posted
- Attached to
- FBI Big Data Extraction Tool
- Solicitation number
- Not on record
About this file
This is a Request for Information (RFI) issued by the Federal Bureau of Investigation's (FBI) Finance and Facilities Division, Procurement Section, seeking information on big data extraction software and services. The RFI targets large and small businesses with capabilities in big data processing, specifically for the Enterprise Data Analytics Section (EDAS). The agency is looking for software solutions and technical expertise to support ETL (extraction, transformation, and loading) processes, with a focus on technologies compatible with Apache Spark, capable of operating in IL 5 and IL 6 environments, and supporting advanced analytics.
Key requirements include software that can handle complex datasets, provide notebook-style development interfaces, support CPU and GPU clusters, integrate with AWS cloud services, and offer AI capabilities such as SparkNLP and Large Language Model compatibility. Responses are due by 12pm Eastern Time on November 21, 2025, to be submitted electronically to Brandon James. The potential performance locations are FBI facilities in Huntsville, Alabama, or the National Capital Region, with an anticipated delivery timeframe of early 2026 through the end of the fiscal year. Respondents must have a Government Top Secret Facility Clearance and submit a 5-page capabilities package demonstrating their technical abilities.
View the file
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
FEDERAL BUREAU OF INVESTIGATION
FINANCE AND FACILITIES DIVISION | PROCUREMENT SECTION
REQUEST FOR INFORMATION (RFI) TEMPLATE
Request for Information (RFI) Big Data Extraction Version 1.2 Page 1
REQUEST FOR INFORMATION (RFI)
Big Data Extraction
November 21, 2025
Acquisitions Administrative Unit
Request for Information (RFI) Big Data Extraction Version 1.2 Page 2
Disclaimer:
THIS NOTICE IS FOR INFORMATIONAL PURPOSES ONLY. THIS IS NOT A REQUEST
FOR PROPOSAL OR QUOTE. IT DOES NOT CONSTITUTE A SOLICITATION AND
SHALL NOT BE CONSTRUED AS A COMMITMENT BY THE GOVERNMENT.
RESPONSES IN ANY FORM ARE NOT OFFERS AND THE GOVERNMENT IS UNDER
NO OBLIGATION TO AWARD A CONTRACT AS A RESULT OF THIS
ANNOUNCEMENT. NO FUNDS ARE AVAILABLE TO PAY FOR PREPARATION OF
RESPONSES TO THIS ANNOUNCEMENT. ANY INFORMATION SUBMITTED BY
RESPONDENTS TO THIS TECHNICAL DESCRIPTION IS STRICTLY VOLUNTARY.
Introduction:
The United States Department of Justice (DOJ), Federal Bureau of Investigation (FBI), is requesting information and conducting research by process of Request for Information (RFI) to identify qualified vendors who possesses the capabilities and software to provide support services that directly supports the FBI’s big data processing requirements and adhere to the FBI; DOJ;
Information Technology Applications & Data Division (ITADD); Enterprise Data Analytics Section (EDAS); initiatives. The information gathered may be used to formulate acquisition strategies for competitive solicitations. This RFI is open to *large and small businesses*.
Responses will be reviewed and maintained by the United States Federal Government.
Background:
The Federal Bureau of Investigation (FBI) is an intelligence-driven and threat-focused national security organization with both intelligence and law enforcement responsibilities. The EDAS mission is to provide the FBI with operational data discovery, exploitation, analytics, and visualization tools. The extraction, transformation, and loading (ETL) of raw data into actionable intelligence is a core enabler of EDAS delivering on its mission. Big data technologies are required to perform ETL and analytic processes due to the volume, velocity, variety, value, and veracity of the enterprise data stewarded by EDAS. The Section continually strives to explore, adapt, and implement the best processes and technologies known within the software industry.
EDAS is looking for effective and optimal technologies and solutions that enable the extraction, transformation, and data analysis of big data at scale. Specifically, EDAS is looking for big data software solutions and technical expertise to set up and train FBI personnel on the software in order support EDAS ETL and analytic processes. The expertise and solutions will help ensure that EDAS can continue to deliver on the FBI’s mission today and into the future.
Request for Information (RFI) Big Data Extraction Version 1.2 Page 3
EDAS currently uses Databricks software to serve as the backbone of a data lake architecture while enabling enterprise ETL processes. A variety of datasets with differing levels of complexities are streamed and batch processed into an enterprise data lake. A message queuing service is used to collect and send new records from datasets in the data lake to the incumbent big data technology for data transformation and enrichment using the Apache Spark framework.
Enrichments are done through user-defined functions, internal APIs, and AI solutions. A medallion architecture is followed and development, data triage, and bug fixes are typically done in a notebook environment. The output is written to a cloud native big data search technology.
EDAS' data lake architecture supports numerous categories of unclassified, classified, or otherwise sensitive data with layered access controls, governance, and workflow requirements, based on legal and policy guidance. Downstream analytics and visualization tools may be restricted to certain categories of data and the corresponding legal and policy requirements.
Contractor Qualifications:
This RFI is open to *large and small business concerns* for market research only to request input from potential providers with expertise in information technology services.
Furthermore, this RFI aims to identify large or small business firms with the software available and capacity to provide on-site consultants at the commencement of the period of performance. The government reserves the right to reach out directly to OEM’s for solutions or for any potential demonstrations.
The professional firm shall have an active Government Top Secret Facility Clearance.
The Government would like to know which firms can provide the software & services for this contemplated requirement by identifying themselves and responding to this RFI. The Government requests the following information:
1. Company name, company address, company business size, and company point-of-contact (POC) name, phone number and e-mail address.
2. Company profile to include number of employees, office location(s), CAGE Code, DUNS number, and a statement regarding current small/large business status.
3. System for Award Management (SAM) registered NAICS codes.
4. Provide capabilities to demonstrate ability to provide the requested services and/or products required (i.e., technical ability, personnel, and experience). Information provided shall be succinct and related to the requested information in this RFI. All submissions shall be unclassified.
5. Address what contract vehicles your company has in place and if they are capable of providing these services on schedule. If able to provide the services on schedule, Request for Information (RFI) Big Data Extraction Version 1.2 Page 4 provide the schedule and SIN.
6. Any other assumptions, comments, concerns, and/or questions relating to the contemplated services.
Required Information:
Contractor Legal/DBA Name:
Address:
Point of Contact:
Telephone:
Email Address:
DUNS Number:
Cage Code:
Facility Clearance (if applicable):
Applicable NAICS Codes:
Standard Business Size:
GSA Schedule:
Contemplated Requirements:
1. The proposed software must be available in both IL 5 and IL 6 environments (Unclassified and Secret).
a. Is the software available on both environments? Is it also available on Top Secret?
b. Is there functionality parity between the software offerings on both environments?
2. Describe the distributed big data processing framework that the solution leverages. Does your solution allow for Apache Spark to be used as the framework?
a. Is the solution compatible with Delta tables and the parquet file format?
3. An interactive and intuitive development interface is needed to facilitate rapid code development, bug triage, and data visualization. Describe your development interface.
a. Is there a notebook-style interface similar to Jupyter Notebooks, Apache Zeppelin, Google Colab, or Databricks Notebooks?
b. If so, are the notebooks portable?
c. What programming languages can be used within your environment?
4. Describe your solution’s compute cluster management capabilities.
a. Can CPU and GPU cluster be used?
b. Can clusters be created using Amazon Web Service (AWS) managed services, to include Elastic Compute Cloud (EC2) instances?
Request for Information (RFI) Big Data Extraction Version 1.2 Page 5
c. Does the solution facilitate cluster autoscaling based on job size?
d. Does the solution facilitate auto termination after a set period of inactivity?
5. Describe the inherent and compatible Artificial Intelligence (AI) capabilities of the solution.
a. Is your solution compatible with SparkNLP?
b. Does the solution integrate with Large Language Models (LLMs)?
c. Is there an AI code assistant built into the solution?
6. Describe your solutions ability to meet requirements, such as those set forth in EO14028 (centralized logging) for auditing, reporting, alerting, and compliance.
7. What job orchestration and workflow management functions exist within the solution?
a. Can tasks be scheduled on a reoccurring basis?
b. Does the solution support GitLab CI/CD pipelines?
8. Describe the deployment process of the solution.
a. Can it be deployed on and integrated with AWS cloud services?
9. If the solution is a cloud service, is the service authorized at FedRamp High impact level?
10. Data will need to be migrated from legacy software to the new solution. It is preferred that current on-site staff perform the migration, but the awardee will need to be available for on-site consultation.
a. How to do propose completing this task?
b. Does anyone require specific skill sets to perform this work?
c. Will any AI/LLM be used to migrate the data? If so, which one?
Place of Performance:
The primary place of performance will be FBI facilities on Redstone Arsenal in Huntsville, Alabama or the National Capital Region (Chantilly, VA/Washington DC).
Anticipated Delivery:
The potential delivery timeframe will be between early 2026 until the end of the fiscal year. Please keep in mind that the Government is not committed to this time frame as the requirement is not fully developed.
Disclaimer and Responses:
As permitted by FAR Part 10, this is a market research tool being utilized for informational and planning purposes. Your responses will assist the Government in the development of its acquisition strategy for a potential Request for Proposal (RFP) or Request for Quote (RFQ) at a later date.
This notice shall not be construed as an RFP/RFQ or as any commitment or obligation on the part of the Government to issue a solicitation. The Government does not intend to award a contract based on this request, so proposals will not be considered. No reimbursement will be made for any costs associated with providing information in response to this synopsis or any follow-up information requests.
Request for Information (RFI) Big Data Extraction Version 1.2 Page 6
WHAT SHOULD BE INCLUDED IN YOUR RESPONSE
1. All interested parties shall submit capability packages in response to this notice.
2. Do submit succinct, thoughtful responses to the requirements/questions listed in this RFI.
3. Do submit comments that address the FBI's requirements, assumptions, conditions, or contemplated approaches to this future acquisition.
4. Do submit information and suggestions that may encourage new, different, or innovative approaches that would result in products, solutions, and direct savings to the FBI.
WHAT SHOULD NOT BE INCLUDED IN YOUR RESPONSE
1. Do not submit proposals or offers.
2. Do not submit past performance information or general descriptions of corporate experience.
3. Do not submit requests to be considered for award or to be notified of a future solicitation.
4. Do not submit requests to be added to a mailing list or distribution list.
5. Do not submit questions or comments not related to this RFI.
6. Do not respond via telephone.
Submittal Instructions:
It is requested that interested businesses submit to the Contracting Office a brief capabilities package using Word, Excel, or PDF searchable format 8 ½ * 11-page size, no more than 5 pages in length, single spaced, 12-point font, one-inch margins, Times New Roman Font, demonstrating ability to meet the FBI’s requirements.
Information must be furnished electronically, (Email) to the Contracting Officer, Brandon James (bmjames@fbi.gov) no later than 12pm Eastern Time on November 21, 2025. The government reserves the right to answer questions or comments regarding this RFI. Any questions or comments may be sent to the contracting officer. No phone calls will be accepted regarding this RFI. Feedback regarding RFI responses will not be provided.
This RFI is for planning purposes only and shall not be considered as a request for proposal or an obligation on the part of the FBI to acquire and products or services. No entitlement to payment of direct or indirect costs or charges by the FBI will arise as a result of contractor submission of responses to this RFI or the FBI’s use of such information. The FBI reserves the right to reject, in whole or in part, any contractor’s
Request for Information (RFI) Big Data Extraction Version 1.2 Page 7 input resulting from this RFI. Responses to this RFI will not be returned. The FBI may request demonstrations or request to test products after the review of proposals are completed. All questions regarding the RFI shall be in writing prior to submission date.
The cost of responding to this RFI shall be exclusively borne by the contractor and no costs will be reimbursed by the FBI.
Attachment AS - Request for Information (RFI) Template
Version 1.2 Page 8
| Introduction: |
| Place of Performance: |
| Submittal Instructions: |
File details come from the government source that posted it. Updated .