Web Harvesting Services - Library of Congress
Closed Solicitation Posted
This opportunity was awarded. See the award notice from .
- Solicitation number
- 030ADV26R0010
- Agency
-
Library of Congress
- Responses due
- Set-aside
- No set-aside
Opportunity facts
- NAICS code
- 518210 Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
- Place of performance
- Washington, District of Columbia, United States
- Points of contact
Notice details come from SAM.gov. Updated .
About this opportunity
The Library of Congress is procuring web harvesting services through an Indefinite-Delivery, Indefinite-Quantity (IDIQ) firm-fixed-price contract competition to systematically harvest web content at scale, provide temporary access for quality review, and enable content transfer for preservation and public access. Contractors must perform crawls using multiple crawling technologies, maintain dual copies of harvested content (primary and disaster recovery), deliver content in WARC format with CDX indexes within five business days of crawl completion, and ensure all infrastructure is physically located in the United States. The solicitation employs a best-value tradeoff evaluation methodology with technical factors equally weighted and significantly more important than price, assessing proposals across technical approach, sample web crawl results, corporate experience and capabilities, and pricing. Key personnel requirements include a Program Manager with five years of experience, a Crawl Engineer with five years of experience, and a Quality Assurance Lead with two years of experience. The original question deadline was February 2, 2026 at 12:00 Noon EST, with proposals initially due February 24, 2026 at 5:00 PM EST; however, Amendment 5 extended the proposal deadline to March 3, 2026 at 5:00 PM EST, while the sample web crawl transfer information deadline remained February 17, 2026 at 5:00 PM EST, and Past Performance Questionnaires are due March 3, 2026 at noon EST.
No set-aside designation applies to this solicitation, and the government has not identified any incumbent contractor information. The contract carries a minimum guarantee of $300,000 and a maximum value of $15,000,000 over a five-year base period running from June 1, 2026 through May 31, 2031, with minimum task order values of $300,000 and maximum single order values of $5,000,000. The Library anticipates annual crawl volumes of 300-700 terabytes, with pricing evaluated on a per-terabyte basis using total compressed WARC file size as the invoiced metric. Performance occurs in Washington, DC, with crawling infrastructure required to be maintained in contractor-owned facilities within the United States, potentially utilizing multi-region U.S. cloud availability zones. Offerors must be registered in the System for Award Management (SAM) and must submit four proposal volumes addressing technical approach (maximum 30 pages), sample web crawl results, corporate experience and capabilities, and pricing in accordance with the specified evaluation criteria.
Notice text
8 versions
Update #8 · Latest ·
Amendment 7 - The purpose of this solicitation amendment is to clarify that offerors’ Past Performance Questionnaires (Attachment J3) are due at noon on March 3, 2026.
The PPQ previously stated a due date of February 24, 2026, but the Library amended the solicitation for a one-week extension via Amendment 0005. Attachment J3 and the solicitation Q&A document are updated to reflect the March 3 due date and time.
If your PPQs are already received and/or your references submit the PPQ with the February deadline, they are and will still be accepted.
As a reminder, the solicitation extension from Amendment 0005 does not extend the due date of sample web crawl transfer information which was required by 5:00pm eastern time on February 17, 2026.
The Library is not accepting additional questions as the question due date passed several weeks ago.
- - - - - - - - - - -
Amendment 6 - The purpose of this solicitation amendment is to provide a revised version of Attachment J9, dated 2/19/2026. This version includes an answer to one late question (# 33) pertaining to SAM registration. Revisions are indicated in red.
Apart from these changes, no other changes are made.
- - - - - - - - - - -
Amendment 5 - The purpose of this solicitation amendment is to extend the proposal due date by one week. Proposals are now due by 5:00pm Eastern time on March 3, 2026. This extension does not extend the due date of sample web crawl transfer information
which was required by 5:00pm eastern time on February 17, 2026.
Apart from this, no other changes are made to the solicitation and its attachments. It is the responsibility of the offeror
or interested party to monitor changes made to the solicitation on SAM.gov.
- - - - - - - - - -
Amendment 4 - The purpose of this solicitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/13/2026. This version of Attachment J9 provides answers to questions 31 and 32, which are marked in red text.
- - - - - - - - - -
Amendment 3 - The purpose of this solcitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/03/2026. This version of Attachment J9 provides answers to questions the Library has received in reponse to the soliciation.
- - - - - - - - - -
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #7 ·
Amendment 6 - The purpose of this solicitation amendment is to provide a revised version of Attachment J9, dated 2/19/2026. This version includes an answer to one late question (# 33) pertaining to SAM registration. Revisions are indicated in red.
Apart from these changes, no other changes are made.
- - - - - - - - - - -
Amendment 5 - The purpose of this solicitation amendment is to extend the proposal due date by one week. Proposals are now due by 5:00pm Eastern time on March 3, 2026. This extension does not extend the due date of sample web crawl transfer information
which was required by 5:00pm eastern time on February 17, 2026.
Apart from this, no other changes are made to the solicitation and its attachments. It is the responsibility of the offeror
or interested party to monitor changes made to the solicitation on SAM.gov.
- - - - - - - - - -
Amendment 4 - The purpose of this solicitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/13/2026. This version of Attachment J9 provides answers to questions 31 and 32, which are marked in red text.
- - - - - - - - - -
Amendment 3 - The purpose of this solcitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/03/2026. This version of Attachment J9 provides answers to questions the Library has received in reponse to the soliciation.
- - - - - - - - - -
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #6 ·
Amendment 5 - The purpose of this solicitation amendment is to extend the proposal due date by one week. Proposals are now due by 5:00pm Eastern time on March 3, 2026. This extension does not extend the due date of sample web crawl transfer information
which was required by 5:00pm eastern time on February 17, 2026.
Apart from this, no other changes are made to the solicitation and its attachments. It is the responsibility of the offeror
or interested party to monitor changes made to the solicitation on SAM.gov.
- - - - - - - - - -
Amendment 4 - The purpose of this solicitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/13/2026. This version of Attachment J9 provides answers to questions 31 and 32, which are marked in red text.
- - - - - - - - - -
Amendment 3 - The purpose of this solcitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/03/2026. This version of Attachment J9 provides answers to questions the Library has received in reponse to the soliciation.
- - - - - - - - - -
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #5 ·
Amendment 4 - The purpose of this solicitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/13/2026. This version of Attachment J9 provides answers to questions 31 and 32, which are marked in red text.
- - - - - - - - - -
Amendment 3 - The purpose of this solcitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/03/2026. This version of Attachment J9 provides answers to questions the Library has received in reponse to the soliciation.
- - - - - - - - - -
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #4 ·
Amendment 3 - The purpose of this solcitation amendment is to provide an updated version of the Q&A document, Attachment J9, dated 02/03/2026. This version of Attachment J9 provides answers to questions the Library has received in reponse to the soliciation.
- - - - - - - - - -
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #3 ·
Amendment 2 - The purpose of this solicitation amendment is to update the submission due date in Attachment J3 and to provide Attachment J9, which provides answers to questions the Library has received thus far.
- - - - - - - - - -
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #2 ·
Amendment 1 - The purpose of this solicitation amendment is to update the information submission date in Attachment J2a – Sample Web Crawl Requirement. Please see the attached amendment document.
- - - - - - - - - -
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Update #1 ·
This public notice is a combined synopsis/solicitation for commercial supplies and services, prepared in accordance with FAR Part 12 and utilizing FAR Part 15 procedures. The solicitaiton is being released as a firm-fixed price contract competition.
The Library of Congress (Library) requires contract support to enable the systematic harvesting of content at-scale from the web, based on instructions from Library staff, to provide temporary access to the content and required crawl reports for quality review, and to enable transfer of content to the Library for preservation and public access.
Please see below for the SF1449 Request for Proposal document 030ADV26R0010 for the full details of the requirement.
Questions are due no later than 12:00 Noon EST on 02/02/2026. Answers will be posted as an amendment to the solicitation.
Proposals are due no later than 5:00 PM EST on 02/24/2026.
Files
Show all 25
Notice history
| Notice | Type | Posted |
|---|---|---|
| Web Harvesting Services - Library of Congress | Award Notice | |
| This notice | Solicitation |
On GovTribe
Work this opportunity
- Track it in your pipeline
- Find teaming partners
- Similar opportunities
- Ask GovTribe AI about this opportunity