StatementofWork.docx

STATEMENT OF WORK

TITLE: WEB COLLECTING AND ARCHIVING SERVICE

I. BACKGROUND INFORMATION

The National Library of Medicine (NLM) in Bethesda, Maryland, is part of the National Institutes of Health, US Department of Health and Human Services (HHS). NLM, the world’s largest biomedical library, acquires and preserves biomedical literature from throughout the world in all formats and languages. The Collection Development and Acquisitions Section in the Technical Services Division builds the NLM modern biomedical literature collection, including electronic journal subscriptions. To fulfill the library’s mandate in its authorizing legislation (Public Law 84-941) to collect, preserve and make accessible literature in the biomedical and health sciences, it is essential that NLM collect born digital web materials. NLM also needs to collect popular literature, in a selective manner, with an emphasis on works impacting public policy, individual behavior, or demonstrating perspectives not found in the technical literature. New forms of publication on the web, such as blogs, may be of interest to historians in the future. Various NLM program areas need to build web-based digital collections to support their missions.

II. OBJECTIVES

The purpose of this contract is to procure the web collecting and archiving service which will meet the specific needs and requirements of the National Library of Medicine.

III. SERVICES

A. General Requirements

1. Independently and not as an agent of the Government, the Contractor shall furnish all the necessary services, qualified personnel, equipment, and facilities needed to perform the requirements.

2. All work under this contract shall be monitored by the Contracting Officer’s Representative (COR) whose position is defined in the contract.

B. Specific Requirements

1. Ability to capture a range of content and file types using different frequencies on an automated basis, including daily, weekly, and monthly.

2. Ability to capture content manually on demand.

3. Data must be securely stored and accessible to NLM in a 24/7 facility using a standard web browser.

4. Data must be preserved in its original, captured form and cannot be altered except on a temporary basis to render the data for viewing.

5. Data must be stored in a container format using the ISO28500 standard, WARC (Web ARChive) file format, which permits one file to carry a very large number of constituent data objects for the purpose of storage, management, and exchange.

6. Archived content must include, but not be limited to: html, images, videos, audio, blogs, social networking sites, and online news articles.

7. Service must include ability to browse collections by URL and search collections via full text search.

8. Service must include the option to allow public access to web archive content as well as keep some collection content private if needed.

9. Service must include ability to capture content organized into multiple web archive collections, conduct, and maintain test crawls, and enter and maintain associated metadata.

10. Service must include ability to add multiple metadata fields at the collection, seed, and document level.

11. Service must include hosting of the captured data and storage of a primary and back-up copy.

12. Service must host data in the context of other archived web collections by cultural heritage institutions, allowing the public to search across all web collections for archived health and medical information.

13. Service must include scoping tools to expand or limit the extent of the crawl and content.

14. Service must include web application training for key NLM users, help documentation, and advanced training and technical support.

15. Service must have ability to export collections and metadata for ingest into the NLM Digital Collections repository.

16. Service must support web archive research and data visualization.

IV. REPORTING REQUIREMENTS AND DELIVERABLES

1. Service must provide detailed reports about crawling activities, including a high-level summary of how that crawl was conducted and whether it completed within expected data and time limits, a summary of how much total content was crawled and how much if any new data was added to a collection, and documentation of seed URLs crawled, scoping rules, hosts of content, and file types captured.