AMENDMENT TWO (2) - CryoEM_Storage_GPU_nodes - NICHD-21-233.pdf

AMENDMENT TWO (2)

No further questions will be accepted regarding this solicitation

MICEF storage server and GPU compute nodes

RFQ ID: NICHD-21-133

Amendment Two is hereby released to provide clarification to the questions received in response to the subject solicitation issued August 12, 2021.

We would like to order one storage server and two GPU servers for our cryoEM facility to store about 500 terabytes of data and on-the-fly image processing of data collected using Titan Krios microscopes.

This high speed microscope generates several thousands of images per day for a total of 3-6 terabytes.

The data collected from the microscope would be save using a 10G connection to the storage device and simultaneously processed by the GPU nodes by accessing the data on the storage node using the InfiniBand connection. Hence we have very specific requirements.

1x storage server

• Motherboard : Intel® C622 Chipset - 10x SATA3 - 2x M.2 NVMe - Dual Intel® 10-Gigabit Ethernet (RJ45)

• Processor ": 2 x Intel® Xeon® Gold 6226R Processor 16-Core 2.9GHz 22MB Cache (150W)

• Memory: 16 x 16GB PC4-25600 3200MHz DDR4 ECC RDIMM

• Chassis : 4U Chassis - 36x Hot-Swap 3.5" SAS - 12Gb/s SAS Single Expander 1200W 1+1

Redundant Power

• M.2 Drive : 2 x 480GB Micron 7300 PRO Series M.2 PCIe 3.0 x4 NVMe Solid State Drive –

Operating System Drive - RAID 1

• Operating System : Ubuntu Linux 20.04 LTS Server Edition (64-bit)

• Storage Drive : 36 x 16TB SAS 3.0 12.0Gb/s 7200RPM - 3.5" - Ultrastar™ DC HC550

(512e/4Kn)

• 32 x 16GB storage configure as RAID 5 and a spare with about 480 TB storages space

• Controller Card : SAS 12Gb/s PCIe 3.0 8-Port Controller with 2GB Cache

• Network Card : 2 x Mellanox 100Gb/s EDR InfiniBand Adapter ConnectX-5 – PCIe 3.0 x16

• Server Management : Supermicro Update Manager (OOB Management Package)

• Warranty : 5 Year Advanced Parts Replacement Warranty and NBD Onsite Service

• dual 10G -> to connect to the planned Arista DCS-7050T-64-F switch

• 2x Mellanox 100Gb/s EDR InfiniBand Adapter - PCIe 3.0 x16 -> to connect to the 2 GPU servers directly and to have 2 extra slots in case we upgrade to more servers

Two GPU servers

• AMD EPYC™ 7002 Series - 4U GPU Server - 24x Hot-Swap 2.5" SATA/SAS3 - 4x U.2

NVMe - 2000W 2+2 Redundant Power

• Processor : 2 x AMD EPYC™ 7443 Processor 24-core 2.85GHz 128MB Cache (200W)

• Memory : 16 x 32GB PC4-25600 3200MHz DDR4 ECC RDIMM

• U.2/U.3 NVMe Drive 2 x 960GB 2.5” U.3 15mm PCIe 4.0 x4 NVMe Solid State Drive

(1xDWPD)(SIE)- Operating System - RAID 1

• Operating System : Ubuntu Linux 20.04 LTS Server Edition (64-bit)

• 2 x 6.4TB 2.5” U.3 15mm PCIe 4.0 x4 NVMe Solid State Drive – Scratch space - RAID 0

• GPU cards: 6 x NVIDIA® A10 GPU Computing Accelerator - 24GB GDDR6 - Passive Cooler

• Network Card : Intel® 10-Gigabit Ethernet Converged Network Adapter X550-T1 (1x RJ-

45)

• Mellanox 100Gb/s EDR InfiniBand Adapter ConnectX-5 - PCIe 3.0 x16

• Server Management : Supermicro Update Manager (OOB Management Package)

• Warranty : 5 Year Advanced Parts Replacement Warranty and NBD Onsite Service

• Intel® 10/40-Gigabit Ethernet Converged Network Adapter XL710-QDA1 (1x QSFP+) -> to connect to the switch

• Mellanox 100Gb/s EDR InfiniBand Adapter ConnectX-5 VPI (1x QSFP28) - PCIe 3.0 x16 -> to connect to the storage server directly

Can we also add a spare 16TB hard drives, 960 NVMe, and a 6.4TB NVMe?