Attachment 1 - Scalable Internet Simulator Specification_updated FINAL.docx

Scalable Internet Simulator

SPECIFICATIONS

Scalable Internet Simulator

NRL requires the ability to model networks at Internet scale in order to perform the most realistic evaluations possible, to obtain realistic and statistically significant results, and to make meaningful conclusions regarding the effectiveness of our communication technologies. Internet-scale simulations allow us to improve our understanding of how R&D algorithms and protocols perform on operational networks at scale before incurring the costs and risks associated with a full deployment on real Navy communication networks.

Dedicated high performance computing hardware is necessary to faithfully model and simulate Navy and DoD networks at Internet scale. Internet-scale models and simulations require a significant amount of storage, memory, and computational resources due to the number of network and host components that must be modeled and simulated in order to ensure a realistic environment that is capable of faithfully reproducing Internet characteristics. Our Internet-scale models, simulations, and R&D tools will consume full system resources in operation.

The following specifications are for machines and components that will compose a computer system for carrying out Internet-scale simulations.

A. Requirements

1) Warranty: remote troubleshooting, email and phone support, repair service, and cross-shipping of replacement parts. Support services shall be provided for no less than 36 months.

B. Specifications

1) GPU Server

1U GPU Server with Intel C621 Chipset Quantity: 2

Each of the 2 servers MUST include (but are not limited to including) minimum capabilities similar to the following:

i. 2 x Intel Xeon Platinum 8260 CPUs, each with a min clock speed of 2.4GHz and 24 cores

ii. 768GB DDR4 ram (64GB x 12) at a min speed of 2666MHz (DDR4 ECC LR-DIMM).

iii. 4 x Nvidia Tesla V100 GPU Cards, PCIe 3.0 x16, each with at least 32GB HBM2

iv. 1 x 1TB NVMe SSD (M.2 PCIe 3.1 x4)

v. 2 x 2TB SATA Hard Drives (2.5 inch, 6.0Gb/s, 7200RPM)

vi. 2 x 960GB SATA SSDs (2.5 inch, 6Gb/s, 1.2 DWPD)

vii. On-board Intel X540 Quad-Port 10GBase-T RJ45 Gigabit Ethernet Controller

viii. 1 x Intel X710-DA2 Ethernet Network Adapter, Dual-Port 10GbE SFP+, PCIe 3.0 x8

ix. 1 x Mellanox ConnectX-5 InfiniBand/VPI Network Adapter, Dual-Port EDR (100Gbps) and 100GbE QSFP28, PCIe 3.0 x16

x. 2000W Redundant Power Supply

xi. 2 x C13 to C14 Power Cable, 16 AWG, 240V/15A, Black - 4'

xii. 1 x 1U Rails for installation into a server rack

2) Storage Server

3U Storage Server Quantity: 1

The server MUST include (but is not limited to including) minimum capabilities similar to the following:

i. 2 x Intel Xeon Gold 6254 CPUs each with a min clock speed of 3.1GHz and 18 cores (25MB Cache, 200W)

ii. 768GB DDR4 ram (64GB x 12) at a min speed of 2933MHz (DDR4 ECC RDIMM).

iii. 2 x 1TB NVMe SSDs (M.2 PCIe 3.1 x4)

iv. 2 x 1TB SATA SSDs (2.5 inch, 6.0Gb/s)

v. 16 x 14TB SAS Hard Drives (3.5inch, SAS 3.0, 12.0Gb/s, 7200RPM)

vi. 1 x 8-Port RAID Card

vii. On-board Intel X540 Dual-Port 10GBase-T RJ45 Gigabit Ethernet Controller

viii. 1 x Intel i350-T4V2, Quad-Port 1GbE RJ45 Card

ix. 1 x Intel X710-DA4, Quad-Port 10GbE SFP+ Card

x. 2 x Mellanox 100Gb/s EDR InfiniBand Adapter ConnectX-5 VPI (2x QSFP28) - PCIe 3.0 x16

xi. 1200W Redundant Power Supply

xii. 2 x C13 to C14 Power Cable, 16 AWG, 240V/15A, Black - 4'

xiii. 1 x 3U Rails for installation into a server rack

3) Compute Cluster – Blade Enclosure and Blade Modules

Blade Enclosure: Quantity: 1 Dual-Socket Blade Modules: Quantity: 20

The compute cluster MUST include (but is not limited to including) minimum capabilities similar to the following:

i. 1 x 8U Blade Enclosure

a) 1 x Chassis Management Module

b) 2 x Broadcom BCM56846 10GbE Low Latency Switches

c) 1 x 100Gb EDR IB Switch Module with 20 Internal+16 External ports (QSFP28)

d) 8 x 2200W Redundant Power Supplies

e) 8 Power Cables for 8U Blade Enclosure

ii. 20 x Dual-Socket 8U Blade Module

Each of the 20 blade modules MUST include (but is not limited to including) the following minimum capabilities:

a) 2 x Intel Xeon Gold 6254 CPUs running at a min clock speed of 3.1GHz and with 18 cores (25MB Cache, 200W).

b) 1,024GB DDR4 ram (64GB x 16) with a min speed of 2933MHz (DDR4 ECC RDIMM).

c) On-board Dual-Port 10GbE RJ45 Controllers

d) 1 x 512GB Micron 2200 TLC M.2 PCIe 3.1 x4 NVMe SSD

e) 1 x 2TB Intel DC P4510 U.2 PCIe 3.1 x4 NVMe Solid State Drive

f) 2 x 1.92TB 2.5" SATA 6.0Gb/s Solid State Drives

g) 1 x Mellanox ConnectX-4, Single-Port 100-Gigabit EDR Infiniband Adapter (AOC-IBH-X4ES)

4) Compute Server

2U Compute Server Quantity: 1

The compute server MUST include (but is not limited to including) minimum capabilities similar to the following:

i. 1 x 2U Server enclosure

ii. 8 x AMD EPYC 7302 CPUs, each with a min clock speed of 3.00 GHz and 16 cores (128MB L3 Cache, 155W)

iii. 512 GB DDR4 ram (32 x 16GB) running at a min speed of 3200MHz (DDR4 ECC RDIMM)

iv. 4 x 1TB NVMe SSDs (3D TLC, PCIe 3.0 x4 NVMe, 0.2 DWPD)

v. 4 x 2.0TB SATA Hard Drives (2.5 inch, 6.0Gb/s, 7200RPM)

vi. 4 x 2-Port RJ45 Ethernet Controllers

vii. 4 x Mellanox ConnectX-5 InfiniBand/VPI Network Adapters, Single-Port EDR (100Gbps) and 100GbE QSFP28, supporting PCIe 3.0 x16

viii. 2200W Redundant Power Supply

ix. 2 x C13 to C14 Power Cable, 16 AWG, 240V/15A, Black - 4'

5) System Components

The system MUST include (but is not limited to including) minimum capabilities similar to the following:

i. 8 x 14TB SAS Hard Drives (3.5 inch, SAS 3.0, 12.0Gb/s 7200RPM) – (Spare for Storage Server)

ii. 4 x 100Gb/s EDR InfiniBand Adapter ConnectX-5 VPI (2x QSFP28) - PCIe 3.0 x16 (for existing servers)

iii. 16 x, 3M Passive Copper EDR InfiniBand up to 100Gb/s QSFP28 Cables

iv. 16 x 3M Passive Copper Ethernet 10GbE SFP+ Cables

v. 16 x 2M Passive Copper EDR InfiniBand up to 100Gb/s QSFP28 Cables