Attachment 1 - Neptune Cluster Specification 8.6.2021.docx

PR 75-007M-21 _ 1103514786

NEPTUNE Real-Time Demonstration Computer System

SPECIFICATIONS

NEPTUNE Real-Time Demonstration Computer System Date: 08/06/2021

A. The following specifications are required for the NEPTUNE Real-Time Demonstration Computer System.

B. Dell and Bright Compute Bundle for NEPTUNE

Specific HPC Compute and Head Node capabilities MUST include, but are not limited to:

1. Seventy Five (75) PowerEdge R6525 Compute Nodes

a. Two (2) AMD EPYC 7713 2.00GHz, 64C/128T, 256M Cache

b. Sixteen (16) 16GB RDIMM, 3200MT/s, Dual Rank

c. Two (2) 480GB SSD SATA Read Intensive

d. One (1) PERC H345 for Chassis up to 10 drives

e. One (1) Mellanox ConnectX-5 Dual Port 10/25GbE SFP28 OCP 3.0

f. One (1) Mellanox ConnectX-6 Single Port HDR100 QSFP56 Infiniband Adapter

g. One (1) 3 Years ProSupport with Next Business Day Onsite Service

2. Two (2) PowerEdge R7525 Bright Head Nodes:

a. Two (2) AMD EPYC 7302 2.9GHz, 32C/64T, 256M Cache

b. Sixteen (16) 8GB RDIMM, 3200MT/s, Dual Rank

c. Two (2) 480GB SSD SATA Read Intensive

d. One (1) PERC H345 for Chassis up to 10 drives

e. One (1) SAS 12Gbps HBA External Controller

f. Two (2) Mellanox ConnectX-6 DX Dual Port 100GbE QSFP56 Network Adapter

g. One (1) Mellanox ConnectX-6 Single Port HDR VPI Infiniband Adapter

h. One (1) 3 Years ProSupport with Next Business Day Onsite Service

3. Bright Cluster Manager Licenses – Three (3) Years

a. Eighty four (84) BCM Advanced Edition, Public Sector Licenses

C. IBM and Dell Storage Bundle for NEPTUNE

1. ESS 3000 Flash Tier:

a. One (1) ESS SN1 - IBM ESS 3000 1:5141 Model AF8

b. One (1) 768GB Base Cache

c. Twenty Four (24) 7.68 TB 2.5 Inch NVMe Flash Drive

d. One (1) 800GB Boot Drive Indicator

e. Six (6) PCIe4 LP 2-port 100Gb EDR IB CAPI adapter

f. One (1) Embedded Red Hat Enterprise Linux for ESS 3000 with 3-Yr Subscription

g. Two (2) Per Svr 1 Skt Pair w 1 PN or up to 2 VN w 3yr PRM Sub

h. One (1) IBM Select Support for xCAT - 3-Year

i. Two (2) Per Server Enhanced Support

j. One (1) IBM Spectrum Scale Data Access Edition for IBM ESS V5

k. Twenty Four (24) Data Access Ed for Flash per Disk Drive

l. One (1) 3-Year Registration SWMA for 5765-DAE

m. Twenty Four (24) Data Access Ed for Flash - Registration

n. One (1) Support Line for Red Hat Enterprise Linux for ESS 3000 - 3-Year

o. Two (2) Standard (9x5) 3yr Support per Server

2. ESS 5000 SL JBOD

a. One (1) Primary ESS SL1 16tb 5U92 Storage 1:5147 Model 092

b. Two (2) 800GB 2.5 inch 6Gb SAS PI SSD

c. Ninety (90) 16 TB Enterprise HDD

d. One (1) IBM Spectrum Scale Data Access Edition for IBM ESS V5

e. Ninety (90) Data Access Ed for Disk per Disk Drive

f. One (1) 3-Year Registration SWMA for 5765-DAE

g. Ninety (90) Data Access Ed for Disk – Registration

3. Two (2) ESS 5000 NSD Server:

a. One (1) 5105 Model 22E

b. One (1) Primary OS - Linux

c. One (1) Base Storage Backplane 8 SFF-3 Bays

d. Two (2) 1.8TB 10K RPM SAS SFF-3 Disk Drive 4K Block - 4096

e. Two (2) 0/20W SMALL CORE 2.5GHz P9 DD2.3 SCM 190W + 2U HEAT SINK + TIM PAD ZZ 22L

f. Twelve (12) 32 GB DDR4 Memory

g. Two (2) 16GB NVDIMM-N (1.2V) 2x72x2666MHZ DDR4 RDIMM DRAM AND SLC FLASH (1RX4) QTY2 + CABLES + BATTERY IN MEDIA BAY

h. Five (5) LSI 9305-16 12GB Host Bus Adapter

i. Three (3) PCIe4 LP 2-port 100Gb EDR IB CAPI adapter

j. One (1) PCIe2 LP 4-port 1GbE Adapter

k. Two (2) AC Power Supply - 1400W (200-240 VAC)

l. One (1) Front IBM Bezel for 8-Bay BackPlane

m. One (1) Embedded Red Hat Enterprise Linux for ESS 5000 with 3-Yr Subscription (1) Per Svr 1 Skt Pair w 1 PN or up to 2 VN w 3yr PRM Sub

n. One (1) IBM Select Support for xCAT - 3-Year

o. One (1) Per Server Enhanced Support

p. One (1) Support Line for Red Hat Enterprise Linux for ESS 5000 - 3-Year

q. One (1) Standard (9x5) 3yr Support per Server

4. EMS Management:

a. One (1) ESS Management Server 1:5105 Model 22E

b. One (1) Primary OS - Linux

c. One (1) Base Storage Backplane 8 SFF-3 Bays

d. Two (2) 1.8TB 10K RPM SAS SFF-3 Disk Drive 4K Block - 4096

e. One (1) 0/20W SMALL CORE 2.5GHz P9 DD2.3 SCM 190W + 2U HEAT SINK + TIM PAD ZZ 22L (8) 16 GB DDR4 Memory

f. One (1) PCIe4 LP 2-port 100Gb EDR IB CAPI adapter

g. One (1) PCIe2 LP 4-port 1GbE Adapter

h. Two (2) AC Power Supply - 1400W (200-240 VAC)

i. One (1) Front IBM Bezel for 8-Bay BackPlane

j. One (1) Embedded Red Hat Enterprise Linux for ESS 5000 with 3-Yr Subscription (1) Per Svr 1 Skt Pair w 1 PN or up to 2 VN w 3yr PRM Sub

k. One (1) IBM Select Support for xCAT - 3-Year

l. One (1) Per Server Enhanced Support

m. One (1) Support Line for Red Hat Enterprise Linux for ESS 5000 - 3-Year

n. One (1) Standard (9x5) 3yr Support per Server

5. ME4012 SAS Storage:

a. One (1) 8-port Dual Controller

b. Eight (8) 960GB RI SAS SSDs

c. Four (4) Mini SAS HD cables, 0.5M

d. One (1) 3 Years ProSupport with Next Business Day Onsite Service

D. Mellanox and Arista Networking Bundle for NEPTUNE

1. Two (2) HDR Spine InfiniBand 40 QSFP56 Managed Switch

a. Three (3) Year Silver Support

2. Five (5) HDR Leaf InfiniBand 40 QSFP56 Unmanaged Switch

a. Three (3) Year Silver Support

3. Two (3) Ethernet 32 QSFP28 Managed Switch

a. Three (3) Years Silver Support

4. Four (4) Gigabit Ethernet: 48x RJ45, 4xSFP+ Switch

a. Thirty Six (36) Months A-Care Software & NBD Hardware Replacement Same Day Ship

5. One (1) Mellanox Cable Bundle

a. Six (6) Mellanox DAC InfiniBand EDR up to 100Gb/s QSFP28 30AWG, 2m, Black

b. Six (6) Mellanox DAC InfiniBand EDR up to 100Gb/s QSFP28 26AWG, 2.5m, Black

c. Six (6) Mellanox DAC InfiniBand EDR up to 100Gb/s QSFP28 26AWG, 3m, Black

d. Four (4) Mellanox DAC InfiniBand EDR up to 100Gb/s QSFP28 26AWG, 4m, Black

e. Two (2) Mellanox DAC InfiniBand EDR up to 100Gb/s QSFP28 26AWG, 5m, Black

f. Sixteen (16) Mellanox DAC Splitter InfiniBand HDR 200Gb/s to 2x100Gb/s LSZH Colored Pulltabs 30AWG, 1m, Black

g. Twenty Four (24) Mellanox DAC Splitter InfiniBand HDR 200Gb/s to 2x100Gb/s LSZH Colored Pulltabs 30AWG, 1.5m, Black

h. Four (4) Mellanox DAC Splitter Ethernet 100GbE to 4x25GbE 1m Colored 30AWG CA-N, 1.5m, Black

i. Four (4) Mellanox DAC Splitter Ethernet 100GbE to 4x25GbE 1m Colored 30AWG CA-N, 2m, Black

j. Two (2) Mellanox DAC Splitter Ethernet 100GbE to 4x25GbE 1m Colored 26AWG CA-N, 2.5m, Black

k. Six (6) Mellanox DAC Splitter Ethernet 100GbE to 4x25GbE 1m Colored 26AWG CA-N, 3m, Black

l. Six (6) Mellanox DAC Splitter Ethernet 100GbE to 4x25GbE 1m Colored 26AWG CA-N, 3.5m, Black

m. Eighteen (18) Mellanox Active Optical Cable InfiniBand HDR up to 200Gb/s QSFP56 LSZH Black Pulltab, 3m

n. Thirty two (32) Mellanox DAC InfiniBand HDR up to 200Gb/s QSFP56 LSZH 1.5m Black Pulltab 30AWG (32) Mellanox DAC InfiniBand HDR up to 200Gb/s QSFP56 LSZH 2m Black Pulltab 26AWG

o. Six (6) Mellanox DAC Ethernet 100GbE QSFP28, 5m, Black, 26AWG CA-L

p. Two (2) Mellanox DAC Ethernet 100GbE QSFP28, 2.5m, Black, 26AWG CA-N

q. Two (2) Mellanox DAC Ethernet 100GbE QSFP28, 3m, Black, 26AWG CA-N

r. Four (4) Mellanox Ethernet Optical Transceiver 100GbE QSFP28 MPO 850nm SR4 up to 100m DDMI

6. Arista Cable Bundle:

a. Two (2) Arista Copper SFP+ Cable 3m

b. Four (4) Arista Copper SFP+ Cable 5m

E. Slimrun Cat6 Bundle for NEPTUNE

1. Four (4) Slimrun Cat6 Ethernet Patch Cable, 4ft, Yellow

2. Sixteen (16) Slimrun Cat6 Ethernet Patch Cable, 5ft, Yellow

3. Fourteen (14) Slimrun Cat6 Ethernet Patch Cable, 6ft, Yellow

4. Twenty Seven (27) Slimrun Cat6 Ethernet Patch Cable, 7ft, Yellow

5. Eight (8) Slimrun Cat6 Ethernet Patch Cable, 9ft, Yellow

6. Eight (8) Slimrun Cat6 Ethernet Patch Cable, 10ft, Yellow

7. Fourteen (14) Slimrun Cat6 Ethernet Patch Cable, 11ft, Yellow

F. APC Infrastructure Bundle for NEPTUNE

1. Six (6) APC 42U Rack AR3300

a. NetShelter SX 42U 750mm Wide x 1200mm Deep Enclosure with Sides - Black

2. Five (5) APC Rack PDU 9000

a. Switched, ZeroU, 17.3kW, 208V, (42) C13/C15, (6) C19/C21

3. APC Power Cables

a. Six (6) Power Cord Kit (6 cables ea), Locking, C13 to C14, 0.6m, North America, black

b. Nine (9) Power Cord Kit (6 cables ea), Locking, C13 to C14, 1.2m, North America, black

c. Two (2) Power Cord Kit (6 cables ea), Locking, C13 to C14, 1.8m, North America, black

d. One (1) Power Cord Kit (6 cables ea), Locking, C13 to C14, 0.6m, North America, red

e. Nine (9) Power Cord Kit (6 cables ea), Locking, C13 to C14, 1.2m, North America, red

f. Seven (7) Power Cord Kit (6 cables ea), Locking, C13 to C14, 1.8m, North America, red

g. One (1) Power Cord Kit (6 cables ea), Locking, C19 to C20, 1.8m, North America, black

h. One (1) Power Cord Kit (6 cables ea), Locking, C19 to C20, 1.8m, North America, red

G. Professional Onsite Services for NEPTUNE

Installation

1. Vendor will provide five (5) days of onsite Professional Services at the NRL Monterey facility for the purpose of system installation and configuration. This includes cabling, network configuration, storage configuration, and cluster configuration. Cluster configuration includes optimizing the job scheduler and high-speed, non-blocking interconnects to the specific computational resource requirements the NEPTUNE model needs to perform as intended. Cabling

a. Cable, label and dress Infiniband fabric

i. Inter-switch uplinks from leaf to spine switches

ii. Downlinks from leaf switches to nodes

iii. Management network cabling to spine switches

2. Cable, label and dress management ethernet networks

a. 25 GbE downlinks from Mellanox switches to compute nodes

b. 100 GbE downlinks from Mellanox switches to Bright headnodes

c. 1 GbE downlinks from Arista switches to all nodes

d. All inter-swtich links for stacking

3. Cable, label and dress power cables

a. Power cables from all equipment to designated PDU ports

Training and Knowledge Transfer

1. Vendor will provide training at the NRL Monterey facility for minimally four personnel to include Bright Cluster Manager operation and IBM Spectrum Scale administration and optimization.

2. Vendor will provide training concurrent with system installation.

H. Warranty

1. Vendor shall provide a three (3) year warranty from the date of shipment to the NRL site, including all parts and labor and telephone/email response during normal business hours.

Documentation

Vendor shall provide electronic copies of the following:

1. Full operating instructions suitable for use in instructing NRL Monterey IT Staff on the administration of Bright Cluster Management software and IBM Spectrum Scale storage platform.

2. Network wiring schematics.

3. Complete system elevation diagram suitable to guide future modifications and repairs.