N0016724Q0295_Minimum Specifications.pdf

MINIMUM SPECIFICATIONS – BRAND NAME OR EQUAL

High Performance GPU Server

A) Qty 1 - High Performance GPU Server as specified below

B) Qty 160 - Fiber Optic Transceivers as specified below

C) Qty 50 - 1m MMF fiber network cables as specified below

D) Qty 50 - 2m MMF fiber network cables as specified below

E) Qty 4 - 70m MMF fiber network cables as specified below

CLIN 0001 A) Server Specifications: Supermicro AS-4125GS-TNRT (OR EQUAL)

1. Processor:

o Dual CPU configuration o AMD EPYC 9754, 2.25GHz 128-Core - Bergamo o 256 Threads, CPU Socket: SP5, L3 Cache: 256MB, 5nm, 360W o Socket Count: 2P/1P OEM

2. RAM:

o Minimum 512GB DDR5-4800MHz 288-pin Low Profile ECC Registered DIMM 2RX8 o Configuration: 16x32GB or EQUAL o 24 DIMM Slots, expandable up to 6TB DDR5 memory

3. Storage:

o (2) Hard Drive 3.84TB SATA 6Gb/s 3D TLC 2.5in 7.0mm, < 2DWPD

4. Graphics Processing Units (GPUs):

o (6) NVIDIA H100 NVL Graphics Processing unit (GPU) OR EQUAL o Thermal Solution: Passive Air Cooled o Flexible GPU support: active & passive GPUs, minimum of 8 direct attached double width, full length GPUs o Total memory of all GPUs must be at least 564GB of HBM3 RAM. Each GPU should have at least 94 GB of vRAM. Memory Bandwidth must be at least 7.8 TB/s. The GPUs must have a data transfer rate from the CPU of at least 128 GB/s. The GPU must be compatible with the CUDA library. The GPUs should be able to communicate at 900 Mbps.

5. Interconnect:

o (9) NVIDIA NVLink Bridge, Ampere, 2-Way 2-Slot x16 OR EQUAL o The GPUs should be able to communicate at 900 Mbps. At least two GPUs at a time must be able to be connected to each other with high bandwidth, if not all GPUs.

6. Security:

o TPM: Security Module SPI capable TPM 2.0

7. Networking:

o Ethernet Adapter Card: Mellanox MCX516A-CCAT 100GbE ES Ethernet Adapter ConnectX-5 EN OR EQUAL o 100GbE Dual QSFP28, PCIe3x1, Compatible with MMF, MPO-12 (Polarity B) o On-board: 2x 10GbE BaseT

8. Operating System:

o RHEL-9 for testing OR EQUAL o Carderock will provide enterprise RHEL license and perform STIG hardening

9. Motherboard & Chassis:

o Rackmount Server up to 8U o Multiple 2U servers is allowed to achieve GPU RAM requirement, if air-cooled and same or lower cost, o Supported GPU : Up to 8 Double-Width/Single-Width Cards (Full Height Full Length), NVIDIA H100 or AMD MI200 series, o Supports both active and passive cooled GPUs, o Dual-Socket SP5 CPU capability, o 24 DIMM Slots, up to 6TB DDR5 memory, L/RDIMM, o On-board: 2x 10GbE BaseT o Integrated IPMI 2.0 and KVM with Dedicated LAN, o SATA3 (6Gbps), o 24x 2.5in hot-swap NVMe/SATA/SAS drive bays (4x 2.5in NVMe dedicated) o 1 M.2 NVMe OR 1 M.2 SATA3

10. Power Supply:

o Dual Power Supply at necessary wattage to support system with max 8 GPUs

11. Additional Requirements:

o Assembly and testing included o Delivery included o Rack power on-site is 208/120 V, 3-phase, up to 80A per breaker

CLIN 0002 B) Fiber Optic Transceiver specifications:

1. Quantity: 160 units

2. Form Factor: QSFP28+

3. Data Rate: 100 Gigabit Ethernet (100GbE)

4. Fiber Mode: Multi-mode Fiber (MMF)

5. Connector Type: MPO-12 with Polarity B

6. Wavelength: 850nm

7. Reach:

o OM3: 70 meters o OM4: 100 meters o OM5: 100 meters

8. Compliance Standards:

o IEEE 802.3bm o IEEE 802.3cd o SFF-8665 o SFF-8642

9. Operating Temperature: 0°C to 70°C (Commercial)

10. Maximum Power Consumption: 3.5W

11. Compatibility:

o Cisco 9332C switch o Mellanox MCX516A-CCAT 100GbE ES Ethernet Adapter OR EQUAL

12. Additional Requirements:

o Must be MSA (Multi-Source Agreement) compliant o RoHS compliant o Must include manufacturer's warranty of at least 1 year

C-E) Fiber Cable specifications:

CLIN 0003 C) Qty 50 - 1m MMF Fiber Network Cables In Accordance With (IAW) Listed Minimum Specifications.

CLIN 0004 D) Qty 50 - 2m MMF Fiber Network Cables In Accordance With (IAW) Listed Minimum Specifications.

CLIN 0005 E) Qty 4 - 70m MMF Fiber Network Cables In Accordance With (IAW) Listed Minimum Specifications.

1. Cable Type: Multi-mode Fiber (MMF)

2. Fiber Type: OM4

3. Connector Type: MPO-12 Male UPC (Polarity B) to MPO-12 Male UPC (Polarity B)

4. Fiber Count: 12

5. Cable Length: As per line item descriptions

6. Jacket Material: LSZH (Low Smoke Zero Halogen)

7. Jacket Color: Aqua

8. Fiber Core Diameter: 50μm

9. Fiber Cladding Diameter: 125μm

10. Insertion Loss: ≤ 0.35 dB per connector

11. Return Loss: ≥ 25 dB

12. Operating Temperature Range: -20°C to +70°C

13. Compliance Standards: IEEE 802.3bm, TIA-568.3-D, IEC 61754-7, RoHS

14. Additional Requirements:

o Factory terminated and tested o Protective pulling eye on each end o Individually packaged and labeled

All fiber network cables must be compatible with the specified fiber optic transceivers (QSFP28+, 100GbE, MMF, MPO-12 Polarity B) and the Cisco 9332C switch and Mellanox MCX516A-CCAT 100GbE ES Ethernet Adapter. The cables should be factory terminated, tested, and labeled to ensure optimal performance and easy installation. The LSZH jacket material ensures fire safety and low smoke emission in case of a fire. The specified compliance standards ensure interoperability and reliability of the fiber network cables.

All items shall be TAA Compliant All components shall be obtained from authorized reseller of OEM