ESBD_384429_1733782263213_TX A&M 3SU 4SU H200 SuperPOD BOM w DDN BOM 12-3-24.xlsx
XLSX spreadsheet 19 KB Posted
- Attached to
- Artificial Intelligence Center of Excellence
- Solicitation number
- RFP01-CIO-25-229
- Issued by
- Texas
About this file
This is a detailed Bill of Materials (BOM) spreadsheet for NVIDIA DGX H200 SuperPOD configurations at Texas A&M, specifying components for both 3-node and 4-node scalable units. The document outlines comprehensive hardware requirements including 95 DGX H200 systems for the 3SU configuration and 127 DGX H200 systems for the 4SU configuration, along with associated networking equipment, storage systems, and infrastructure components. The configurations include extensive NDR InfiniBand networking fabric, management networks, DDN storage systems with 8PB usable capacity, and complete rack infrastructure including PDUs and physical racks.
The technical specifications detail power consumption requirements, with individual DGX H200 systems consuming 10.2kW each, totaling approximately 969kW for the 3SU and 1,296kW for the 4SU configurations. The systems include comprehensive support services with 3-year terms, including Premium Technical Account Manager support, Infrastructure Startup Engineer services, and various hardware support packages for switches, cables, and transceivers. DDN storage components include AI400X2 All Flash Appliances with NVMe storage, metadata servers, and monitoring systems with Premium Onsite Support and EXAScaler Software Support for 3 years.
View the file
Other files
Show all 12
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
3SU DGX H200 SuperPOD BOM
| Non-NVIDIA parts highlighted | |||||||
| Role | OPN | MLNX OPN | Quantity | Description | Comment | Power Consumption Per Unit | Total Power Consumption |
| DGX Compute | DGXH-G1128+P2CMI36 | 95 | DGX H200 P4387 System 1128GB Full, 3 Yr | DGX system | 10.2 kW | 968.9999999999999 KW | |
| DGX Compute | 797-YUFETG+P2CMI36 | UFM-EN-500-3G | 195 | NVIDIA UFM Ent Subscription SW ,3 Years | UFM subscription | 0 | 0 |
| DGX Compute | 728-SWBBDL+P2CMI36 | 95 | DGX software and std support bundle Subscription (NVIDIA Base Command with NVIDIA AI Enterprise), 3 Years | DGX software | 0 | 0 | |
| DGX Compute | 719-DLI010 | 30 | NVIDIA Deep Learning Institute (DLI) Credits | DLI Learning Credits | |||
| Storage | DDN-12XSTORAGE-ENDPOINT-36M | 1 | DDN-16XSTORAGE-ENDPOINT-36M (Usable 8PB - see separate DDN BOM Below) | Storage vendor | 25.9 kW | 25.9 KW | |
| Storage | 980-9I11Z-00H005 | MFA7U10-H005 | 48 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 5m | Storage splitter cables HDR200 | Included | Included |
| Storage | Cat6 | 48 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | Storage cat6 cables | 0 | 0 | |
| Storage | NFS-storage | 1 | Customer provided NFS storage for Home Directories | NFS storage | 0 | 0 | |
| Storage | 920-9B210-00FN-0M0 | MQM9700-NS2F | 4 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR leaf MGMT Switches | 1.7 kW | 6.8 KW |
| Storage | 980-9I73V-000005 | MFP7E10-N005 | 4 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 5m | MGMT cables | Included | Included |
| Storage | 980-9I693-00NS00 | MMA1Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, QSFP112, MPO12 APC, 850nm MMF, up to 30m, flat top | MGMT Transceivers | Included | Included |
| Compute Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 24 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR leaf Switches | 1.7 kW | 40.8 KW |
| Compute Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 16 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR spine Switches | 1.7 kW | 27.2 KW |
| Compute Fabric | 980-9I51A-00NS00 | MMA4Z00-NS-FLT | 380 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, flat top | Transceivers on DGX | Included | Included |
| Compute Fabric | 980-9I510-00NS00 | MMA4Z00-NS | 1280 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, finned | OSFP transceivers on Switch | Included | Included |
| Compute Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 128 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I57Z-000020 | MFP7E10-N020 | 344 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 20m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I570-00N030 | MFP7E10-N030 | 288 | NVIDIA passive fiber cable, MMF , MPO12 APC to MPO12 APC, 30m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I73U-000003 | MFP7E10-N003 | 384 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 3m | Leaf-Spine cables | Included | Included |
| Compute Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 384 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Leaf-Spine cables | Included | Included |
| Compute Fabric | 980-9I51S-00NS00 | MMA4Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, OSFP, MPO12 APC, 850nm MMF, up to 50m, flat top | UFM transceivers | Included | Included |
| Compute Fabric | 980-9I572-00N005 | MFP7E20-N005 | 2 | NVIDIA passive fiber cable, MMF, MPO12 APC to 2xMPO12 APC, 5m | UFM to Leaf cables | Included | Included |
| Compute Fabric | 920-9B020-00RA-0D0 | MUA9602H-2SRS | 2 | NVIDIA UFM Appliance 3.0 for UFM Telemetry or UFM Enterprise, 1U server with 2x ConnectX-7 NDR Single-port 400Gb/s InfiniBand adapter, Secured-boot, UFM software package sold separately | UFM appliance | 750 W | 1500 W |
| Storage Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 6 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR DGX leaf Switches | 1.7 kW | 10.2 KW |
| Storage Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 4 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR spine switches for storage fabric | 1.7 kW | 6.8 KW |
| Storage Fabric | 980-9I693-00NS00 | MMA1Z00-NS400 | 190 | NVIDIA single port transceiver, 400Gbps,NDR, QSFP112, MPO12 APC, 850nm MMF, up to 30m, flat top | DGX single transceivers | Included | Included |
| Storage Fabric | 980-9I510-00NS00 | MMA4Z00-NS | 348 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, finned | OSFP Transceivers on Switches for storage fabric | Included | Included |
| Storage Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 46 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I57Z-000020 | MFP7E10-N020 | 112 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 20m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I570-00N030 | MFP7E10-N030 | 32 | NVIDIA passive fiber cable, MMF , MPO12 APC to MPO12 APC, 30m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I73U-000003 | MFP7E10-N003 | 124 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 3m | Leaf-Spine cables for storage fabric | Included | Included |
| Storage Fabric | 980-9I73V-000005 | MFP7E10-N005 | 62 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 5m | Leaf-Spine cables for storage fabric | Included | Included |
| Storage Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 62 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Leaf-Spine cables for storage fabric | Included | Included |
| Storage Fabric | 980-9I51S-00NS00 | MMA4Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, OSFP, MPO12 APC, 850nm MMF, up to 50m, flat top | UFM transceivers | Included | Included |
| Storage Fabric | 980-9I572-00N005 | MFP7E20-N005 | 2 | NVIDIA passive fiber cable, MMF, MPO12 APC to 2xMPO12 APC, 5m | UFM to Leaf cables | Included | Included |
| Storage Fabric | 920-9B020-00RA-0D0 | MUA9602H-2SRS | 2 | NVIDIA UFM Appliance 3.0 for UFM Telemetry or UFM Enterprise, 1U server with 2x ConnectX-7 NDR Single-port 400Gb/s InfiniBand adapter, Secured-boot, UFM software package sold separately | UFM appliance | 750 W | 1500 W |
| Management - In-Band | 920-9N302-00F7-0C2 | MSN4600-CS2FC | 6 | NVIDIA Spectrum-3 based 100GbE 2U Open Ethernet switch with Cumulus Linux, 64 QSFP28 ports, 2 Power Supplies (AC), x86 CPU, standard depth, P2C airflow, Rail Kit | Ethernet switches | 820 W | 4920 W |
| Management - In-Band | 980-9I134-00C010 | MFA1A00-C010 | 46 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 10m | Node-Leaf ethernet cables | 5 W | 230 W |
| Management - In-Band | 980-9I134-00C010 | MFA1A00-C010 | 99 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 10m | DGX systems, Management nodes to leaf | 5 W | 495 W |
| Management - In-Band | 980-9I13F-00C020 | MFA1A00-C020 | 112 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 20m | Node-Leaf ethernet cables | 2.5 W | 280 W |
| Management - In-Band | 980-9I13N-00C030 | MFA1A00-C030 | 32 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 30m | Node-Leaf ethernet cables | 2.5 W | 80 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 11 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | Leaf-Spine ethernet cables | 2.5 W | 27.5 W |
| Management - In-Band | 980-9I134-00C010 | MFA1A00-C010 | 21 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 10m | Leaf-Spine ethernet cables | 2.5 W | 52.5 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 2 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | OOB uplinks | 2.5 W | 5 W |
| Management - In-Band | 980-9I13F-00C020 | MFA1A00-C020 | 14 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 20m | OOB uplinks | 2.5 W | 35 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 8 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | In-Band cables for MGMT Servers | 2.5 W | 20 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | UFM to Inband | 2.5 W | 10 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | Inband Ethernet switch ISL cable | 2.5 W | 10 W |
| Management - In-Band | 980-9I17Q-00CM00 | MMA1L30-CM | 4 | Mellanox optical module, 100GbE, 100Gb/s, QSFP28, LC-LC, 1310nm, CWDM4, up to 2km | Uplinks CWDM | 3.5 W | 14 W |
| Management - In-Band | 980-9I13N-00C030 | MFA1A00-C030 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 30m | Links to Nas | 2.5 W | 10 W |
| Management - OOB | 920-9N110-00F1-0C0 | MSN2201-CB2FC | 8 | Nvidia Spectrum based 1GBase-T/100GbE 1U Open Ethernet switch with Cumulus Linux, 48 RJ45 ports and 4 QSFP28 ports, Dual Power Supply (AC), x86 CPU, short depth, P2C airflow, 4-post Rail kit. | 1GBase switches | 135 W | 1080 W |
| Management - OOB | Cat6 | 376 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | OOB Cat6 cables | 0 | 0 | |
| Management - OOB | Cat6 | 7 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | IPMI switches connection | 0 | 0 | |
| Management - OOB | Cat6 | 2 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | UFM back to back cables | 0 | 0 | |
| Management - OOB | 980-9I71G-00J000 | MAM1Q00A-QSA | 4 | Mellanox cable module, ETH 10GbE, 40Gb/s to 10Gb/s, QSFP to SFP+ | QSFP-->SFP transceiver for each UFM | Included | Included |
| Management - OOB | 980-9I251-00IS00 | MC3208411-T | 4 | Mellanox module, ETH 1GbE, 1Gb/s, SFP, Base-T, up to 100m | RJ45 transceiver for each UFM | Included | Included |
| Management Nodes | INTEL-MGMT-SERVER | 4 | Dell R760 DGX BC + Slurm | Management nodes | 0 | 0 | |
| Rack Infrastructure | Raritan (PX3-5091R-P1Q2R1A5) or Equiv | 144 | Horizontal PDU for Compute Rack | Horizontal PDU for compute rack | 0 | 0 | |
| Rack Infrastructure | Raritan (PX3-5747V-V2) or equivalent | 20 | Vertical PDU for Mgmt Rack | Vertical PDU for mgmt rack | 0 | 0 | |
| Rack Infrastructure | Legrand NVIDPD13 or equivalent | 58 | Physical Racks | Physical racks | 0 | 0 | |
| Support services | 723-TAMP00+P2CMI36 | 1 | NVIDIA Premium Technical Account Manager, Remote, 3 Years | Premium technical services | 0 | 0 | |
| Support services | 788-D2M06L+P2CMI00 | GPS-NET-ISE-6M | 2 | NVIDIA Infrastructure Startup Engineer, 6 Months. 8 hours per week, local business hours, minimum utilization unit - 4 hours. | Remote reliability engineer | 0 | 0 |
| Support services - NBU | 790-CN7NNZ+P2CMI36 | SUP-QM9700-3GNBD | 54 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for QM9700,3 Years | IB switch support | 0 | 0 |
| Support services - NBU | 781-C46NNZ+P2CMI36 | SUP-SN4600-CL-3GNBD | 6 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for SN4600 Series,3 Years | Ethernet 100GbE switches support | 0 | 0 |
| Support services - NBU | 781-C23NNZ+P2CMI36 | SUP-S2201C-3GNBD | 8 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for SN2201 Series,3 Years | Ethernet 1GbE switches support | 0 | 0 |
| Support services - NBU | 785-CAON0Z+P2CMI36 | 312 | NVIDIA BUSINESS CRITICAL SERVICE FOR ACTIVE FIBER CABLES,3 Years | Active Fiber Cables Support | 0 | 0 | |
| Support services - NBU | 785-CPFN0Z+P2CMI36 | 1970 | NVIDIA BUSINESS CRITICAL SERVICE FOR PASSIVE FIBER CABLES,3 Years | Passive Fiber Cables Support | 0 | 0 | |
| Support services - NBU | 785-CTRN0Y+P2CMI36 | 2218 | NVIDIA BUSINESS CRITICAL SERVICE FOR TRANSCEIVERS,3 Years | Transceivers Support | 0 | 0 | |
| Support services - NBU | 793-CU9NNZ+P2CMI36 | SUP-MUA9602H-3GNBD | 4 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for MUA9602 H Appliance,3 Years | UFM appliance Support | 0 | 0 |
| Installation services | 788-D1X20B+P2CMI00 | 3 | NVPS deployment for one 31-DGX-node scalable unit.Price per SU. (T&E included,Storage excluded) | NVPS installation services | 0 | 0 | |
| DDN BOM | |||||||
| Storage Systems | Storage | ||||||
| 16 | AI400X2 All Flash Appliance with 24x NVMe slots. SSD bundle for AI400X2T Includes 24x | ||||||
| NVMe SED Capable SSDs for 737TB RAW / 500TB Useable Capacity. | |||||||
| Metadata | |||||||
| 3 | AI400X2 MDS All Flash Appliance with 24x NVMe slots. SSD bundle for AI400X2-MDS | ||||||
| Includes 12x NVMe SED Capable SSDs for 46TB RAW capacity for up to 10 billion inodes. | |||||||
| DDN Insight Monitoring | |||||||
| 1 | 1U R6615 server with: 1x 9254 CPU (24c@2.9GHz, 128MB cache, DDR5-4800), iDRAC9 | ||||||
| Ent, H755, 128GB RAM (4x 32GB), 2x 480GB SATA SSD, 2x 1920GB NVME, Dual | |||||||
| 10/25GE SFP28 & Dual 1GE BaseT, Titanium. | |||||||
| Software | |||||||
| 1 | DDN Insight Monitoring Software and Support subscription for SFA/EXAScaler | ||||||
| Support | |||||||
| 1 | Premium Onsite Support, 3-years | ||||||
| 1 | Premium EXAScaler Software Support; 3 years | ||||||
| Services | |||||||
| 1 | DDN hardware installation | ||||||
| 1 | Essential Parallel File System remote services deployment bundle | ||||||
| Support begins on the date of invoice |
4SU DGX H200 SuperPOD BOM
| Non-NVIDIA parts highlighted | |||||||
| Role | OPN | MLNX OPN | Quantity | Description | Comment | Power Consumption Per Unit | Total Power Consumption |
| DGX Compute | DGXH-G1128+P2CMI36 | 127 | DGX H200 P4387 System 1128GB Full, 3 Yr | DGX system | 10.2 kW | 1295.3999999999999 KW | |
| DGX Compute | 797-YUFETG+P2CMI36 | UFM-EN-500-3G | 259 | NVIDIA UFM Ent Subscription SW ,3 Years | UFM subscription | 0 | 0 |
| DGX Compute | 728-SWBBDL+P2CMI36 | 127 | DGX software and std support bundle Subscription (NVIDIA Base Command with NVIDIA AI Enterprise), 3 Years | DGX software | 0 | 0 | |
| DGX Compute | 719-DLI010 | 30 | NVIDIA Deep Learning Institute (DLI) Credits | DLI Learning Credits | |||
| Storage | DDN-16XSTORAGE-ENDPOINT-36M | 1 | DDN-16XSTORAGE-ENDPOINT-36M (Usable 8PB - see separate DDN BOM Below) | Storage vendor | 34.6 kW | 34.6 KW | |
| Storage | 980-9I11Z-00H005 | MFA7U10-H005 | 64 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 5m | Storage splitter cables HDR200 | Included | Included |
| Storage | Cat6 | 64 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | Storage cat6 cables | 0 | 0 | |
| Storage | NFS-storage | 1 | Customer provided NFS storage for Home Directories | NFS storage | 0 | 0 | |
| Storage | 920-9B210-00FN-0M0 | MQM9700-NS2F | 6 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR leaf MGMT Switches | 1.7 kW | 10.2 KW |
| Storage | 980-9I73V-000005 | MFP7E10-N005 | 4 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 5m | MGMT cables | Included | Included |
| Storage | 980-9I693-00NS00 | MMA1Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, QSFP112, MPO12 APC, 850nm MMF, up to 30m, flat top | MGMT Transceivers | Included | Included |
| Compute Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 32 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR leaf Switches | 1.7 kW | 54.4 KW |
| Compute Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 16 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR spine Switches | 1.7 kW | 27.2 KW |
| Compute Fabric | 980-9I51A-00NS00 | MMA4Z00-NS-FLT | 508 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, flat top | Transceivers on DGX | Included | Included |
| Compute Fabric | 980-9I510-00NS00 | MMA4Z00-NS | 1536 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, finned | OSFP transceivers on Switch | Included | Included |
| Compute Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 256 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I57Z-000020 | MFP7E10-N020 | 440 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 20m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I570-00N030 | MFP7E10-N030 | 320 | NVIDIA passive fiber cable, MMF , MPO12 APC to MPO12 APC, 30m | Node-Leaf cables | Included | Included |
| Compute Fabric | 980-9I73U-000003 | MFP7E10-N003 | 512 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 3m | Leaf-Spine cables | Included | Included |
| Compute Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 512 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Leaf-Spine cables | Included | Included |
| Compute Fabric | 980-9I51S-00NS00 | MMA4Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, OSFP, MPO12 APC, 850nm MMF, up to 50m, flat top | UFM transceivers | Included | Included |
| Compute Fabric | 980-9I572-00N005 | MFP7E20-N005 | 2 | NVIDIA passive fiber cable, MMF, MPO12 APC to 2xMPO12 APC, 5m | UFM to Leaf cables | Included | Included |
| Compute Fabric | 920-9B020-00RA-0D0 | MUA9602H-2SRS | 2 | NVIDIA UFM Appliance 3.0 for UFM Telemetry or UFM Enterprise, 1U server with 2x ConnectX-7 NDR Single-port 400Gb/s InfiniBand adapter, Secured-boot, UFM software package sold separately | UFM appliance | 750 W | 1500 W |
| Storage Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 8 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR DGX leaf Switches | 1.7 kW | 13.6 KW |
| Storage Fabric | 920-9B210-00FN-0M0 | MQM9700-NS2F | 6 | NVIDIA Quantum 2 based NDR InfiniBand Switch, 64 NDR ports, 32 OSFP ports, 2 Power Supplies (AC), Standard depth, Managed, P2C airflow, Rail Kit | NDR spine switches for storage fabric | 1.7 kW | 10.2 KW |
| Storage Fabric | 980-9I693-00NS00 | MMA1Z00-NS400 | 254 | NVIDIA single port transceiver, 400Gbps,NDR, QSFP112, MPO12 APC, 850nm MMF, up to 30m, flat top | DGX single transceivers | Included | Included |
| Storage Fabric | 980-9I510-00NS00 | MMA4Z00-NS | 460 | NVIDIA twin port transceiver, 800Gbps,2xNDR, OSFP, 2xMPO12 APC, 850nm MMF, up to 50m, finned | OSFP Transceivers on Switches for storage fabric | Included | Included |
| Storage Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 48 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I57Z-000020 | MFP7E10-N020 | 142 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 20m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I570-00N030 | MFP7E10-N030 | 64 | NVIDIA passive fiber cable, MMF , MPO12 APC to MPO12 APC, 30m | DGX-Leaf cables | Included | Included |
| Storage Fabric | 980-9I73U-000003 | MFP7E10-N003 | 224 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 3m | Leaf-Spine cables for storage fabric | Included | Included |
| Storage Fabric | 980-9I57X-00N010 | MFP7E10-N010 | 112 | NVIDIA passive fiber cable, MMF, MPO12 APC to MPO12 APC, 10m | Leaf-Spine cables for storage fabric | Included | Included |
| Storage Fabric | 980-9I51S-00NS00 | MMA4Z00-NS400 | 4 | NVIDIA single port transceiver, 400Gbps,NDR, OSFP, MPO12 APC, 850nm MMF, up to 50m, flat top | UFM transceivers | Included | Included |
| Storage Fabric | 980-9I572-00N005 | MFP7E20-N005 | 2 | NVIDIA passive fiber cable, MMF, MPO12 APC to 2xMPO12 APC, 5m | UFM to Leaf cables | Included | Included |
| Storage Fabric | 920-9B020-00RA-0D0 | MUA9602H-2SRS | 2 | NVIDIA UFM Appliance 3.0 for UFM Telemetry or UFM Enterprise, 1U server with 2x ConnectX-7 NDR Single-port 400Gb/s InfiniBand adapter, Secured-boot, UFM software package sold separately | UFM appliance | 750 W | 1500 W |
| Management - In-Band | 920-9N302-00F7-0C2 | MSN4600-CS2FC | 8 | NVIDIA Spectrum-3 based 100GbE 2U Open Ethernet switch with Cumulus Linux, 64 QSFP28 ports, 2 Power Supplies (AC), x86 CPU, standard depth, P2C airflow, Rail Kit | Ethernet switches | 820 W | 6560 W |
| Management - In-Band | 980-9I134-00C010 | MFA1A00-C010 | 48 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 10m | Node-Leaf ethernet cables | 5 W | 240 W |
| Management - In-Band | 980-9I134-00C010 | MFA1A00-C010 | 131 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 10m | DGX systems, Management nodes to leaf | 5 W | 655 W |
| Management - In-Band | 980-9I13F-00C020 | MFA1A00-C020 | 142 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 20m | Node-Leaf ethernet cables | 2.5 W | 355 W |
| Management - In-Band | 980-9I13N-00C030 | MFA1A00-C030 | 64 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 30m | Node-Leaf ethernet cables | 2.5 W | 160 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 48 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | Leaf-Spine ethernet cables | 2.5 W | 120 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | OOB uplinks | 2.5 W | 10 W |
| Management - In-Band | 980-9I13F-00C020 | MFA1A00-C020 | 18 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 20m | OOB uplinks | 2.5 W | 45 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 8 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | In-Band cables for MGMT Servers | 2.5 W | 20 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | UFM to Inband | 2.5 W | 10 W |
| Management - In-Band | 980-9I13X-00C005 | MFA1A00-C005 | 6 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 5m | Inband Ethernet switch ISL cable | 2.5 W | 15 W |
| Management - In-Band | 980-9I17Q-00CM00 | MMA1L30-CM | 4 | Mellanox optical module, 100GbE, 100Gb/s, QSFP28, LC-LC, 1310nm, CWDM4, up to 2km | Uplinks CWDM | 3.5 W | 14 W |
| Management - In-Band | 980-9I13N-00C030 | MFA1A00-C030 | 4 | Mellanox active fiber cable, ETH 100GbE, 100Gb/s, QSFP, LSZH, 30m | Links to Nas | 2.5 W | 10 W |
| Management - OOB | 920-9N110-00F1-0C0 | MSN2201-CB2FC | 11 | Nvidia Spectrum based 1GBase-T/100GbE 1U Open Ethernet switch with Cumulus Linux, 48 RJ45 ports and 4 QSFP28 ports, Dual Power Supply (AC), x86 CPU, short depth, P2C airflow, 4-post Rail kit. | 1GBase switches | 135 W | 1485 W |
| Management - OOB | Cat6 | 492 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | OOB Cat6 cables | 0 | 0 | |
| Management - OOB | Cat6 | 10 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | IPMI switches connection | 0 | 0 | |
| Management - OOB | Cat6 | 2 | Cat6 Snagless Unshielded (UTP) Network Patch Ethernet Cable-Blue, 10 m (from utility rack to GPU racks) | UFM back to back cables | 0 | 0 | |
| Management - OOB | 980-9I71G-00J000 | MAM1Q00A-QSA | 4 | Mellanox cable module, ETH 10GbE, 40Gb/s to 10Gb/s, QSFP to SFP+ | QSFP-->SFP transceiver for each UFM | Included | Included |
| Management - OOB | 980-9I251-00IS00 | MC3208411-T | 4 | Mellanox module, ETH 1GbE, 1Gb/s, SFP, Base-T, up to 100m | RJ45 transceiver for each UFM | Included | Included |
| Management Nodes | INTEL-MGMT-SERVER | 4 | Dell R760 DGX BC + Slurm | Management nodes | 0 | 0 | |
| Rack Infrastructure | Raritan (PX3-5091R-P1Q2R1A5) or Equiv | 192 | Horizontal PDU for Compute Rack | Horizontal PDU for compute rack | 0 | 0 | |
| Rack Infrastructure | Raritan (PX3-5747V-V2) or equivalent | 24 | Vertical PDU for Mgmt Rack | Vertical PDU for mgmt rack | 0 | 0 | |
| Rack Infrastructure | Legrand NVIDPD13 or equivalent | 76 | Physical Racks | Physical racks | 0 | 0 | |
| Support services | 723-TAMP00+P2CMI36 | 1 | NVIDIA Premium Technical Account Manager, Remote, 3 Years | Premium technical services | 0 | 0 | |
| Support services | 788-D2M06L+P2CMI00 | GPS-NET-ISE-6M | 2 | NVIDIA Infrastructure Startup Engineer, 6 Months. 8 hours per week, local business hours, minimum utilization unit - 4 hours. | Remote reliability engineer | 0 | 0 |
| Support services - NBU | 790-CN7NNZ+P2CMI36 | SUP-QM9700-3GNBD | 68 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for QM9700,3 Years | IB switch support | 0 | 0 |
| Support services - NBU | 781-C46NNZ+P2CMI36 | SUP-SN4600-CL-3GNBD | 8 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for SN4600 Series,3 Years | Ethernet 100GbE switches support | 0 | 0 |
| Support services - NBU | 781-C23NNZ+P2CMI36 | SUP-S2201C-3GNBD | 11 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for SN2201 Series,3 Years | Ethernet 1GbE switches support | 0 | 0 |
| Support services - NBU | 785-CAON0Z+P2CMI36 | 416 | NVIDIA BUSINESS CRITICAL SERVICE FOR ACTIVE FIBER CABLES,3 Years | Active Fiber Cables Support | 0 | 0 | |
| Support services - NBU | 785-CPFN0Z+P2CMI36 | 2634 | NVIDIA BUSINESS CRITICAL SERVICE FOR PASSIVE FIBER CABLES,3 Years | Passive Fiber Cables Support | 0 | 0 | |
| Support services - NBU | 785-CTRN0Y+P2CMI36 | 2778 | NVIDIA BUSINESS CRITICAL SERVICE FOR TRANSCEIVERS,3 Years | Transceivers Support | 0 | 0 | |
| Support services - NBU | 793-CU9NNZ+P2CMI36 | SUP-MUA9602H-3GNBD | 4 | NVIDIA ENT Business Critical Support Services NBD On-Site CE for MUA9602 H Appliance,3 Years | UFM appliance Support | 0 | 0 |
| Installation services | 788-D1X20B+P2CMI00 | 4 | NVPS deployment for one 31-DGX-node scalable unit.Price per SU. (T&E included,Storage excluded) | NVPS installation services | 0 | 0 |
| DDN BOM | |||
| Storage Systems | Storage | ||
| 16 | AI400X2 All Flash Appliance with 24x NVMe slots. SSD bundle for AI400X2T Includes 24x | ||
| NVMe SED Capable SSDs for 737TB RAW / 500TB Useable Capacity. | |||
| Metadata | |||
| 3 | AI400X2 MDS All Flash Appliance with 24x NVMe slots. SSD bundle for AI400X2-MDS | ||
| Includes 12x NVMe SED Capable SSDs for 46TB RAW capacity for up to 10 billion inodes. | |||
| DDN Insight Monitoring | |||
| 1 | 1U R6615 server with: 1x 9254 CPU (24c@2.9GHz, 128MB cache, DDR5-4800), iDRAC9 | ||
| Ent, H755, 128GB RAM (4x 32GB), 2x 480GB SATA SSD, 2x 1920GB NVME, Dual | |||
| 10/25GE SFP28 & Dual 1GE BaseT, Titanium. | |||
| Software | |||
| 1 | DDN Insight Monitoring Software and Support subscription for SFA/EXAScaler | ||
| Support | |||
| 1 | Premium Onsite Support, 3-years | ||
| 1 | Premium EXAScaler Software Support; 3 years | ||
| Services | |||
| 1 | DDN hardware installation | ||
| 1 | Essential Parallel File System remote services deployment bundle | ||
| Support begins on the date of invoice |
File details come from the government source that posted it. Updated .