DGX H100

Specifications

Management Network

10Gb/s onboard NIC with RJ45; 50Gb/s Ethernet optional NIC; Host BMC with RJ45

Networking

4x OSFP ports serving 8x single-port; NVIDIA ConnectX-7 VPI;-400Gb/s InfiniBand/Ethernet; 2x dual-port NVIDIA ConnectX-7 VPI;- 1x 400Gb/s InfiniBand; - 1x 200Gb/s Ethernet

Gpus

8x NVIDIA H100 Tensor Core GPUs

Storage

OS: 2x 1.9TB M.2 NVME drives;Internal Storage: 8x 3.84TB NVMe; U.2 drives

Cpu

Dual 56-core 4th Gen Intel® Xeon® Scalable processors

Performance

32 petaFLOPS FP8

System Memory

2TB

Gpu Memory

640GB total

Nvidia Nvswitch

4x

System Power Usage

-11.3kW max