DGX A100

Specifications

Gpus

8x NVIDIA A100 80 GB / 40 GB Tensor Core GPUs

Storage

OS 2x 1.92TB M.2 NVME drives Internal Storage: 30 TB (8x 3.84 TB) / 15TB (4x 3.84TB) U.2 NVME drives

Cpu

Dual AMD Rome 7742, 128 cores total, 2.25 GHz (base), 3.4 GHz (max boost)

System Memory

2TB / 1 TB

Performance

5 petaFLOPS AI;10 petaOPS INT8

Gpu Memory

640 GB / 320 GB total

Network

8x Single-Port Mellanox ConnectX-6 VPI;- 200Gb/s HDR InfiniBand;2x / 1x Dual-Port Mellanox ConnectX-6 VPI;- 10/25/50/100/200Gb/s Ethernet

Nvidia Nvswitches

6

System Power Usage

6.5kW max