DEPLOYDatabase

Cluster · NVIDIA · rack

NVIDIA GB200 NVL72

72 Blackwell GPUs + 36 Grace CPUs in one liquid-cooled rack, sharing a single NVLink 5 domain. The current flagship training rack.

Key facts

Chips per instance
36
Power (typical)
132 kW
Interconnect
NVLink 5 (1.8 TB/s per GPU, 130 TB/s aggregate)
Cooling
water
Announced
2024-03-18
GA / release
2024-12-01

Chips inside

×36NVIDIA GB200 Grace Blackwell SuperchipGrace Blackwell Superchip (2 GPUs + 1 Grace CPU each)

Where you'll find it

Data centers publicly running the chips inside this design. Per-rack counts are rarely disclosed, so these are presence rows: this campus runs these chips.

Vendor page: https://www.nvidia.com/en-us/data-center/gb200-nvl72/

See also: all rack designs · chip catalog · NVIDIA.