Cluster · NVIDIA · platform

NVIDIA HGX H100 (8-GPU baseboard)

The 8-GPU H100 SXM5 baseboard that anchored the entire 2023-2024 AI-training build-out. The generation the world learned to buy in bulk.

Key facts

Chips per instance: 8
Power (typical): 10.2 kW
Interconnect: NVLink 4 (900 GB/s per GPU, 7.2 TB/s aggregate)
Cooling: air
Announced: 2022-03-22
GA / release: 2022-10-13

Chips inside

×8NVIDIA H100 Tensor Core GPUH100 SXM5 GPU

Where you'll find it

Data centers publicly running the chips inside this design. Per-rack counts are rarely disclosed, so these are presence rows: this campus runs these chips.

Stargate Norway (Kvandal / Narvik) · 100,000 NVIDIA GPUs targeted by end of 2026 (initial phase; specific SKU may be H100/H200/Blackwell mix)
Compass Datacenters Red Oak Campus (DFW III) · H100/H200-generation hyperscaler capacity at the Red Oak DFW III campus
ByteDance Pecem Data Center Campus (TikTok) · ByteDance TikTok/Doubao inference capacity in South America (H100/H200-class)
xAI Colossus (Memphis) · ~100,000 GPUs live in first cluster (Sep 2024); scaled toward 200,000 across the complex
Crusoe Childress Campus · Crusoe operates H100 GPU clusters at Childress
Meta Hyperion Data Center (Richland Parish) · Nvidia complement to MTIA for training + inference at Hyperion
Meta Prometheus Data Center (New Albany) · Nvidia complement to MTIA for training + inference at Prometheus

Vendor page: https://www.nvidia.com/en-us/data-center/hgx/

See also: all rack designs · chip catalog · NVIDIA.