Cluster · AMD · platform

AMD Instinct MI300X Platform (8-GPU OAM baseboard)

AMD's 8-way OAM answer to HGX H100/H200: 1.5 TB HBM3 total, priced to unseat NVIDIA on memory-bound inference. The Meta / Microsoft / Oracle purchase.

Key facts

Chips per instance: 8
Power (typical): 6 kW
Interconnect: AMD Infinity Fabric (896 GB/s per GPU, 5.5 TB/s bisection)
Cooling: air
Announced: 2023-12-06
GA / release: 2024-01-01

Chips inside

×8AMD Instinct MI300XMI300X OAM GPU

Vendor page: https://www.amd.com/en/products/accelerators/instinct/mi300/mi300x.html

See also: all rack designs · chip catalog · AMD.