Cluster · Google · supercluster

Google TPU v5p Pod (8,960 chips)

Google's single-pod ceiling under v5p: 8,960 accelerators in one all-to-all ICI domain. The unit-of-scale for Gemini-generation training.

Key facts

Chips per instance: 8,960
Interconnect: Google ICI (Inter-Chip Interconnect) + Optical Circuit Switching
Cooling: water
Announced: 2023-12-06
GA / release: 2024-01-01

Chips inside

×8960Google TPU v5pTPU v5p chip

Where you'll find it

Data centers publicly running the chips inside this design. Per-rack counts are rarely disclosed, so these are presence rows: this campus runs these chips.

Google The Dalles Data Center Campus · TPU v5p available in us-east5 (Columbus) + us-central1 (Iowa) + us-central2 (Oklahoma) — The Dalles hosts related pods

Vendor page: https://cloud.google.com/tpu/docs/v5p

See also: all rack designs · chip catalog · Google.