DEPLOYDatabase

Chip comparison

Google TPU v5p vs NVIDIA Jetson AGX Orin

Side-by-side specs

Straight from each vendor's datasheet. Winner in bold: higher throughput, memory, or transistor count; lower power draw or price. Sparse (2:4) throughput roughly doubles the FP8/INT8 numbers shown.

FieldGoogle TPU v5pNVIDIA Jetson AGX Orin
Process nodeSamsung 8N
TDP300 W60 W
Memory95 GB HBM2e64 GB LPDDR5
Memory bandwidth2,765 GB/s204.8 GB/s
BF16 (dense)459 TFLOPS
INT8 (dense)918 TOPS275 TOPS
Form factorOAM (per-chip in v5p pod)Module (AGX Orin 64GB)
Announced2023-12-062022-03-22
Released2024-01-012022-07-01

Robots running Google TPU v5p

No robots publicly running it yet.

Data centers with Google TPU v5p

Data centers with NVIDIA Jetson AGX Orin

No data centers publicly running it yet.

Common questions

Google TPU v5p vs NVIDIA Jetson AGX Orin: which has more memory?

Google TPU v5p carries more HBM (Google TPU v5p: 95 GB HBM2e; NVIDIA Jetson AGX Orin: 64 GB LPDDR5). Memory capacity sets the largest model that fits on one chip without partitioning; memory bandwidth sets inference throughput.

Google TPU v5p vs NVIDIA Jetson AGX Orin: which is more widely used?

Google TPU v5p: 0 robots and 1 data center publicly running it. NVIDIA Jetson AGX Orin: 9 robots and 0 data centers. Empty here means no operator has said publicly, not zero adoption in the market.

See also: every chip comparison · Google TPU v5p full page · NVIDIA Jetson AGX Orin full page.