Chip comparison
Groq LPU (Language Processing Unit) vs NVIDIA Jetson AGX Orin
Side-by-side specs
Straight from each vendor's datasheet. Winner in bold: higher throughput, memory, or transistor count; lower power draw or price. Sparse (2:4) throughput roughly doubles the FP8/INT8 numbers shown.
| Field | Groq LPU (Language Processing Unit) | NVIDIA Jetson AGX Orin |
|---|---|---|
| Process node | GlobalFoundries 14nm | Samsung 8N |
| TDP | 375 W | 60 W |
| Memory | 0.23 GB SRAM (230 MB on-die) | 64 GB LPDDR5 |
| Memory bandwidth | 80,000 GB/s | 204.8 GB/s |
| FP16 (dense) | 188 TFLOPS | — |
| INT8 (dense) | 750 TOPS | 275 TOPS |
| Form factor | PCIe (GroqCard) / rack-scale GroqRack | Module (AGX Orin 64GB) |
| Announced | 2020-01-01 | 2022-03-22 |
| Released | 2021-06-01 | 2022-07-01 |
Robots running Groq LPU (Language Processing Unit)
No robots publicly running it yet.
Robots running NVIDIA Jetson AGX Orin
Data centers with Groq LPU (Language Processing Unit)
No data centers publicly running it yet.
Data centers with NVIDIA Jetson AGX Orin
No data centers publicly running it yet.
Common questions
Groq LPU (Language Processing Unit) vs NVIDIA Jetson AGX Orin: which has more memory?
NVIDIA Jetson AGX Orin carries more HBM (Groq LPU (Language Processing Unit): 0.23 GB SRAM (230 MB on-die); NVIDIA Jetson AGX Orin: 64 GB LPDDR5). Memory capacity sets the largest model that fits on one chip without partitioning; memory bandwidth sets inference throughput.
Groq LPU (Language Processing Unit) vs NVIDIA Jetson AGX Orin: which is more widely used?
Groq LPU (Language Processing Unit): 0 robots and 0 data centers publicly running it. NVIDIA Jetson AGX Orin: 9 robots and 0 data centers. Empty here means no operator has said publicly, not zero adoption in the market.
See also: every chip comparison · Groq LPU (Language Processing Unit) full page · NVIDIA Jetson AGX Orin full page.