At the Google I/O event, Sundar Pichai introduced Trillium, its sixth generation Tensor Processing Unit (TPU).
Trillium TPU Features:
- Performance: 4.7x faster compute performance than TPU v5e.
- Memory: Doubled High Bandwidth Memory (HBM) capacity and bandwidth.
- Interconnectivity: Doubled Interchip Interconnect (ICI) bandwidth.
- Efficiency: Over 67% more energy-efficient than TPU v5e.
- SparseCore: Specialized accelerator for large language models.
- Scalability: Up to 256 TPUs in a single pod.
- Multi-pod scalability: Connects hundreds of pods with tens of thousands of chips.
https://cloud.google.com/blog/products/compute/introducing-trillium-6th-gen-tpus?e=48754805
