Google Cloud has unveiled Trillium, its new AI chip with 4x faster training and up to 3x higher inference throughput than its predecessor. Trillium features doubled memory and bandwidth, supports large language models, and can link up to 256 chips in a pod. It boasts 67% better energy efficiency. Google also announced upcoming preview of A3 Ultra VMs with Nvidia H200 GPUs.
