Google Cloud has unveiled Trillium, its new AI chip with 4x faster training and up to 3x higher inference throughput than its predecessor. Trillium features doubled memory and bandwidth, supports large language models, and can link up to 256 chips in a pod. It boasts 67% better energy efficiency. Google also announced upcoming preview of A3 Ultra VMs with Nvidia H200 GPUs.
Microsoft has enhanced Azure AI with new features: Data Zone for geographic data control, a 99.9% latency SLA, new AI models including medical imaging and language models, and GitHub Marketplace API access. These updates improve data privacy, reliability, and accessibility for Azure AI users.
Datadog, a cloud monitoring firm, has increased its annual revenue forecast to £2.66 billion and raised its adjusted profit forecast to £1.75-1.77 per share. This improved outlook is due to growing demand for its AI-backed cybersecurity products. The company also reported quarterly revenue and profit exceeding analyst expectations.
Amazon Bedrock has introduced application inference profiles, allowing organisations to tag on-demand models and monitor costs. This feature enables custom tagging for foundation models, improving cost tracking across AI applications. It integrates with AWS services for better cost visualisation and management. The profiles can be created using model ARNs or by copying existing ones, and can be dynamically retrieved using Resource Groups API. This feature is now available in all AWS Regions where Amazon Bedrock is offered, enhancing cost allocation for generative AI initiatives.
