Anthropic Secures 1M Google TPUs in Major Infra Deal
Anthropic has reportedly secured a massive deal with Google for one million Tensor Processing Units (TPUs), representing one gigawatt of power. This move is seen as a push for infrastructure independence from cloud rentals, potentially halving model costs for the AI company.
- While this is a landmark deal with Google, Anthropic maintains a multi-cloud strategy, with Amazon Web Services (AWS) remaining its primary partner for model training. Anthropic utilizes Amazon's custom Trainium processors in a massive cluster known as Project Rainier, in addition to NVIDIA GPUs, allowing it to optimize workloads across different chip architectures. - The deal provides Anthropic access to Google's upcoming seventh-generation "Ironwood" TPUs. Unlike general-purpose GPUs, TPUs are Application-Specific Integrated Circuits (ASICs) designed specifically for neural network operations, featuring a systolic array architecture that excels at the large-scale matrix multiplications fundamental to AI models. - This agreement is one of the largest single AI hardware commitments ever, valued at tens of billions of dollars. For context, industry analysts estimate that building a one-gigawatt data center from the ground up costs approximately $50 billion, with around $35 billion of that allocated just for the chips. - Google's TPUs are deeply integrated with its own software frameworks like TensorFlow and JAX, which can offer significant price-performance advantages for optimized workloads. Some companies moving AI inference tasks from NVIDIA GPUs to TPUs have reported cost reductions of 50% to 65%. - The push for more compute is driven by immense customer growth; Anthropic now serves over 300,000 business customers, and its large enterprise accounts (those with over $100,000 in annual revenue) have grown by nearly 7x in the past year. - This deal is part of a broader, capital-intensive strategy. Anthropic has also placed a $21 billion order for Broadcom TPU racks and announced a $50 billion data center construction project with FluidStack. - Both Google and Amazon have made substantial equity investments in Anthropic. Google has invested around $3 billion, while Amazon has committed a total of $8 billion, making AWS Anthropic's largest financial backer and primary cloud provider for critical workloads.
