Anthropic tests Microsoft's Maia chips

- Anthropic was reported on May 21 to be in early talks to rent Microsoft servers using Maia AI chips for Claude inference. - Microsoft’s Maia 200 offers “over 30% improved tokens per dollar,” CEO Satya Nadella said in April, as Anthropic seeks more capacity. - The talks were first reported by The Information; Microsoft and Anthropic have not announced a final agreement.

Anthropic is in early talks to use Microsoft’s Maia AI chips, according to The Information, Reuters and CNBC, as the Claude maker looks for more inference capacity and another path beyond Nvidia-heavy supply. The discussions are not final and may not lead to a deal, people familiar with the matter told those outlets. If completed, the arrangement would make Anthropic an external user of Microsoft’s in-house AI silicon rather than just a buyer of standard cloud capacity. That matters because Anthropic is already one of the most compute-hungry model companies in the market. Dario Amodei, Anthropic’s chief executive, said earlier in May that the company had “difficulties with compute,” according to CNBC. Anthropic’s Claude assistant and Claude Code products have grown quickly this year, increasing demand for inference capacity. (money.usnews.com) ### Why would Anthropic want Maia instead of more Nvidia chips? Microsoft announced Maia 200 in January 2026 and has so far kept the chip inside its own data centers rather than broadly offering it on Azure, CNBC reported. A deal with Anthropic would therefore be less about buying a retail cloud SKU and more about renting access to Microsoft-operated infrastructure built around custom silicon. (cnbc.com) Nvidia still dominates the market for AI training and inference, but the pressure point here is cost and availability. Microsoft CEO Satya Nadella said on the company’s April earnings call that Maia 200 delivers “over 30% improved tokens per dollar” versus the latest silicon in Microsoft’s fleet. That metric is important because inference economics are increasingly measured in throughput and cost per generated token, not just peak model quality. (cnbc.com) ### What exactly is Microsoft offering? Microsoft’s Maia chips are custom AI accelerators designed to run inside Azure data centers. Nadella said in April that Maia systems were already running in Arizona and Iowa, and that Microsoft expected the chip to run OpenAI’s GPT-5.2 model. CNBC reported that Microsoft has lagged Amazon and Google in supplying outside customers with proprietary AI chips, so Anthropic would be a notable external win if the talks produce a contract. (cnbc.com) The structure under discussion appears to be server rental rather than chip sales. Reuters said Anthropic was discussing renting servers powered by Microsoft-designed chips, which would let Microsoft keep control of deployment, networking and operations while selling usable compute capacity. (cnbc.com) ### How does this fit with Anthropic’s other compute deals? Anthropic has not relied on a single infrastructure partner. CNBC said Microsoft announced a $5 billion investment in Anthropic in November, while Anthropic committed to spend $30 billion on Azure. The company also uses cloud services from Amazon and Google. (money.usnews.com) A separate deal shows how far that diversification is going. xAI said on May 6 that it had signed a compute partnership with Anthropic for access to Colossus 1, and SpaceX’s filing later disclosed terms under which Anthropic would pay as much as $1.25 billion a month through May 2029, according to CNBC, TechCrunch and xAI’s statement. That makes the Microsoft talks look less like a one-off experiment and more like a broader effort to secure inference and training capacity from multiple providers. (cnbc.com) ### Why are people calling this a shift in the AI business model? Network World wrote on May 23 that the xAI-Anthropic arrangement points to “AI compute as a standalone business,” with model companies increasingly buying infrastructure from one another instead of building every layer themselves. The same logic applies to Maia: if Anthropic rents Microsoft’s custom-chip capacity, compute becomes a service that can be traded across nominal rivals. (x.ai) For engineers and buyers, the practical change is in workload planning. A company no longer has to choose only between building chips, buying Nvidia systems, or waiting for a single cloud vendor’s roadmap. It can spread inference across several providers, compare tokens-per-dollar, and treat model serving capacity more like a procurement market. That is an inference from the reported Anthropic, xAI and Microsoft arrangements. (networkworld.com) ### What happens next? The immediate next step is whether Anthropic and Microsoft convert the talks into a signed infrastructure agreement. Reuters and CNBC both said the discussions were early and could still end without a deal. Microsoft has not yet broadly opened Maia 200 to Azure customers, so any formal announcement would also show how far the company is willing to commercialize its in-house chip program beyond internal use and OpenAI workloads. (networkworld.com) (money.usnews.com)

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.