Arm ships AGI CPU — Meta as first customer

Arm announced its first in‑house data center AI chip (called the AGI CPU) and says Meta is the inaugural customer, signaling Arm's move from IP licensor to finished-silicon vendor. That shifts the hardware landscape toward tighter hardware‑software stacks and raises questions about power, integration, and job routing at AI scale. (finance.yahoo.com)

The AGI CPU configuration tops out at 136 Neoverse V3 cores spread across two dies, with reported clock targets around 3.2 GHz base and 3.7 GHz boost on a 3 nm process. (siliconangle.com)) Memory and I/O specs published by reviewers list roughly 6 GB/s of memory bandwidth per core (about 825 GB/s aggregate), support for DDR5‑8800 and up to ~6 TB per socket, plus 96 PCIe Gen6 lanes, CXL 3.0 and AMBA CHI connectivity. (techpowerup.com)) Thermal and density numbers show a ~300 W TDP per CPU and vendor claims of more than 2× performance per rack versus comparable x86 platforms, with quoted rack densities of ~8,000 cores for air cooling and >45,000 cores with liquid cooling. (newsroom.arm.com)) Multiple large cloud and AI firms were named as early adopters beyond the lead partner, including OpenAI, Cloudflare and SAP among a group of seven other committed customers reported by outlets covering the launch. (cnbc.com)) Design choices emphasize one thread per core (no simultaneous multithreading) and sub‑100‑nanosecond memory latencies to favor predictable per‑thread performance for high‑token‑throughput agentic AI workloads, with Arm explicitly linking these choices to rising CPU demand per gigawatt. (onmsft.com)) Manufacturing details point to TSMC’s 3 nm node for the dual‑die parts and industry analysts note the product positions the company into merchant silicon supply chains alongside existing server CPU vendors. (trendforce.com))

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.