Arm Enters Data Center CPU Market with AGI CPU, Co-Developed with Meta

Arm Holdings has announced the AGI CPU, marking a historic shift for the company as it enters the data center CPU market with its own silicon. For over three decades, Arm has primarily focused on licensing its instruction set architecture to chipmakers like Apple, Nvidia, Amazon, and Google. The AGI CPU represents Arm’s first foray into designing, manufacturing, and selling its own production processor, co-developed with Meta and built on TSMC’s 3nm process with Neoverse V3 cores.

Designed for Agentic AI Infrastructure

The AGI CPU is specifically designed for what Arm terms “agentic AI infrastructure,” addressing the growing need for CPU-side orchestration in large-scale AI deployments. This includes coordinating accelerators and managing data movement, a critical function as AI systems turn into more complex.

AGI CPU Specifications

The chip boasts up to 136 Neoverse V3 cores, running at speeds up to 3.2 GHz all-core and 3.7 GHz boost. It operates within a 300-watt Thermal Design Power (TDP) envelope. Key features include:

• Memory Support: 12 channels of DDR5 memory at up to 8800 MT/s, delivering over 800 GB/s of aggregate bandwidth (6GB/s per core) with sub-100ns latency.
• I/O: 96 PCIe Gen6 lanes and native CXL 3.0 support for memory expansion and pooling.

Reference Platform and Scalability

Arm’s reference platform is a 10U dual-node server compliant with the Open Compute Project’s DC-MHS standard. Each blade can accommodate two AGI CPUs, and a standard air-cooled 36kW rack can house 30 blades, totaling 8,160 cores. A liquid-cooled configuration, developed in partnership with Supermicro, can fit 336 chips and over 45,000 cores within a 200kW rack.

Performance Claims and Early Adopters

Arm claims the AGI CPU delivers more than two times the performance per rack compared to current x86 platforms. Meta is the first official customer, planning to deploy the AGI CPU alongside its custom MTIA accelerators. Other early adopters include Cerebras, Cloudflare, F5, OpenAI, Positron, Rebellions, SAP, and SK Telecom.

A Shift in Arm’s Business Model

This move represents a significant evolution for Arm, adding a third option to its existing business model of IP licensing and Compute Subsystems (CSS). Arm intends to continue developing both its IP and CSS offerings alongside the AGI CPU product line. Sachin Katti, head of industrial compute at OpenAI, stated the AGI CPU will strengthen the orchestration layer for large-scale AI workloads.

Key Takeaways

• Arm has entered the data center CPU market with its own silicon, the AGI CPU.
• The AGI CPU is co-developed with Meta and built on TSMC’s 3nm process.
• It’s designed for “agentic AI infrastructure,” focusing on CPU-side orchestration for AI workloads.
• Arm claims a performance advantage over x86 platforms.
• Meta, OpenAI, and other major companies are early adopters of the AGI CPU.

Follow Tom’s Hardware on Google News or add us as a preferred source to get our latest news, analysis, & reviews in your feeds.