Wednesday, May 29, 2024

Arm readies next-gen, on-device AI silicon

Arm introduced its Compute Subsystems (CSS) for Client, a framework that brings together its Armv9 capabilties into production-ready implementations of new Arm CPUs and GPUs on 3nm process nodes.

CSS for Client provides the foundational computing elements for the company's flagship SoCs and features the latest Armv9.2 CPUs and Immortalis GPUs, as well as production ready physical implementations for CPU and GPU on 3nm and the latest Corelink System Interconnect and System Memory Management Units (SMMUs).

Silicon companies can use the Arm CSS framework to create the lates compute solutions for AI smartphones and PCs, delivering Android workloads with greater than 30 percent increase on compute and graphics performance and 59 percent faster AI inference for broader AI/ML and computer vision (CV) workloads, according to the company.

The new Arm Cortex-X925 CPU cluster is Arm’s most powerful and efficient yet. Using advanced 3nm process nodes and running at 3.8GHz with maximum cache size, the Cortex-X925 achieves a 36% increase in single-thread performance over 2023 flagship 4nm SoCs. For AI applications, it provides a remarkable 41% performance boost, significantly enhancing the responsiveness of on-device generative AI like large language models.

Key Points for the new Arm Cortex-X925 CPU:

Performance: Highest year-on-year performance uplift in Cortex-X history.

Process Node: Advanced 3nm technology.

Clock Rate: 3.8GHz with maximum cache.

Single-Thread Performance: 36% increase compared to 2023 4nm SoCs.

AI Performance: 41% improvement for on-device generative AI tasks.

Arm's press release cites supports from TSMC, Samsung Foundry, and Intel Foundry Services.

https://newsroom.arm.com/news/arm-css-for-client?utm_source=linkedin&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk04_client_css24