Thursday, December 14, 2023

Intel launches its Next-Gen AI processors

Intel introduced its latest processors for the data center, cloud, network, edge and PCs, and featuring AI optimizations. 

Some highlights:

5th Gen Intel Xeon processors (code-named Emerald Rapids) optimized for networking workloads including specialized AI and virtualized workloads.

Xeon for the network

  • 1.51x higher throughput with 5G core user plane functions (UPF) vs. prior generation.
  • 1.37x performance per watt improvement with Intel Infrastructure Power Manager software for 5G UPF applications vs. prior generation.
  • • 3.73x higher throughput on VPP IPSec (1420B) with integrated Intel QAT accelerator (as compared to without Intel QAT).
  • 1.69x higher connections per second on NGINX TLS 1.3 Webserver Handshake with integrated Intel QAT accelerator vs. prior generation.

Xeon for the edge

  • 1.29x average performance-per-watt gain vs. 3rd Gen Intel Xeon® Gold 6348 processor.
  • 1.59x average performance gain vs. 3rd Gen Intel® Xeon® Gold 6348 processor
  • 3.13x higher real-time inference performance for image classification vs. AMD EPYC 9334
  • 5.28x higher real-time inference performance for object detection vs. 3rd Gen Intel Xeon Gold 6348 processor

Intel expects to deliver its Gaudi3 AI accelerator for deep learning and large-scale generative AI models.

Intel Core Ultra processors for the edge

  • 1.5x the AI performance
  • • 1.81x the Graphics performance
  • • 2.56x the AI Performance per Watt