NVIDIA previews its first data center CPU, due in 2023

NVIDIA unveiled its first data center CPU, an Arm-based processor featuring a new memory architecture and designed for the most complex AI and high-performance computing workloads.

The forthcoming "Grace" CPU, which is named in honor of Grace Hopper, the U.S. computer-programming pioneer — is a highly specialized processor targeting workloads such as training next-generation NLP models that have more than 1 trillion parameters. When tightly coupled with NVIDIA GPUs, a Grace CPU-based system will deliver 10x faster performance than today’s state-of-the-art NVIDIA DGX-based systems, which run on x86 CPUs.

 Underlying Grace’s performance is fourth-generation NVIDIA NVLink interconnect technology, which provides a record 900 GB/s connection between Grace and NVIDIA GPUs to enable 30x higher aggregate bandwidth compared to current generation servers. Grace will also utilize an innovative LPDDR5x memory subsystem that will deliver twice the bandwidth and 10x better energy efficiency compared with DDR4 memory. In addition, the new architecture provides unified cache coherence with a single memory address space, combining system and HBM GPU memory to simplify programmability.

“Leading-edge AI and data science are pushing today’s computer architecture beyond its limits – processing unthinkable amounts of data,” said Jensen Huang, founder and CEO of NVIDIA. “Using licensed Arm IP, NVIDIA has designed Grace as a CPU specifically for giant-scale AI and HPC. Coupled with the GPU and DPU, Grace gives us the third foundational technology for computing, and the ability to re-architect the data center to advance AI. NVIDIA is now a three-chip company.”

CSCS and Los Alamos National Laboratory both plan to bring Grace-powered supercomputers, built by Hewlett Packard Enterprise, online in 2023.

https://nvidianews.nvidia.com/news/nvidia-announces-cpu-for-giant-ai-and-high-performance-computing-workloads

Read More

NVIDIA outlines roadmap for BlueField data processing units (DPUs)

NVIDIA outlined a roadmap for the next two generations of its BlueField data processing unit (DPU) chips.

The current generation, BlueField-2, is now shipping and features dual 100Gb/s Ethernet or InfiniBand network ports and up to eight Arm cores. The BlueField-2 DPU includes accelerators for software-defined storage, networking, security, streaming, line rate TLS/IPSEC cryptography, precision timing for 5G telco and time-synchronized data centers and other cloud infrastructure services.

BlueField-3, which is expected to sample in the first quarter of 2022, will deliver 400GbE/NDR networking performance. It features 10x the accelerated compute power of the previous generation, with 16x Arm A78 cores and 4x the acceleration for cryptography. BlueField-3 is also the first DPU to support fifth-generation PCIe and offer time-synchronized data center acceleration. The company says BlueField-3 will enable real-time network visibility, detection and response for cyber threats and acts as the monitoring, or telemetry, agent for NVIDIA Morpheus, an AI-enabled, cloud-native cybersecurity platform, also announced today.

BlueField-3 takes advantage of NVIDIA DOCA, NVIDIA'S new data-center-on-a-chip software platform for building software-defined, hardware-accelerated networking, storage, security and management applications running on BlueField DPUs. Released today and available for download, DOCA includes a runtime environment to create, compile and optimize applications for the BlueField DPU; orchestration tools to provision, update and monitor thousands of DPUs across the data center; as well as libraries, APIs and a growing number of applications, such as deep packet inspection and load balancing.

BlueField-4 was shown on a slide with a projected 2024 horizon. It is expected to scale to 800GbE performance.

“Modern hyperscale clouds are driving a fundamental new architecture for data centers,” said Jensen Huang, founder and CEO of NVIDIA. “A new type of processor, designed to process data center infrastructure software, is needed to offload and accelerate the tremendous compute load of virtualization, networking, storage, security and other cloud-native AI services. The time for BlueField DPU has come.”

“Red Hat continues to collaborate with NVIDIA as part of an open ecosystem that accelerates innovation while providing access to the latest hardware innovations for composable infrastructure,” said Chris Wright, chief technology officer of Red Hat. “We recognize the need to develop advanced solutions for network security and automation and are excited to support BlueField DPUs and the NVIDIA Morpheus AI framework via Red Hat Enterprise Linux, Red Hat OpenShift, industry-leading containers and Kubernetes-powered hybrid cloud platform.”

“Our mutual customers are racing to harness the power of AI for enterprise applications,” said Lee Caswell, vice president of marketing for the Cloud Platform Business Unit at VMware. “The vision of enterprise infrastructure powered by the VMware Cloud Foundation and to be certified with the newly announced NVIDIA BlueField-3 DPU shows customers a path to improved application performance, a consistent operating model across virtualized and bare-metal environments, along with a new model for delivering zero-trust security without compromising performance.”

NVIDIA also disclosed that it is using its BlueField DPUs to accelerate its GeForce Now online gaming service.

https://nvidianews.nvidia.com/

NVIDIA acquires Mellanox - focus on Next Gen Data Centers

Monday, April 27, 2020  Mellanox, Mergers And Acquisitions, Nvidia  

NVIDIA completed its $7 billion acquisition of Mellanox Technologies. The deal was originally announced on March 11, 2019. NVIDIA says that by combining its computing expertise with Mellanox’s high-performance networking technology, data center customers will achieve higher performance, greater utilization of computing resources and lower operating costs. “The expanding use of AI and data science is reshaping computing and data center architectures,”...

READ MORE

Read More

NVIDIA builds an ecosystem for its AI-on-5G platform

NVIDIA announced partnerships with Fujitsu, Google Cloud, Mavenir, Radisys and Wind River to develop solutions for its AI-on-5G platform.

NVIDIA's AI-on-5G platform combines its Aerial software development kit with its BlueField-2 A100 — a converged card that combines GPUs and DPUs including NVIDIA’s “5T for 5G” solution.

“In this era of continuous, accelerated computing, network operators are looking to take advantage of the security, low latency and ability to connect hundreds of devices on one node to deliver the widest range of services in ways that are cost-effective, flexible and efficient,” said Ronnie Vasishta, senior vice president of Telecom at NVIDIA. “With the support of key players in the 5G industry, we’re delivering on the promise of AI everywhere.”

NVIDIA’s collaboration with others working to enable AI-on-5G includes:

Mavenir, which is building two 5G vRAN systems based on the Aerial SDK, and will target the network operator segment for public 5G and for enterprise AI with private 5G. Mavenir and NVIDIA have created a hyperconverged enterprise 5G solution to enable enterprises to implement AI-on-5G applications in a seamless and easy-to-use solution.

Fujitsu later this year plans to deliver a 5G Open RAN system for verification starting with Sub6 band. Upon the system’s completion, Fujitsu and NVIDIA will be helping NTT DOCOMO and global operators with their evolution toward Open RAN in 5G, and beyond. Aerial software-defined implementation reduces time to market, speeds innovation and helps deliver AI applications to enterprises.

Radisys and Wind River plan to deliver NVIDIA Aerial AI-on-5G solutions for enterprise 5G and industrial 5G networks. Over 6 million 5G cells will be deployed by 2027 to smart factories, fulfillment centers and other enterprise, industrial and public zones to provide localized connectivity solutions, according to ABI Research.

Google Cloud is extending the Anthos application platform to the network edge, allowing telecommunications service providers and enterprises to enable the rapid delivery of new services and applications at the 5G edge. Anthos offers a consistent platform for application deployments, with a service-centric view of each environment. The platform enables customers to build and deploy enterprise-grade, containerized applications faster with managed Kubernetes in the cloud, on premises and at the network edge. Anthos supports NVIDIA GPU-accelerated servers, enabling a consistent deployment and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

“AI-on-5G is transformative. Google Cloud’s industry-specific AI solutions meet scalable vertical needs,” said Shailesh Shukla, vice president and general manager for Networking at Google Cloud. “With the power of 5G, Google’s AI offering increases exponentially. We are excited to expand our work with NVIDIA to deliver AI and 5G computing at the edge with Anthos and NVIDIA’s accelerated edge technologies.”

https://nvidianews.nvidia.com/news?q=A100&year=&c=

Read More

NVIDIA: Q1 revenue ahead of expectations

NVIDIA announced that first quarter revenue for fiscal 2022 is tracking above its previously provided outlook, with outperformance in each of its market platforms.

“While our fiscal 2022 first quarter is not yet complete, Q1 total revenue is tracking above the $5.30 billion outlook provided during our fiscal year-end earnings call. We are experiencing broad-based strength, with all our market platforms driving upside to our initial outlook,” said Colette Kress, executive vice president and chief financial officer of NVIDIA.

“Within Data Center we have good visibility, and we expect another strong year. Industries are increasingly using AI to improve their products and services. We expect this will lead to increased consumption of our platform through cloud service providers, resulting in more purchases as we go through the year. Our EGX platform has strong momentum, and we expect this will drive increased revenue from enterprise and edge computing deployments in the second half of the year.

“Overall demand remains very strong and continues to exceed supply while our channel inventories remain quite lean. We expect demand to continue to exceed supply for much of this year. We believe we will have sufficient supply to support sequential growth beyond Q1,” she continued.

https://s22.q4cdn.com/364334381/files/doc_presentations/2021/04/v2/NVIDIA-Investor-Day-2021-FINAL.pdf

Read More

Samsung releases PCIe Gen4 Client SSD

Samsung Electronics released the first OEM-qualified PCIe Gen4 NVMe Client SSD. Engineered specifically for OEM applications and incorporating Samsung’s own NAND, controller, and firmware into the compact M.2 form factor, the PM9A1 is the first device of its type to be integrated into an OEM producer’s laptop.

The new PM9A1 SSD provides sequential read speeds of 7,000 MB/s for 50% faster file operations and boosts random read speeds by 50 percent to 1,000K IOPs for improved system response. 

All the key components, DRAM, V-NAND, and Elpis controller are developed specifically by Samsung. The PM9A1 uses sixth generation V-NAND, which has 12% faster read & 20% write speed, and 15% reduced power consumption compared to the prior generation. The drive is also equipped with advanced thermal control technology to allow the drive to perform well at cool temperatures and prevent overheating, which is particularly important during heavy workload use.

“The PM9A1 represents a big step forward for SSD technology. From our newest generation V6 NAND, to the custom firmware and controller, everything is developed in house to deliver the best performance available in the market,” said Jaejune Kim, corporate senior vice president of Memory Marketing at Samsung Semiconductor, Inc. “In demanding applications such as gaming, V/R and A/R, graphic design, as well as video editing, storage is becoming increasingly important not just as a data repository, but as a key technology enabler. The PM9A1 is an essential building block to next-generation computing.”

“Our customers’ priorities have shifted over the last year of remote work, and ensuring they have access to the essential compute technology needed to power how and where they work is critical,” said Jim Nottingham, general manager and global head, Advanced Compute and Solutions, HP Inc. “There is clear demand for PCIe Gen4’s capabilities and HP is working closely with Samsung to offer future support for the PM9A1, delivering increased bandwidth for even greater performance and seamless workflows for data-intensive users.”

Read More

Biden nominates National Cyber Director and CISA Director

 President Biden will nominate Chris Inglis as the firstNational Cyber Director and Jen Easterly as the Director of the Cybersecurity and Infrastructure Agency. 

John Chris Inglis is a former Deputy Director of the National Security Agency.

Jen Easterly is a former Army intelligence officer and currently Head of Firm Resilience and the Fusion Resilience Center at Morgan Stanley.

https://www.whitehouse.gov/

Read More

NEC to deliver 5G core running Red Hat OpenShift

NEC Corporation will deliver 5G core solutions built on Red Hat OpenShift, the leading enterprise Kubernetes platform. 

Michio Kiuchi, senior vice president , NEC, states: “We are pleased to collaborate with Red Hat to help CSPs and DSPs stay competitive in this increasingly demanding global 5G market, especially on the cloud-native front. Through our long-term and continued collaboration with Red Hat, we are working to build an open industry standard which has enormous potential for expanding awareness and adoption of 5G cloud-native network functions. NEC 5G solutions will provide a more efficient and reliable network experience for our customers by integration with Red Hat’s cloud-native solution.”

Read More