Tuesday, March 21, 2023

Connecting data center racks for AI/ML

How do you build a data center rack for AI/ML training? At OFC23, Credo showcased a high-performance rack with 3 next gen appliances connected with 3 types of physical networking, including a big backbone for RDMA sharing, which could be used for GPT-style applications. 

https://youtu.be/nHb7Bee1_M8

Also on display was a Credo 800G Active Electrical Cable with the Screaming Eagle retimer. Another demo featured Credo's Dove 800G Digital Signal Processor (DSP) demonstrating the ability to support extra host performance in a hyperscaler environment by supporting an (MR) interface. 

A suite of Dove 800 optical DSP demos showcased performance in various applications, interoperability, internal VCSEL driver, host performance and silicon photonics integration. 

Here is a booth tour with Don Bartleson and Easwar Shanker.