Sunday, December 10, 2023

AI Super Clusters Need Optics to Scale

AI super clusters, powered by vast numbers of GPUs or specialized silicon, are redefining data center architecture. 

Radha Nagarajan, SVP and CTO, Optical and Cloud from Marvell explains:

  • The increasing size of AI clusters: AI clusters are growing from a handful of GPUs to super clusters, necessitating efficient data movement over large distances. This growth is driving the need for larger interconnected pods, achievable only through optical connectivity.
  • The role of optical connectivity in AI clusters: As AI clusters expand, copper cables and active electrical cables are no longer sufficient due to their limited reach. Optical connectivity becomes critical, especially for AI-centric data centers that are starting to be built today.
  • The future of data transport in AI clusters: As the data generated by AI clusters continues to increase, the need for higher data transport speeds is evident. Marvell is pushing ahead with its current 800G and soon 1.6 Tbps solutions. 


https://youtu.be/B2IEZHlhJfE

Want to be involved our video series? Contact info@nextgeninfra.io