Thursday, November 30, 2023

Broadcom’s next Trident switching silicon doubles capacity, adds neural engine

 Broadcom announced an on-chip, neural-network inference engine called NetGNT (Networking General-purpose Neural-network Traffic-analyzer) in its new, software-programmable Trident 5-X12 chip for top-of-rack (ToR) data center switches.

The new Trident 5-X12 chip provides 16.0 Tbps of bandwidth, which is double that of the Broadcom’s current Trident 4-X9. It also adds support for 800G ports, allowing direct connection to Broadcom’s Tomahawk 5, which is used as the spine/fabric in the newest compute and AI/ML data centers. 

Broadcom says its new chip is uniquely positioned to enable a 1RU data center ToR supporting 48x200G downlink ports and 8x800G uplink ports.

NetGNT works in parallel to augment the standard packet-processing pipeline. The standard pipeline is one-packet/one-path, meaning that it looks at one packet as it takes a specific path through the chip’s ports and buffers. NetGNT, in contrast, is an ML inference engine and can be trained to look for different types of traffic patterns that span the entire chip.

For example, NetGNT can look for a traffic pattern common in AI/ML workloads called “incast” in which many packet flows all converge on the same port and buffer at roughly the same time causing congestion. NetGNT can recognize this pattern in real-time as it begins and invoke congestion-control techniques to avoid degraded network performance. And since NetGNT runs in hardware at full line rate— there is no impact to throughput or latency.

“We continue to push the envelope and introduce brand-new technologies such as NetGNT to the market. We also listen very closely to our customers who have made it clear that one size does not fit all. They rely on us to deliver a broad portfolio of chips, customized for different applications,” said Ram Velaga, senior vice president and general manager, Core Switching Group, Broadcom. “Trident 5-X12 is the most power-efficient ToR (Top of Rack) on the market, while still adding cutting-edge new features that our customers have come to expect from an innovator such as Broadcom.”

Trident 5-X12 highlights

  • Uses 25% less power per 400G port than current market-leading Trident 4-X9
  • Adds support for 800G ports using Broadcom’s industry-leading 100G-PAM4 SerDes, enabling up to 4m DAC and Linear Optics
  • Supports the transition to next-generation CPU & GPU servers using 400G NICs
  • Adds NetGNT to enable new capabilities along with improved network efficiency and performance
  • Adds enhanced telemetry capabilities allowing deeper real-time insights into network operations, which can then be used to train NetGNT
  • Increases forwarding/policy scales to support ever-expanding network sizes
  • Maintains legacy API compatibility with current Broadcom switch chips
  • Fully-programmable using NPL (Network Programming Language), allowing in-field upgrades to add features such as new telemetry, security and traffic engineering
  • NPL-compatible with current Trident 4 family, which is already in use by a large number of customers to develop their own customized switch applications
  • Support for Enterprise SONiC and SAI promote rapid and seamless integration into data center operations frameworks

HPE targets AI-native architecture and hybrid cloud

Hewlett Packard Enterprise  introduced its next series of AI-native and hybrid cloud offerings for machine learning development, data analytics, AI-optimized file storage, AI tuning and inferencing and professional services. 

The solutions are based on an open, full-stack AI-native architecture and leverage HPE’s expertise in hybrid cloud, supercomputing and AI/ML software.

“With the emergence of GenAI, enterprises are quickly realizing that the data and computational demands to effectively run AI models require a fundamentally different approach to technology,” said Antonio Neri, president and CEO, at HPE. “HPE will bring its market-leading hybrid cloud, supercomputing and AI capabilities more broadly to the enterprise to enable an AI-powered transformation, where customers can develop AI models securely with their proprietary data. 

Key elements of the announcement

  • Data-first pipeline to manage public and proprietary data across multi-gen IT
  • AI lifecycle management software to accelerate workflows for training, tuning and inferencing
  • Hybrid by design to run AI anywhere from edge to cloud with data protection
  • High-performance interconnects for intelligent connectivity and traffic management for large clusters
  • Supercomputing DNA built into the entire portfolio, sustainable by design, to train the largest models
  • Open ecosystem for freedom of choice with no lock-in

HPE teams with NVIDIA on Enterprise GenAI

Hewlett Packard Enterprise announced an expanded alliance with NVIDIA to build an enterprise computing solution for generative AI (GenAI). 

These solutions integrate HPE Machine Learning Development Environment Software, HPE Ezmeral Software, HPE ProLiant Compute and HPE Cray Supercomputers with the NVIDIA AI Enterprise software suite, including the NVIDIA NeMo framework. 

Hardware encompasses rack-scale  HPE ProLiant Compute DL380a pre-configured with NVIDIA L40S GPUs, NVIDIA BlueField-3 DPUs and the NVIDIA Spectrum-X Ethernet Networking Platform for hyperscale AI. The solution was sized to fine-tune a 70 billion-parameter Llama 2 model and includes 16 HPE ProLiant DL380a servers and 64 L40S GPUs.

“Together, HPE and NVIDIA are in a unique position to deliver a comprehensive AI-native solution that will dramatically ease the journey to develop and deploy AI models with a portfolio of pre-configured solutions,” said Antonio Neri, president and CEO, at HPE. “The strategic collaboration between HPE and NVIDIA will dramatically reduce barriers for customers looking to transform their businesses with AI.”

Marvell posts Q3 sales of $1.419 billion, down 8% yoy

Marvell Technology Q3 revenue of $1.419 billion, down by 8% year-over-year, and $19 million above the midpoint of the company's guidance provided on August 24, 2023. 

GAAP net loss for the third quarter of fiscal 2024 was $(164.3) million, or $(0.19) per diluted share. Non-GAAP net income for the third quarter of fiscal 2024 was $354.1 million, or $0.41 per diluted share. Cash flow from operations for the third quarter was $503.0 million.

"Marvell delivered third quarter fiscal 2024 revenue of $1.419 billion, growing 6% sequentially, above the midpoint of guidance. Revenue from our datacenter end market grew over 20% sequentially in the third quarter, and we expect growth of over 30% sequentially in our fourth quarter," said Matt Murphy, Marvell's Chairman and CEO. "The diversification of our portfolio is serving us well, with strong growth from AI and cloud carrying us through a softening demand environment in other end markets. These dynamics are reflected in our forecast for overall revenue to be flat sequentially in the fourth quarter at the midpoint of guidance."

Q3 2023 Revenue by Segment

  • Data center $555.8 million
  • Enterprise networking $271.1 million
  • Carrier infrastructure $316.5 million
  • Consumer $168.7 million
  • Automotive/industrial $106.5 million

Vertiv supplies liquid cooling for Intel Gaudi AI Accelerator

Vertiv is providing a liquid cooling solution for the new Intel Gaudi3 AI accelerator, scheduled to launch in 2024. 

The Intel Gaudi3 AI accelerator will enable both liquid-cooled and air-cooled servers, supported by Vertiv pumped two-phase (P2P) cooling infrastructure. 

The liquid cooled solution has been tested up to 160kW accelerator power using facility water from 17°C up to 45°C (62.6°F to 113°F). The air-cooled solution has been tested up to 40kW of heat load that can be deployed in warm ambient air data centers up to 35°C (95°F). This medium pressure direct P2P refrigerant-based cooling solution will help customers implement heat reuse, warm water cooling, free air cooling and reductions in power usage effectiveness (PUE), water usage effectiveness (WUE) and total cost of ownership (TCO).

“The Intel Gaudi3 AI accelerator provides the perfect solution for a Vertiv and Intel collaboration,” said John Niemann, SVP global thermal line of business at Vertiv. “Vertiv continues to expand our broad liquid cooling portfolio, resulting in our ability to support leaders of next generation AI technologies, like Intel. Vertiv helps customers accelerate the adoption of AI quickly and reliably, while also helping them to achieve sustainability goals.”

Aviz Networks raises $10m for its open networking software

Aviz Networks, a start-up based in San Jose, California, has added Cisco Investments to its latest funding expansion, joining existing investors, Moment Ventures, Accton and Wistron. 

This funding round, now reaching $10M, will accelerate customer momentum for Aviz’s multi-vendor, GenAI-based networking stack along with adoption of SONiC based open networking.

Aviz’s stack supports the fast-growing SONiC open-source network OS (NOS) as well as multi-NOS environments and leverages the power of large-language-models (LLMs).

“We are delighted to close this latest funding round that includes Accton, Cisco Investments, Moment Ventures, and Wistron. Our vision of delivering open, cloud & AI enabled networks for all enterprises and telecoms has rapidly taken shape as we partner with customers and our vendor ecosystem,” said Vishal Shukla, Co-Founder and CEO for Aviz.

Malaysia’s Axiata picks AWS as its primary cloud

Axiata Group, a leading Asian telco and digital group headquartered in Malaysia, has selected AWS as its primary cloud provider. 

Axiata will migrate a large array of its mission-critical applications, including more than 650 services across customer service, enterprise resource planning, and human resources, to AWS by the end of 2024. 

In addition, Axiata will move 80 machine learning (ML) applications to the AWS.

“AWS has been a key collaborator in our digital transformation journey, accelerating our time to market for new services, enabling us to better serve our 174 million customers across Asia,” said Anthony Rodrigo, group chief information officer at Axiata. 

Broadcom cuts over 1800 VMware positions

Following the completion of its acquisition of VMware last week, Broadcom filed papers to state employment offices regarding the elimination of approximately 2,000 positions.

This includes 1,267 positions in California, along with 600 additional staff in the states of Washington, Colorado and Georgia.

Wednesday, November 29, 2023

OVHcloud Summit 2023 Paris: Innovation for Freedom

Marking its its 24th year as a company and its tenth annual Summit event in Paris, OVHcloud showcased its key innovations in security, compute, storage, database, network services, analytics, AI and quantum.

OVHcloud executives highlighted solid full year 2023 financial results published just a month ago that delivered double-digit growth in a challenging global context.

Key announcements:

  • Expanding its global presence, with 38 Data-Centers across 4 continents, OVHcloud now generates 52% of its revenue outside of France. The company is the process of opening facilities in Singapore, Sydney, Mumbai, and Toronto, while expanding in other locations, especially Paris.
  • OVHcloud now has more than 80 clients using SecNumCloud qualified infrastructures, which guarantees that cloud services are fully protected against foreign (non-EU) access
  • In December 2023, OVHcloud is set to open a third SecNumCloud Data Center in Gravelines, France, joining the existing SecNumCloud Data Centers located in Roubaix and Strasbourg, France answering growing demands from its customers base;

  • A new Bare Metal SecNumCloud offer is in the works and the Group has just begun its SecNumCloud qualification procedure with ANSSI;
  • The Group plans to further extend the SNC qualification to its IaaS and PaaS offers starting with enabling its PaaS solutions portfolio in the Public Cloud universe including Kubernetes, databases, Data Platform and the most recent AI Solutions.

  • New Compute Instances: Available now, OVHcloud’s new compute instances are powered by AMD EPYC processors and tackle new use-cases for workloads requiring either a balanced mixed of processor/memory/storage (General Purpose B3), high-performance many cores processing (Compute Optimized C3) and fast memory data processing (Memory Optimized R3)
  • New Block Storage & File Storage: Public Cloud will soon benefit from Block Storage with NVMe over fabric enabled storage options for use-cases where I/O is crucial, with a Beta version available now. The new File Storage service will allow for storing files in Public Cloud
  • New Managed MongoDB: Designed with MongoDB, the new managed offer comes with a free tier so developers can now effortlessly start, test and explore MongoDB in a trusted cloud environment before scaling their projects on a production tier, each with predictive pricing and excellent performance/price ratio.
  • Network novelties: New layer 3 network services combining floating IP, load balancing and gateways as well as new vRack Endpoint to address use cases around Netapp,
  • Security Dashboard: The OVHcloud Manager will soon benefit from a dashboard view representing key security events intercepted by the Group top-of-the-line Anti-DDoS mitigation algorithms so that clients have a better understanding of their exposure to online threats,
  • Key Management Service: managed service to administer encryption keys in order to protect customers data from within OVHcloud services and applications. Allowing both generation and lifecycle of encryption keys, OVHcloud KMS is now available as an Alpha version on OVHcloud Labs,
  • Improved Public Cloud customer experience: Public Cloud customers will soon experience various quality of life improvements in their overall journey
  • Rancher for heavily containerized workloads: Facilitating hybrid and multi-cloud scenarios, the Group will soon launch its Managed Rancher service providing easy to use solutions to effortlessly manage Kubernetes clusters through Rancher single pane of glass

A recording of the main keynote is here:

Credo intros 800G DSP for Linear Receive Optics

Credo announced sampling of its Dove 850 800G Digital Signal Processor (DSP) IC, optimized for Linear Receive Optics (LRO), also known within the industry as Half-retimed Linear Optics (HALO). 

A Dove 850 based optical transceiver aims to address the inherent weakness of a Linear Pluggable Optics (LPO) implementation by facilitating IEEE compliant optical transmit signaling and easing the deployment burden on system operators by eliminating manual, per port tuning. The result is lower bit error rates, enhanced sensitivity, reduced performance variation, and improved resilience to different switch ASICs, PCB traces, optical components, and environmental conditions.

In an LRO transceiver or Active Optical Cable (AOC), only the transmit path from the electrical input to the optical line side output includes a DSP for signal retiming and equalization. The Dove 850 is a unidirectional 8 x 112 Gbps DSP purpose built for this LRO architecture.

Credo says transceiver vendors can further optimize the module cost with Dove 850 by employing a variety of optics, including VCSELs, silicon photonics, EML or thin-film lithium niobate as dictated by the application requirements.

“Dove 850 reduces DSP power by up to 50% and optimizes cost while providing customers with an easy to use, robust, and interoperable solution,” said Chris Collins, Vice President of Sales and Optical Product Marketing at Credo. “Our lead transceiver and hyperscale customers recognize the value of this solution and we have already shipped Dove 850 samples and evaluation boards to address the market need.”

The Dove 850 features independent PLL’s for each lane to support breakout applications, an OIF CEI-112G-MR compliant host interface, and numerous integrated diagnostic features to accelerate time to market and aid with system debug.

Dove 850 Features and Technical Benefits

  • IEEE 802.3 and CMIS 5.x compliant.
  • 8 x 112 Gb/s PAM4 on both the electrical host receiver and optical line transmitter interfaces.
  • Copper optimized DSP based electrical host side receivers deliver industry leading sensitivity and BER performance.
  • Line side transmitters with multi-tap FIR filters, and non-linear correction facilitate the use of multi-mode or single-mode optics.
  • Independent phase locked loops per channel supports flexible breakout configurations including 2x400G, 4x200G and 8x100G.
  • A full suite of link diagnostic features simplifies lab bring up and production testing.
  • Low-power dissipation reduces cooling requirements and provides for an energy efficient 800G optical solution.

Ciena expands U.S. manufacturing with Flex


Ciena is adding domestic manufacturing through an expanded agreement with global diversified manufacturer Flex.

Under the terms of the agreement, Flex will provide advanced manufacturing capabilities, including specialized optical transceiver assembly, and supply chain services, enabling Ciena to quickly ramp high-volume production of its innovative pluggable OLTs and ONUs at scale. This U.S. expansion builds on a 20-year global relationship. As a result of its partnership with Flex, Ciena is positioned to enable U.S. network providers with greater ability to leverage the BEAD program to expand their local footprint and business opportunities.

Ciena expects to begin production of the industry’s first pluggable optical line terminals (OLTs) as well as its optical network units (ONU) at a Flex factory in the U.S. in mid-2024.

The companies said this expansion will support the U.S. government’s Broadband Equity Adoption and Deployment (BEAD) projects, create new jobs and help broadband service providers comply with the Build America, Buy America (BABA) requirements.


  • Ciena's pluggable OLT technology  will be manufactured in America. A key enabling technology in next generation broadband deployments, Ciena’s pluggable OLTs are part of a comprehensive broadband portfolio that includes access infrastructure, middle mile networks, and essential software and services.
  • Adding to its existing portfolio of innovations that reduce the environmental impact of communication networks, Ciena’s pluggable OLTs greatly increase network sustainability and efficiency by connecting more homes at higher speeds per unit of power and space than competing solutions. Additionally, Ciena’s host routing platforms are already 25G ready, future-proofing service provider network investment without the need for hardware replacement, further maximizing the solutions’ sustainable footprint.
  • Ciena will also develop its next-generation 25GS-PON pluggable OLTs and ONUs in the U.S., providing a seamless evolution path for service providers to build open, modular, and scalable broadband networks.

Nutanix posts revenue of $287 million, up 24% yoy

Nutanix reported revenue of $287.2 million for its first quarter ended October 31, 2023, up 24% yoy.

“We delivered a solid first quarter financial performance against an uncertain macro backdrop reflecting the value our customers see in the Nutanix Cloud Platform and the strength of our subscription business model,” said Rajiv Ramaswami, President and CEO of Nutanix. “I’m excited about our future as we look to capitalize on our large and growing market opportunity, favorable industry competitive dynamics, and our ramping partnerships.”

“Our first quarter marked a good start to our fiscal year with 24% year-over-year ACV billings growth along with strong free cash flow generation,” said Rukmini Sivaraman, CFO of Nutanix. “We continue to see good execution and remain focused on driving towards the targets we shared at our recent Investor Day and delivering durable growth and increasing profitability.”

Vodafone Business launches AI-driven SD-LAN with Juniper

Vodafone Business has launched a new SD-LAN (Software Defined Local Area Networking) managed service built on Juniper Networks' cloud-based wired and wireless assurance services, driven by Mist AI.

Vodafone Business is offering customers fully managed and co-managed SD-LAN services with flexible subscription models, including the opportunity to own their own on-premises equipment. It is based on Juniper’s wide array of wireless Access Points and EX switches, managed via cloud-driven wired and wireless access assurance services and the industry’s only AI-driven virtual network assistant (VNA). With advanced AIOps (AI for IT Operations) capabilities, Vodafone Business can offer a superior SD-LAN solution with simple zero touch provisioning for quick onboarding, proactive problem detection and resolution for maximum resiliency, and customizable wired and wireless service levels for assured user experiences.

The SD-LAN service delivers predictable, reliable and measurable wired/wireless services that can leverage proactive automated operations to eliminate an estimated 90 percent of manually generated trouble tickets, based on results from other Juniper Mist customers.

Andy Kivell, Head of Connectivity Portfolio, Vodafone Business, states: "With the advent of boundless working, it’s imperative to hyper-connect your business with productive and limitless workplaces, utilizing the latest technologies that inspire collaboration and empower staff to work safely and productively. Vodafone Business SD-LAN managed service powered by Juniper Mist is optimizing operations, performance and user experience through centralized cloud control, anonymized deep insights and AI analytics. From risk-free migrations to E2E In life support, with each step we are ensuring our customers a worry-free transition. As a core part of the proposition, sustainability options are embedded across the product lifecycle to support customers’ sustainability goals.”

Sally Bament, VP, Field & Industry Marketing, Juniper Networks, states: “Being able to compete in a digital world is fundamentally important to enterprises in any sector, any region. But for some, specifying, owning and managing an intelligent, fit-for-purpose network platform is prohibitively complex and costly. A managed service built on Juniper’s technology and delivered by Vodafone’s expertise solves that challenge very elegantly. This approach enables more enterprises to build their business and scale up on a sustainable, AI-driven experience-first network, without the operational overhead.”

KT picks HPE Aruba Networking SD-WAN via AWS

Korea Telecom (KT) has selected the HPE Aruba Networking EdgeConnect SD-WAN platform to provide edge-to-cloud integration with AWS Cloud WAN, allowing KT to offer its customers an alternative to using an MPLS network for global branch office connectivity.

HPE is also announcing a new partnership with KT, which will allow KT to provide its customers with a globally-managed SD-WAN service, enabled by HPE Aruba Networking, that acts as a cloud on-ramp, simplifying edge-to-cloud connectivity using the AWS global backbone network.

“A modernized network is the backbone for powering next-generation digital experiences and enabling new business models by securing enterprise applications and maximizing performance from any location or device,” said Phil Mottram, executive vice president and general manager, HPE Aruba Networking. “With this newly formed partnership, KT can leverage the HPE Aruba Networking EdgeConnect SD-WAN platform to expand its services to customers and locations in other regions outside of South Korea and APJ, providing best-in-class performance optimization, cloud onramp and operational capabilities for campus, branch, WAN, and remote workers.”

“Having insights into network performance and end-user experience becomes a powerful tool for enterprises that are managing globally distributed SD-WAN deployments,” said Sang-Ki Lee, executive vice president, KT Global Telecom DX Business Department. “Our partnership with HPE will allow our customers to adapt to changing business needs by delivering maximum network and application performance from the edge to the cloud.”

DigitalBridge raises $1.1 Billion for Digital Infrastructure

DigitalBridge Group  announced the close of its digital infrastructure credit fund, DigitalBridge Credit (Onshore),together with its parallel vehicles, which raised aggregate commitments of $1.1 billion inclusive of related co-investment commitments alongside the Fund.

DBC is the inaugural fund in DigitalBridge’s credit strategy, which focuses on delivering investment solutions to support the growth of companies across the digital infrastructure sector. The Fund has a global investor base consisting of pension funds, insurance companies, sovereign wealth funds, asset managers, family offices and private wealth platforms, among others. 

The DigitalBridge Credit team has made 11 investments to date, across Data Centers, Fiber, Satellite Broadband and Cloud Infrastructure. 

“This closing is an important milestone for the firm’s credit platform and reflects great partnership with investors and clients,” said Dean Criares, Head of Credit at DigitalBridge. “Establishing DigitalBridge’s brand within the expanding private credit sector reflects support from senior management and the strength of our relationships and partnerships with industry experts as we source and diligence opportunities.”

Mr. Criares continued, “This is an important time to be investing in this industry and sector. We believe the addressable market in digital infrastructure is large and expanding, leaving opportunities to deliver quality assets to our investors at a predictable pace.”

  • The DigitalBridge team manages $75 billion of infrastructure assets on behalf of its limited partners and shareholders.

Marvell Joins Ultra Ethernet Consortium

Marvell Technology has joined the Ultra Ethernet Consortium (UEC), part of the Linux Foundation's Joint Development Foundation.

"The future of the AI cloud will rely on standards-based Ethernet to deliver the scale and performance required for next generation workloads across the wide range of operator applications," said Nick Kucharewski, senior vice president and GM, Network Switching Business Unit, at Marvell. "Marvell is committed to continuous innovation on an open, Ethernet-based cloud fabric, and we look forward to working with the UEC members to make this a reality."

The Marvell accelerated computing portfolio includes optical PAM4 DSPs, TIAs and drivers for mid- to long-reach optical connections inside data centers, active electrical cable (AEC) PAM4 DSPs for short-reach connections within compute racks, COLORZ data center interconnect (DCI) pluggable modules for long distance connections between data centers, and Teralynx® Ethernet switches for low-latency fabrics between compute nodes. Marvell is also collaborating directly with cloud providers to deliver cloud-optimized, custom compute solutions that address their unique infrastructure and services most efficiently.

Tuesday, November 28, 2023

Infrastructure notes from AWS re:Invent 2023

At AWS re:Invent 2023 in Las Vegas, Adam Selipsky, CEO of Amazon Web Services, presented a 2.5 hour keynote where he shared the latest announcements and cloud strategies, with a heavy emphasis on AI.

Here are infrastructure highlights:

Introducing Amazon S3 Express One Zone - 17 years since launching its S3 Cloud Storage, AWS is introducing Amazon S3 Express One Zone for the highest performance and lowest latency storage. Amazon S3 Express One Zone is the lowest latency cloud object storage available, with data access speed up to 10 times faster and request costs up to 50% lower than Amazon S3 Standard, from any AWS Availability Zone within an AWS Region.

Introducing AWS Graviton4 processor - In 2018, AWS introduced its Graviton processor. This was followed in 2020 Graviton 2 and then Graviton3. There are already 150 EC2 instance types that use this processor, offering price/performance benefits. For example, SAP is using Graviton for its HANA service.

The new Graviton4 CPU is 30% faster , 50% more cores and 75% more memory bandwidth than current generation Graviton3 processor. Graviton4 also raises the bar on security by fully encrypting all high-speed physical hardware interface

AWS is now previewing R8g Instances based on Graviton4, enabling customers to improve the execution of their high-performance databases, in-memory caches, and big data analytics workloads. R8g instances offer larger instance sizes with up to 3x more vCPUs and 3x more memory than current generation R7g instances. 

Introducing Trainium2 - the new processor is designed to deliver up to 4x faster training than first generation Triennium chips and will be able to be deployed in EC2 UltraClusters of up to 100,000 chips.

An Expanded partnership with NVIDIA: AWS will offer first cloud AI supercomputer with NVIDIA Grace Hopper Superchip and AWS UltraCluster scalability based on multi-node NVLink technology.

NVLink can connect 32 Grace Hoppers via a new NVLINK switch. Each GH200 Superchip combines an Arm-based Grace CPU with a Hopper architecture GPU on the same module. 

A single Amazon EC2 instance with GH200 NVL32 can provide up to 20 TB of shared memory to power terabyte-scale workloads. These instances will take advantage of AWS’s third-generation EFA interconnect, providing up to 400 Gbps per Superchip of low-latency, high-bandwidth networking throughput, enabling customers to scale to thousands of GH200 Superchips in EC2 UltraClusters.

Liquid Cooling: AWS instances with GH200 NVL32 will be the first AI infrastructure on AWS to feature liquid cooling 

NVIDIA GH200-powered EC2 instances will feature 4.5 TB of HBM3e memory—a 7.2x increase compared to current generation H100-powered EC2 P5d instances—allowing customers to run larger models, while improving training performance. Additionally, CPU-to-GPU memory interconnect provides up to 7x higher bandwidth than PCIe, enabling chip-to-chip communications that extend the total memory available for applications.

NVIDIA DGX Cloud comes to AWS powered by GH200 NVL32 NVLink infrastructure. DGX Cloud is NVIDIA’s AI factory supporting many use cases, such as weather simulation, digital biology, etc.  

NVIDIA Project Ceiba - which refers to the most magnificent tree in the Amazon, will connect 16,384 GPUs into one giant supercomputer. NVIDIA estimates this will cut training time of largest LLMs in half the time. This will be 65 Exaflops — like 65 supercomputers in one system for training models.

AWS will introduce three additional Amazon EC2 instances: P5e instances, powered by NVIDIA H200 Tensor Core GPUs, for large-scale and cutting-edge generative AI and HPC workloads; and G6 and G6e instances, powered by NVIDIA L4 GPUs and NVIDIA L40S GPUs, respectively, for a wide set of applications such as AI fine tuning, inference, graphics, and video workloads.

Flexible Ultracluster usage - AWS is targeting fluctuating demand for cluster capacity. Amazon EC2 Capacity Blocks for ML lets customers reserve up to 100s of GPUs in a single cluster. This will push the envelop on price performance for ML workload.

AWS Sagemaker is being used by tens of thousands of customers, including support for Hugging Face

AWS Bedrock introduced a number of features including the ability to apply guardrails to all large language models (LLMs) , including fine-tuned models, and Agents for Amazon Bedrock.  Guardrails can be used to define denied topics and content filters to remove undesirable and harmful content from interactions between users and your applications.

Update on Project Kuiper satellite broadband - Amazon is making a big bet by building its own LEO constellation. The first 2 prototype satellites were launched in October  AWS plans to offer an enterprise service, along with a global consumer broadband service. AWS expects that developers will be able to begin testing in 2nd half of 2024.

Amazon's Project Kuiper signs NTT/SKY Perfect JSAT

NTT DOCOMO, NTT Communications, and SKY Perfect JSAT announced a strategic collaboration with Amazon's Project Kuiper. The companies expect to use Project Kuiper LEO satellite connectivity services to enhance communications availability and resiliency for Japanese customers.

Specifically, NTT and SKY Perfect JSAT plan to distribute Project Kuiper connectivity services to enterprises and government organizations in Japan, while NTT Group companies become customers of Project Kuiper. The companies plan to use Project Kuiper to provide their customers with new connectivity options to build out resilient, redundant communications networks.

Although Japan is well served by terrestrial communications technology like fiber and wireless, the country's mountainous terrain and many islands makes it challenging to restore connectivity in the event of natural disasters and other emergencies. 

“Improving connectivity infrastructure will become even more important in the future to help solve various issues facing society and to establish sustainable economic and social activities,” said Katsuhiko Kawazoe, senior executive vice president of NTT.

Verizon demos 5G network slicing for Axon public safety

Verizon and Axon Enterprise demonstrated the ability to transmit video from public safety devices over a network slice in a completely commercial 5G environment.

The trial carried  Axon Fleet 3 and Axon Respond services over Verizon’s live 5G network in Phoenix, Arizona. The Axon Fleet 3 in-car video system provides live maps and live streaming from mobile cameras along with real-time situational awareness through Axon Respond to help enhance situational awareness for law enforcement members not on the scene.

The test results were measured in four categories.

  1. The time to first frame, which is the time between when a remote law enforcement officer requests a stream and when that officer can remotely access the live stream.
  2. Start percent, or the percent of time the stream started before timing out and causing the law enforcement officer not on the scene to potentially abandon remotely accessing video and call into law enforcement personnel on the scene instead.
  3. Latency, or the responsiveness of the application across the network.
  4. Jitter, which is the sequence and timing of the audio and video packages being sent across the network.

The results showed the application, while running over a Verizon network slice, had sustained performance levels. Compared to Verizon’s commercial 5G Ultra Wideband network, services on the network slice showed: 

  • 53% improvement in 95th percentile of time to first frame
  • 5% improvement in start percent
  • 68% improvement in latency
  • 83% improvement in jitter

“This most recent network slicing demonstration shows one of many use cases where network slicing can be a game-changer for our enterprise, public sector, and Verizon Frontline customers,” said Adam Koeppe, SVP of Network and Technology Planning for Verizon. “We have undergone a massive transformation of our network over the past few years, including building on a cloud-native architecture, virtualizing from the core to the edge, building an advanced 5G standalone core, driving capacity in our fiber core, adding robust and varied spectrum assets, and infusing intelligence throughout the network. These changes allow us to develop and test this new technology that effectively matches the required network resources with the performance characteristics needed for an app or use case to work effectively.”

Bouygues Telecom upgrades IP core with Nokia 7750

Bouygues Telecom is upgrading its IP core with Nokia’s FP5-based IP routers.

Nokia’s solution includes its 7750 Service Router (SR) platform, which is powered by its FP5 routing silicon, provides a future-ready 800GE capability.

Nokia will also evolve Bouygues Telecom’s existing Nokia security gateway services by deploying its FP5 powered, SR-1 routers and the 7750 Extended Services Appliance (ESA) to meet the increased capacity and scalability demands of mobile broadband services.

Frédéric Bénéteau, Vice President, West and Central Europe Market Unit at Nokia, said: “We are delighted to extend our relationship with Bouygues Telecom to support its strategic priorities. Nokia’s IP routing solutions offer best-in-class scalability, efficiency and security, enabling Bouygues Telecom to confidently manage their growth initiatives as they continue delivering the exceptional experience their customers count on both now and in the future.”

U.N. and Orange foster recycled telecom equipment market in Egypt

The United Nations Industrial Development Organization (UNIDO) and Orange are developing a secondary market of mobile devices and networks/IT equipment in Egypt. 

This pilot is part of the global Switch to Circular Economy Value Chains project (SWITCH2CE), co-funded by the European Union and the Government of Finland.

This project will focus on several key objectives to realize the circular potential of Egypt's ICT (Information and Communication Technology) and electronics value chain.

  • Supporting the adoption of circular economy practices and policies: The initiative aims to accelerate the development of circular economy practices and policies in Egypt by engaging citizens and advocating for behavioral change towards recycling and circularity. 
  • Developing a local infrastructure: network equipment and mobile devices refurbishment centers will be established to serve the local market, with ambitions to become an Africa & Middle East hub.
  • Capacity Development: Local technicians will be recruited and trained, vocational certifying training programs will be introduced, and new practices that promote circular transitions in the electronics sector will be implemented.  The pilot aims to open new potential for reuse of products, extend their longevity and reduce the generated e-waste. Refurbished and recertified network equipment and devices will re-enter the local market, the residual e-waste will be collected and recycled by pilot’s partners.

Astera Labs adds to executive team

Astera Labs, a start-up focused on semiconductor-based connectivity solutions for cloud and AI infrastructure, announced new senior leadership appointments: 

  • Elli Castro-Bordano will oversee legal operations, focusing on commercial transactions and compliance, leveraging her extensive experience in the semiconductor industry, including roles at Marvell, Inphi, and Broadcom, and her background in the electric vehicle charging and defense industries.
  • Chris Petersen as Fellow, Technology and Ecosystems to drive the company's technology and product roadmap, as well as collaboration with hyperscaler customers and ecosystem partners. He brings over 20 years of experience as a data center and server design architect, including at Meta. He also serves as a  board member in CXL Consortium, JEDEC, and NVM Express, Inc.
  • Kelvin Khoo as Senior Vice President, Corporate Development. Khoo’s experience includes growing Broadcom and NetLogic Microsystems and scaling several technology startups with successful liquidity events.

Astera Labs raises $150M for its CXL platform

Astera Labs, a start-up based in Santa Clara, California, raised $150 million in Series-D funding with a $3.15B valuation for its data and memory connectivity solutions based on Compute Express Link (CXL), PCIe, and Ethernet technologies. Fidelity led the funding round and was joined by other existing investors, including Atreides Management, Intel Capital, and Sutter Hill Ventures.“Astera Labs continues to surpass every milestone for a technology...

Monday, November 27, 2023

Networking notes from AWS re:Invent 2023

In an afternoon keynote at AWS:reInvent 2023 in Las Vegas, Dave Brown, VP of Amazon EC2 Networking and Compute Services, presented the latest innovations in AWS core networking infrastructure, VPC networking, data center networking for AI/ML, security, and global connectivity.

Some highlights:

  • AWS now has 35 regions in operation, with four new regions expected to come online soon: New Zealand, Canada, Thailand, and Malaysia.

  • There are now 35 AWS Local Zones in operation and 19 more will be coming online soon.  First launched in Los Angeles three years ago, the initial use case was cloud-based video production for the media industry.

  • There are now 130 AWS Direct Connect locations, all supporting 100 Gbps fiber interconnects

  • There are now 600 PoPs for Amazon CloudFront, its content delivery network service

  • AWS Nitro has been fundamental to EC2 and network bandwidth continues to rise at a rapid clip.  The lates P5 instances using NVIDIA H100 can access up to 3200 Gbps. The AI/ML workloads will continue to scale up.  Anthropic Claude already uses 10,000 GPUs.

  • New network topologies for connecting all these GPUs are needed. AWS calls thse “Ultra Clusters” and is moving beyond CLOS architecture.

  • AWS is introducing an Instance Topology API to help customers understand how many hops are between their instances across an Ultracluster. The API provides info on where your instance are located.

  • AWS has developed its own routing solution based on its own Scalable Reliable Datagram protocol.  This has been running internally for several years, and on certain high-end customer instances. AWS is announcing that SRD is now available on all Nitro instances. Among its capabilities, flow limits expand from 5 Gbps to 25 Gbps

  • The AWS Cloud WAN service continues to grow while adding features. The service allows enterprises to create network segments. Globla network WANs can be automated and managed from a single portal.  The latest capability is AWS Cloud WAN Tunnel-less Connect.

Salesforce significantly expands its use of AWS

Under an expanded strategic partnership, Salesforce will significantly expand its use of AWS across its full portfolio and is taking an AWS-native approach to its most strategic and fastest growing innovation, the Salesforce Data Cloud. 

The agrement will lead to deepening product integrations across data and artificial intelligence, and for the first time offering select Salesforce products on the AWS Marketplace. 

  • Salesforce will expand its use of AWS, including compute, storage, data, and AI technologies. 
  • AWS will  expand its use of Salesforce products such as Salesforce Data Cloud.

“Today’s announcement is an incredible milestone in the evolution of our longstanding partnership with AWS,” said Marc Benioff, chair and CEO, Salesforce. “We’re bringing together the #No. 1 AI CRM provider and the leading cloud provider to deliver a trusted, open, integrated data and AI platform, and ensuring we meet massive customer demand for our products on the AWS Marketplace. With these enhancements to our partnership, we’re enabling all of our customers to be more innovative, productive and successful in this new AI era.”

“Salesforce and AWS make it easy for developers to securely access and leverage data and generative AI technologies to drive rapid transformation for their organizations and industries,” said Adam Selipsky, CEO, AWS. “With this expanded partnership, our joint customers gain powerful new ways to innovate, collaborate, and build more customer-focused applications using the broadest and deepest set of cloud services.”

Australia’s nbn hits new traffic peak - 26.76 Tbps

Australia’s nbn set a new peak traffic record on 3 November, when gamers smashed the old record by downloading a Fortnite update and new Call of Duty game. This is the equivalent of more than half a million simultaneous Fortnite downloads at 50 Mbps, or more than 1.1 million simultaneous 4K video streams.

The new record beat the previous high of 24.98 Tbps set in June and was almost 19 per cent higher than the average traffic peak on the nbn network in October of 22.5 Tbps – the equivalent of more than 900,000 simultaneous 4K video streams.

Dr Robert Joyce, Head of Customer Strategy and Innovation at nbn, said: “Around 8.6 million homes and businesses are now connected to our network, and we carry over 80 per cent of Australia’s download traffic. We monitor the network 24/7 for customer trends and to stay ahead of demand. 

“Our 2023 Top Network Insights show our customers are using more data than ever. New network usage records were set and broken three times in the last 12 months. 

“We’ve built a network that’s kept ahead of data demand and will continue to support Australians as their need for speed and increased data volumes continues to grow. 

“With data usage more than tripling in the past seven years, and with average households now having around 21 connected devices, it’s a timely reminder to check your home broadband plan is still meeting what you want from your broadband service.”

UK outlines five Quantum Missions

 As part of its National Quantum Strategy outlined earlier this year, which called for an investment of £2.5 billion (US$3.15 billion) in quantum over the next ten years , the UK Government published five key missions that provide more specific goals:

  • Mission 1
    By 2035, there will be accessible, UK-based quantum computers capable of running 1 trillion (error-free logical) operations and supporting applications that provide benefits well in excess of classical supercomputers across key sectors of the economy.
  • Mission 2
    By 2035, the UK will have deployed the world’s most advanced quantum network at scale, pioneering the future quantum internet.
  • Mission 3
    By 2030, every NHS Trust will benefit from quantum sensing-enabled solutions, helping those with chronic illness live healthier, longer lives through early diagnosis and treatment.
  • Mission 4
    By 2030, quantum navigation systems, including clocks, will be deployed on aircraft, providing next-generation accuracy for resilience that is independent of satellite signals.
  • Mission 5
    By 2030, mobile, networked quantum sensors will have unlocked new situational awareness capabilities, exploited across critical infrastructure in the transport, telecoms, energy, and defence sectors.