Microsoft Unveils NVIDIA's "Blackwell-Based" High-End Azure AI Compute Platform; HPC-Focused Azure AMD EPYC With HBM As Well 1

Microsoft Launches Cutting-Edge Azure AI Compute Platform with NVIDIA’s Blackwell Chips and HPC-Optimized AMD EPYC HBM Technology

Microsoft is making waves in the AI computing landscape with significant announcements at their recent “Ignite” event. The tech giant unveiled exciting integrations and enhancements for its Azure platform, focusing on cutting-edge technologies from NVIDIA and AMD.

Microsoft’s unveiling of NVIDIA’s Blackwell AI architecture marks a new chapter for Azure, featuring prominently in the Azure ND GB200 V6 VM series. This series is the first to leverage Blackwell technology, equipped with two GB200 Grace Blackwell Superchips, each housing two powerful Blackwell GPUs and a Grace CPU, all interconnected via NVLink. This setup allows an impressive expansion capability, accommodating up to 72 Blackwell GPUs per platform thanks to NVIDIA’s innovative InfiniBand fabric system.

In tandem with NVIDIA’s updates, Microsoft is incorporating AMD’s latest EPYC “Genoa” CPUs, targeting tasks with demanding memory bandwidth needs through their new Azure HBv5 virtual machines. These VMs boast substantial specifications:

– A peak memory bandwidth of 6.9 TB/s.
– Configurable options up to 9 GB of memory per core.
– Up to 352 AMD EPYC “Zen4” CPU cores operating at peak frequencies of 4GHz.
– Enhanced Infinity Fabric bandwidth, doubling past EPYC server capabilities.
– Single-tenant design, ensuring dedicated performance for each user.

Azure HBv5 VMs are fortified with AMD’s high-performance 4th Gen EPYC CPUs, demonstrating a noticeable performance boost over previous generations. They offer 14 TB of local NVMe SSD storage, enabling rapid read and write operations, and integrate seamless networking enhancements like Azure Accelerated Networking delivering up to 160 Gbps.

These advancements underscore Microsoft’s leadership in AI services, pushing Azure’s capabilities to new heights. By harnessing the power of NVIDIA’s and AMD’s cutting-edge technologies, Microsoft is positioning its AI portfolio as a formidable player in the market, ready to capture the full potential of AI-driven solutions.