Microsoft Azure has taken a significant leap forward in the realm of artificial intelligence by integrating the NVIDIA Blackwell “GB200 NVL72” system to support OpenAI. This development represents a pivotal advancement in AI training and development. With more than 500 of these powerful Blackwell chips spread across eight racks, Microsoft’s Azure OpenAI Service is poised to deliver unmatched performance.
The collaboration between Microsoft and NVIDIA promises to enhance AI models significantly, allowing them to undergo rigorous training with greater efficiency. This partnership elevates Microsoft Azure as a leading contender among cloud services providers, especially for AI workloads.
The NVIDIA Blackwell GB200 NVL72 brings together impressive hardware: 36 Grace CPUs and 72 Blackwell GPUs packed into a highly efficient rack-scale design. Collectively, the eight racks house a staggering 288 Grace CPUs and 576 B200 GPUs, achieving unparalleled computational output. A single rack alone can deliver up to 6,480 TFLOPS of FP32 performance and up to 3,240 TFLOPS of FP64 performance. Multiply this by eight, and Azure reaches near astronomical computing capabilities with up to 51,840 TFLOPS of FP32 and 25,920 TFLOPS of FP64 performance.
This exceptional processing power is a major asset for enterprises striving to scale and enhance their business operations. The NVIDIA “Blackwell” GB200 NVL72 is optimally designed for handling large-scale generative AI workloads, featuring an impressive memory bandwidth of 576 TB/s and extensive parallel processing capabilities.
OpenAI has previously utilized a variety of NVIDIA GPUs, such as the V100s, H100s, and A100s. However, the new Blackwell B200 GPUs offer revolutionary advancements, significantly surpassing their predecessors in performance. With Microsoft having invested a substantial $14 billion into OpenAI, it comes as no surprise that they are eager to leverage the most advanced technology available for their clients.
This groundbreaking integration of the NVIDIA Blackwell GB200 NVL72 system positions Microsoft Azure at the forefront of cloud AI services, ready to deliver innovative solutions and performance that can redefine artificial intelligence applications across industries.
