AMD has made a significant leap into the future of AI and high-performance computing with the launch of its Instinct MI350 series GPUs. This cutting-edge lineup includes the MI350X and the even more powerful MI355X, highlighting AMD’s commitment to pushing the boundaries of technology.
The Instinct MI350 GPUs are built on AMD’s innovative CDNA 3 architecture using TSMC’s 3nm process node. This advanced design features a staggering 185 billion transistors. The series offers multiple configurations, including both air-cooled and liquid-cooled options, catering to various performance needs.
At the heart of these GPUs is a massive AI computing power, boasting 20 PFLOPs of FP4/FP6 performance, which translates to a fourfold increase compared to previous generations. This power is complemented by HBM3e memory, offering blazing-fast data transfer speeds and a robust capacity of up to 288 GB.
The MI355X stands out with 8 TB/s of memory bandwidth and a comprehensive suite of computational capabilities, including 79 TFLOPs of FP64 and up to 20 PFLOPs of FP6/FP4 compute in its top-tier 1400W setup. Despite sharing the same die, the MI355X distinguishes itself with a higher thermal design power (TDP), marking it as a powerhouse for demanding tasks.
When comparing to competitors, the MI355X showcases substantial advantages: it surpasses NVIDIA’s B200 series in memory and FP6 performance metrics, offering significant improvements across the board.
In practical terms, the MI355X demonstrates a remarkable 35x improvement in inference performance over its predecessor, the MI300 series, in specific AI tasks like Llama 3.1.
AMD’s Instinct platform allows for scalability, with configurations supporting multiple GPUs to achieve extraordinary performance levels. A liquid-cooled rack can house up to 128 GPUs, reaching an impressive 2.6 Exaflops of FP4 compute capacity. This solution is further enhanced by AMD’s Turin EPYC CPUs, featuring Zen 5 core architecture, for seamless integration and performance.
The company has also teased future advancements with the MI400 series, set to debut in 2026, offering a glimpse into ongoing innovation in AI acceleration.
Overall, the Instinct MI350 series sets a new standard in AI and high-performance computing, promising a transformative impact on industries reliant on advanced computational capabilities. With the official rollout planned through 2025, AMD continues to establish itself as a leader in next-gen GPU technology.
