Samsung has unveiled the industry’s first 12-stack HBM3E DRAM chip, an impressive feat in the semiconductor memory chip market. This high-capacity HBM memory chip boasts 50% greater capacity and performance than the previous generations.
Samsung’s 36GB HBM3E DRAM Chip: A New Benchmark in Memory Technology
The latest from Samsung is a HBM3E 12H chip that offers a substantial bandwidth of up to 1,280GB/s and a sizable capacity of 36GB, numbers that eclipse its 8-stack HBM3 predecessors. The company has implemented an advanced Thermal Compression Non-Conductive Film (TC NCF) in the manufacturing process. This innovation ensures that these 12-layer chips maintain the same height as traditional 8-layer HBM chips, thereby enhancing compatibility and granting more flexibility for system builders. Moreover, this advancement addresses chip die wrapping issues often associated with thinner die constructions.
Samsung emphasizes that their HBM3E chips have achieved the industry’s smallest inter-chip gap of 7µm. This design consideration effectively eliminates void spaces between chip layers, boosting vertical density by a significant 20% compared to the 8-layer HBM3 chips.
In terms of thermal management—a critical aspect of chip design—Samsung’s TC NCF technology utilizes varying sizes of bumps between the chips. This approach means smaller bumps are placed in signaling regions, with larger ones situated where heat dissipation is paramount. This precision in design not only enhances thermal performance but also raises the product’s overall yield.
Enhancing AI Capabilities with HBM3E Technology
With their latest offering, Samsung promises that enterprises will see increased performance and capacity, alongside a reduction in the total cost of ownership for data centers utilizing these chips. In particular, AI applications stand to benefit significantly, with AI training speeds projected to be 34% faster and the potential for an 11.5-fold increase in the simultaneous use of services.
Samsung has already initiated the distribution of HBM3E 12H chip samples to select customers, with plans for mass production set to commence within the first half of the year.
Highlighting the strategic importance of this development, Yongcheol Bae, Executive Vice President of Memory Product Planning at Samsung Electronics, remarked on the commitment to meet the growing demands for higher-capacity HBM, particularly in the AI sector, and affirmed the company’s dedication to technological leadership in the realm of high-capacity HBM solutions.
Samsung’s recent advancements are expected to push the industry forward and offer new possibilities for the integration of high-performance memory in complex data-driven applications.
