Nvidia bypasses JEDEC with custom NVHBM memory standard

Nvidia has moved the HBM memory controller from the GPU die to the memory base die in its custom NVHBM standard, unveiled as part of the NVLink Fusion announcement. The company claims up to 30% more bandwidth, 15% lower HBM power use and 25% more free GPU die area versus standard HBM4E.

• NVHBM delivers up to 30% more memory bandwidth than HBM4E
• HBM power drops 15% and up to 25% of GPU die area is freed
• Samsung, SK hynix and Micron back the standard and will use TSMC's 3nm process
• Nvidia will buy 37% of global HBM supply in 2027, per Morgan Stanley