Microsoft shows Maia 300 AI accelerator with 288GB HBM4 at OCP 2026

At OCP 2026 Microsoft displayed the Maia 300 accelerator with eight HBM4 stacks for 288GB of memory, 18TB/s of memory bandwidth and 3.2TB/s of scale-up bandwidth. A rack fits 96 chips and the scale-up domain about 12K; each 950W accelerator uses a liquid-cooled cold plate.

• 288GB HBM4 with 18TB/s memory bandwidth
• 3.2TB/s bidirectional scale-up bandwidth
• 96 accelerators per rack, ~12K in scale-up domain
• 950W TDP with liquid-cooled cold plate