AMD Ryzen AI Halo with 192GB runs 300B-parameter models for $7,299

AMD launched the Ryzen AI Halo Developer Platform with a Ryzen AI Max+ PRO 495 and 192GB of unified LPDDR5X-8533 memory for $7,299.99. It is the first compact workstation able to load 300-billion-parameter models, but benchmarks show it generating tokens about 30% slower than Nvidia's $4,699 DGX Spark on models that fit within 64GB.

• 192GB unified memory, up to 160GB allocatable as GPU VRAM
• A 300B-parameter model needs ~150GB for weights at 4-bit quantization
• Memory bandwidth is 273 GB/s, up from 256 GB/s on the 128GB model
• On models under 64GB, Halo is ~30% slower than DGX Spark at a higher price