Big clouds charge a median 3.2x the cheapest GPU rate across 18 cards

A comparison of on-demand prices for 18 GPUs found that the cheapest hyperscaler rate is a median 3.2x the market floor. The gap is widest on older cards like the V100 (35.6x) and narrowest on the newest GB300 (1.4x).

• H100 costs $5.38 per GPU-hour at Google Cloud vs $1.80 at Lium
• V100 at Google Cloud is 35.6x the market floor; GB300 at Oracle is 1.4x
• Median premium: AWS 4.3x, Oracle 4.0x, Google Cloud 5.4x, Azure 5.5x
• Egress of 1,000 GB costs $90 at AWS and $87 at Azure, often free at GPU clouds