Cloudflare saves 100 TB of RAM again by cutting server hashes by 90%

Cloudflare optimized its URL-to-cache-server hash mapping, reducing server hashes per machine from 100,000 to 10,000 and saving roughly 100 TB of RAM. The new v2 algorithm ships as a separate code path so the team can revert if issues arise.

• Server hashes per machine cut from 100,000 to 10,000
• Optimization saved about 100 TB of RAM in total
• Rust data structures trimmed 2 bytes per hash-map entry
• New v2 algorithm kept as separate code path for rollback