NVIDIA RTX PRO 4500 Blackwell Server Edition Review: L40S Throughput at 165W

NVIDIA's single-slot, passively cooled RTX PRO 4500 Blackwell Server Edition packs 32GB of GDDR7 and MIG support at 165W. In vLLM tests it matched the L40S on FP8 and BF16 models at short context, but trailed 17-33% at 8K input due to its 32GB frame buffer.

• Ministral 3 14B FP8: 1,107 vs 995 tokens/s against L40S at 165W
• 2.8-3.6x the L4 at short context on 2.3x the board power
• Trails L40S by 17-33% at 8K input as KV cache hits 32GB limit
• RTX PRO 6000 at 450W delivers about 2x the 4500 at short context