Ask HN: Are Nvidia H100s that good?
I tried a vLLM and Resnet training workload. The H100 outperforms the A100 about 45% to 80% consistently, but it isn’t that much faster…
What workloads would see the most speedup, because I’m really not seeing 3x+ any on vLLM or simple training workloads?
by zer00eyz on 5/5/2024, 5:26:49 PM
You're doing inference, not training.
https://lambdalabs.com/gpu-benchmarks
by jonathanlei on 5/5/2024, 5:24:25 PM
Oops, just noticed the link isn’t clickable, here you go! https://tensordock.com/benchmarks
I tried a vLLM and Resnet training workload. The H100 outperforms the A100 about 45% to 80% consistently, but it isn’t that much faster…
What workloads would see the most speedup, because I’m really not seeing 3x+ any on vLLM or simple training workloads?