AMD MI300X performance compared with Nvidia H100 — low-level benchmarks testing cache, latency, inference, and more show strong results for single GPUs

AMD’s MI300X was tested by Chips and Cheese, looking at many low-level performance metrics and comparing the chip with rival Nvidia H100 in compute throughput and cache intensive benchmarks. Scaleout performance unfortunately wasn’t tested, which is far more important for data center hardware, and there are plenty of other questions raised. 

AMD’s MI300X was tested by Chips and Cheese, looking at many low-level performance metrics and comparing the chip with rival Nvidia H100 in compute throughput and cache intensive benchmarks. Scaleout performance unfortunately wasn’t tested, which is far more important for data center hardware, and there are plenty of other questions raised.