Supermicro NVIDIA Blackwell Systems Demonstrate Linear Scalability for MLPerf Training v6.0

In the latest MLPerf Training V6.0 benchmarking effort, Supermicro demonstrated linear scaling in training performance for 3 different models, scaling from 8 GPU to 72 B300 GPUs. Additional runs on HGX B200 systems were run, which showed that B300 performs better than B200 in Training performance.

The following systems with NVIDIA Blackwell GPUs were used in the benchmarking effort.

In the LLAMA 3.1 8b benchmark, 2 systems of HGX-B300 showed even better performance than the linear scaling for HGX-B300 to NVL72, due to the optimal use of networking for this small model. In the bigger LLAMA 3.1 70b model LORA, the 2 systems of HGX-B300 follow the linear scaling of the HGX-B300 to NVL72.

Overall, Supermicro demonstrates the linear scaling capability of the NVIDIA Blackwell GPU architecture that uses NVLINK with performance that scales linearly from 8 GPU B300 (HGX-B300) to 72 GPU B300 (NVL72).