This post offers a closer look at the work done by NVIDIA to deliver these results. For more information, see In addition, in its fifth MLPerf Training, A100 continued to deliver excellent performance across the full suite of workloads, delivering up to 2.5x more performance compared to its first submission, as a result of extensive software optimizations.
Performance improvements of the latest H100 and A100 submissions compared to the first A100 submission on each MLPerf Training workload
