Compare

Comparing Offline scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing Server scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing SingleStream scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing MultiStream scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Compare Results

System 1 Kuai-Kuai_702-reference-gpu-pytorch-v2.5.1-scc24-base_cu124 ba7f5c94d10f-nvidia-gpu-TensorRT-scc24-base Coffeepot-nvidia_original-gpu-tensorrt-vdefault-scc24-main aqua-reference-rocm-pytorch-v2.6.0.dev20241109-scc24-base aqua-reference-rocm-pytorch-v2.6.0.dev20241118-scc24-base aqua-reference-rocm-pytorch-v2.6.0.dev20241118-scc24-main mlperf_inference_lry_40-nvidia_original-gpu-tensorrt-vdefault-scc24-main atl1_1_02_010_5_1.pace.gatech.edu-reference-cpu-pytorch-v2.4.1-default_config f2ea47b0a016-nvidia_original-gpu-tensorrt-vdefault-scc24-main

System 2 Kuai-Kuai_702-reference-gpu-pytorch-v2.5.1-scc24-base_cu124 ba7f5c94d10f-nvidia-gpu-TensorRT-scc24-base Coffeepot-nvidia_original-gpu-tensorrt-vdefault-scc24-main aqua-reference-rocm-pytorch-v2.6.0.dev20241109-scc24-base aqua-reference-rocm-pytorch-v2.6.0.dev20241118-scc24-base aqua-reference-rocm-pytorch-v2.6.0.dev20241118-scc24-main mlperf_inference_lry_40-nvidia_original-gpu-tensorrt-vdefault-scc24-main atl1_1_02_010_5_1.pace.gatech.edu-reference-cpu-pytorch-v2.4.1-default_config f2ea47b0a016-nvidia_original-gpu-tensorrt-vdefault-scc24-main

Models All models stable-diffusion-xl bert-99

Compare SUTs