Compare

Comparing Offline scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing Server scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing SingleStream scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Comparing MultiStream scenario for v4.1: 1xMI300X_2EPYC-937F and v4.1: 8xMI300X_2EPYC-937F

10 20 30 All

Model	v4.1: 1xMI300X_2EPYC-937F	v4.1: 8xMI300X_2EPYC-937F	Performance Delta

10 20 30 All

Download

Download

Download

---

Compare Results

System 1 13fce262fb79-reference-gpu-pytorch_v2.4.1-scc24-base 3b07702db56d-reference-gpu-pytorch_v2.4.1-scc24-base 41485dfb4f36-reference-gpu-pytorch_v2.4.1-scc24-base_cu124 48ed6105bd85-nvidia-gpu-TensorRT-scc24-base 48ed6105bd85-nvidia-gpu-TensorRT-scc24-main 48ed6105bd85-reference-gpu-pytorch_v2.1.0a0-scc24-base 97c3ec750d0e-nvidia-gpu-TensorRT-scc24-base a51568200dc1-reference-gpu-pytorch_v2.4.1-scc24-base_cu124 e8dbfdd7ca14-nvidia-gpu-TensorRT-scc24-base f9ac88850adc-reference-gpu-pytorch_v2.4.1-scc24-base gh_action-reference-gpu-pytorch_v2.4.1-cu124 gh_action-reference-gpu-pytorch_v2.4.1-default_config 4751fbf98487-reference-cpu-pytorch_v2.4.1-scc24-base 4751fbf98487-reference-gpu-pytorch_v2.4.1-scc24-base 4751fbf98487-reference-gpu-pytorch_v2.4.1-scc24-main 7b06989ff188-nvidia-gpu-TensorRT-scc24-base 7b06989ff188-nvidia-gpu-TensorRT-scc24-main roadrunner-nvidia-gpu-TensorRT-scc24-base

System 2 13fce262fb79-reference-gpu-pytorch_v2.4.1-scc24-base 3b07702db56d-reference-gpu-pytorch_v2.4.1-scc24-base 41485dfb4f36-reference-gpu-pytorch_v2.4.1-scc24-base_cu124 48ed6105bd85-nvidia-gpu-TensorRT-scc24-base 48ed6105bd85-nvidia-gpu-TensorRT-scc24-main 48ed6105bd85-reference-gpu-pytorch_v2.1.0a0-scc24-base 97c3ec750d0e-nvidia-gpu-TensorRT-scc24-base a51568200dc1-reference-gpu-pytorch_v2.4.1-scc24-base_cu124 e8dbfdd7ca14-nvidia-gpu-TensorRT-scc24-base f9ac88850adc-reference-gpu-pytorch_v2.4.1-scc24-base gh_action-reference-gpu-pytorch_v2.4.1-cu124 gh_action-reference-gpu-pytorch_v2.4.1-default_config 4751fbf98487-reference-cpu-pytorch_v2.4.1-scc24-base 4751fbf98487-reference-gpu-pytorch_v2.4.1-scc24-base 4751fbf98487-reference-gpu-pytorch_v2.4.1-scc24-main 7b06989ff188-nvidia-gpu-TensorRT-scc24-base 7b06989ff188-nvidia-gpu-TensorRT-scc24-main roadrunner-nvidia-gpu-TensorRT-scc24-base

Models All models stable-diffusion-xl gptj-99

Compare SUTs