Results

Datacenter Category: Available submissions in Closed division

ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
5.0-0001 QuantaGrid D74A-7U AMD AMD Instinct MI325X 256GB HBM3E x 8 30724.5 33928.1 30724.5 33928.1
5.0-0002 Quanta S7PA AMD AMD Instinct MI325X 256GB HBM3E x 8 16.2 17.1
5.0-0003 ASUSTeK ESC8000A-E13P (8x H200-NVL-141GB NVLink, TensorRT) ASUSTeK NVIDIA H200-NVL-141GB x 8 27417.3 27765.3 27417.3 27765.3 17953.9 18113.4 17953.9 18113.4 525118.0 326670.0 300029.0 325823.0
5.0-0004 ASUSTeK ESC8000A-E13P (8x H200-NVL-141GB, TensorRT) ASUSTeK NVIDIA H200-NVL-141GB x 8 14.8 16.0 11988.9 11263.8 540125.0 680738.0 49.5 49.5
5.0-0005 ASUSTeK ESC A8A-E12U (8x MI325x-256GB ) ASUSTeK AMD Instinct MI325X 256GB HBM3E x 8 30086.5 33366.5 30086.5 33366.5
5.0-0006 ASUSTeK ESC N8 (8x H200-SXM-141GB, TensorRT) ASUSTeK NVIDIA H200-SXM-141GB x 8 33037.2 34807.1 33037.2 34807.1 21533.9 21171.3 21533.9 21171.3
5.0-0007 SYS-821GE-TNRT (8x H100-SXM-80GB, TensorRT) Broadcom_Supermicro Virtualized NVIDIA H100-SXM-80GB x 8 19318.9 19936.5 19318.9 19936.5 12869.8 14313.3 51.4 51.4
5.0-0008 1-node-2S-GNR_86C Cisco 168.7 315.4 350.9 476.6 27988.0 31559.2 2.3
5.0-0009 Cisco UCS C245 M8 (2x H100NVL-PCIe-94GB) Cisco NVIDIA H100-NVL-94GB x 2 3337.6 3741.3 3305.3 3789.4 96987.8 103047.0 2400.5 2677.1 109989.0 124595.0 10.8
5.0-0010 Cisco UCS C885A M8 (8x H100-SXM-80GB, TensorRT) Cisco NVIDIA H100-SXM-80GB x 8 26599.4 30899.7 26599.4 30899.7 20706.7 20307.7 20706.7 20307.7 17.8 18.4 13908.7 14476.3 652002.0 715761.0
5.0-0011 Cisco UCS C885A M8 (8x H200-SXM-141GB, TensorRT) Cisco NVIDIA H200-SXM-141GB x 8 30420.2 34081.1 30420.2 34081.1 21813.4 21557.8 21813.4 21557.8 648207.0 770496.0
5.0-0012 UCS C245 M8 (2x L40S, TensorRT) Cisco NVIDIA L40S x 2 1.3 1.4 49591.6 57832.5 7.8
5.0-0013 UCS X215 M8 (2x L40S, TensorRT) Cisco NVIDIA L40S x 2 1745.8 1755.0 49591.6 57918.1 7.7
5.0-0014 Cisco UCS X215c M8 with X440P PCIe node (2x H100NVL-PCIe-94GB) Cisco NVIDIA H100-NVL-94GB x 2 3337.8 3879.9 3701.8 3743.4 98585.8 101768.0 2400.5 2653.4 119990.0 136731.0 10.8
5.0-0015 1-node-2S-GNR_86C Dell 168.7 316.0 11788.9 12397.8 350.9 465.9 27987.9 31472.7 2.3
5.0-0016 Dell PowerEdge R7725 (2x H100-NVL-94GB, TensorRT) Dell NVIDIA H100-NVL-94GB x 2 10.8 10.8
5.0-0017 Dell PowerEdge XE7745 (8x H200-NVL-141GB, TensorRT) Dell NVIDIA H200-NVL-141GB x 8 28848.4 31149.9 28848.4 31149.9 17975.8 16900.1 17975.8 16900.1
5.0-0018 Dell PowerEdge XE7745 (8x L40S, TensorRT) Dell NVIDIA L40S x 8 3201.1 3481.5 3201.1 3481.5 6213.3 6946.7 6213.3 6946.7 5.9 6.2 6095.4 6522.1 340047.0 345721.0 28.0 28.0
5.0-0019 Dell PowerEdge XE9680L (8x H200-SXM-141GB, TensorRT) Dell NVIDIA H200-SXM-141GB x 8 33023.5 34763.2 33023.5 34763.2 21455.9 21406.8 21455.9 21406.8 16.7 19.3 13588.8 14794.4 632200.0 765417.0 54.7 54.7
5.0-0020 Dell PowerEdge XE9680 (8x H100-SXM-80GB, TensorRT) Dell NVIDIA H100-SXM-80GB x 8 30903.6 31216.8 30903.6 31216.8 21134.4 20663.7 21134.4 20663.7 51.5 51.5
5.0-0021 Dell PowerEdge XE9680 (8xH200-SXM-141GBx8, TensorRT) Dell NVIDIA H200-SXM-141GB x 8 33051.9 34822.6 33051.9 34822.6 21536.4 21117.0 21536.4 21117.0 16.7 19.0 13588.8 14893.4 54.7 54.7
5.0-0022 Dell PowerEdge XE9680 (8x H100-SXM-80GB,VMware ESXi 8.0.3) Dell Virtualized NVIDIA H100-SXM-80GB x 8
5.0-0023 PRIMERGY CDI (8x H100NVL, TensorRT) Fujitsu NVIDIA H100-NVL-94GB x 8 16848.6 18084.9 16848.6 18084.9 14846.7 14769.7 14846.7 14769.7 10234.4 11106.2 44.6 44.6
5.0-0024 GATE Overflow Intel Sapphire Rapids (2x RTX 4090) GATEOverflow NVIDIA GeForce RTX 4090 x 2 8266.2 3339.7 73725.3 87921.1 8.3 8.3
5.0-0033 G893-SD1 GigaComputing NVIDIA H200-SXM-141GB x 8 33054.0 34889.5 33054.0 34889.5 21544.3 21450.8 21544.3 21450.8 16.8 19.2 585166.0 645975.0 370056.0 388769.0 14004.6 14992.5 676219.0 765403.0 54.8 54.8
5.0-0034 G893-ZX1-AAX2 GigaComputing AMD Instinct MI325X 256GB HBM3E x 8 29094.3 33251.3 29094.3 33251.3
5.0-0035 a3-ultragpu-8g (8x H200-SXM-141GB, TensorRT) Google NVIDIA H200-SXM-141GB x 8 31390.2 34144.7 31390.2 34144.7 20501.8 21040.9 20501.8 21040.9 555883.0 634294.0 362655.0 383039.0 12909.5 14765.7
5.0-0036 tpu-v6e-4 Google TPU Trillium x 4 5.5 6.1
5.0-0037 HPE ProLiant Compute DL384 Gen12 (1x GH200-144GB_aarch64, TensorRT) HPE NVIDIA GH200 Grace Hopper Superchip 144GB x 1 4327.7 4609.1 4327.7 4609.1 2526.0 2845.4 2526.0 2845.4 2.1 2.5 80994.3 85998.9 50070.5 51970.0
5.0-0038 HPE ProLiant Compute DL384 Gen12 (2x GH200-144GB_aarch64, TensorRT) HPE NVIDIA GH200 Grace Hopper Superchip 144GB x 2 8674.6 9362.9 8674.6 9362.9 5039.8 5666.2 5039.8 5666.2 4.3 5.0 157961.0 173943.0 98162.1 103949.0
5.0-0039 HPE Cray XD670 with HPE GreenLake for File Storage (8x H100-SXM-80GB, TensorRT) HPE NVIDIA H100-SXM-80GB x 8 30457.7 31238.0 30500.8 31252.1 19363.2 20993.9 19363.3 20796.0 16.0 18.1 555631.0 599191.0 358055.0 377305.0 13748.4 14637.8 620188.0 718177.0 52.2 52.1
5.0-0040 HPE Cray XD670 with Cray ClusterStor (8x H100-SXM-80GB, TensorRT) HPE NVIDIA H100-SXM-80GB x 8 30498.9 31174.7 30480.6 31147.4 20991.3 20925.3 20795.3 20716.5 16.0 18.0 13748.4 14633.1 620188.0 717848.0 52.1 52.2
5.0-0041 HPE Cray XD670 with Cray ClusterStor (8x H200-SXM-141GB) HPE NVIDIA H200-SXM-141GB x 8 31281.1 33781.8 31283.3 33964.0 21025.5 21324.9 21019.9 21014.6 16.8 19.0 590167.0 654489.0 380059.0 398164.0 14388.8 14909.6 667216.0 769420.0 55.1 55.1
5.0-0042 HPE Compute Scale-up Server 3200 (4x H100-NVL-94GB, TensorRT) HPE NVIDIA H100-NVL-94GB x 4 7179.9 7240.1 5097.8 5326.9 21.9 21.9
5.0-0043 HPE ProLiant DL380a Compute Gen12 (8x H200-NVL-141GB, TensorRT) HPE NVIDIA H200-NVL-141GB x 8 27638.9 30297.5 27638.9 30297.5 18065.1 17882.9 18065.1 17882.9 15.5 16.4 201011.0 512363.0 195518.0 320287.0 11988.4 13549.5 620188.0 686884.0 49.5 49.5
5.0-0044 HPE ProLiant Compute DL380a Gen12 (8x H100-NVL-94GB, TensorRT) HPE NVIDIA H100-NVL-94GB x 8 170018.0 225640.0 9991.1 10893.6 480097.0 483928.0 43.2 43.2
5.0-0045 HPE ProLiant Compute DL380a Gen12 (8x L40S-PCIe-48GB, TensorRT) HPE NVIDIA L40S x 8 6821.1 6823.9 6821.1 6823.9 5.0 6.1 177643.0 225297.0 94989.3 100517.0 6095.5 6305.1 344052.0 330082.0 27.1 27.1
5.0-0046 HPE ProLiant Compute DL380a Gen12 (8x L40S-PCIe-48GB, TensorRT) HPE NVIDIA L40S x 8 3181.7 3655.9 3181.7 3655.9
5.0-0048 1-node-2S-GNR_128C Intel 265.1 516.8 265.1 516.8 18177.0 18686.1 18177.0 18686.1 580.9 713.8 40184.8 45530.4 3.7 3.7
5.0-0049 NVIDIA H200 (8x H200-SXM-141GB, TensorRT) Lambda NVIDIA H200-SXM-141GB x 8 33045.3 35385.1 33045.3 35385.1 21543.9 21448.4 21543.9 21448.4 585164.0 643756.0 370055.0 386569.0
5.0-0050 ThinkSystem SR650a V4 (4x H100-NVL-94GB, TensorRT) Lenovo NVIDIA H100-NVL-94GB x 4 6773.9 7706.0 6773.9 7706.0 5.9 6.5 5277.7 5487.0 265225.0 278849.0 22.4 22.4
5.0-0051 ThinkSystem SR680a V3(8x H200-SXM-141GB, TensorRT) Lenovo NVIDIA H200-SXM-141GB x 8 32976.4 35453.0 32976.4 35453.0 21549.1 21513.3 21549.1 21513.3 16.7 19.4 13588.8 14785.2 673220.0 773300.0 54.7 54.7
5.0-0052 ThinkSystem SR675 V3 (4x H200-SXM-141GB, TensorRT) Lenovo NVIDIA H200-SXM-141GB x 4 14652.8 17654.1 14652.8 17654.1 10503.7 10825.5 10503.7 10825.5 8.3 9.6 6795.6 7239.2 304031.0 378623.0 27.4 27.4
5.0-0053 ThinkSystem SR780a V3(8x H200-SXM-141GB, TensorRT) Lenovo NVIDIA H200-SXM-141GB x 8 32934.7 35400.2 32934.7 35400.2 21553.4 21626.0 21553.4 21626.0 16.7 19.3 13996.7 14711.6 670220.0 771137.0 54.6 54.6
5.0-0054 MangoBoost Mi300X (32x MI300X-192GB-HBM3, LLMBoost) MangoBoost AMD Instinct MI300X 192GB HBM3 x 8 93039.9 103182.0 93039.9 103182.0
5.0-0055 NVIDIA DGX B200 (1x B200-SXM-180GB, TensorRT) NVIDIA NVIDIA B200-SXM-180GB x 1 12078.4 12269.3 12078.4 12269.3
5.0-0056 NVIDIA DGX B200 (8x B200-SXM-180GB, TensorRT) NVIDIA NVIDIA B200-SXM-180GB x 8 98443.3 98858.0 98443.3 98858.0 28.4 30.4
5.0-0057 NVIDIA DGX H100 (8x H100-SXM-80GB, TensorRT) NVIDIA NVIDIA H100-SXM-80GB x 8 31106.3 31306.8 31106.3 31306.8
5.0-0058 (72x GB200-186GB_aarch64, TensorRT, Triton) NVIDIA NVIDIA GB200 x 4
5.0-0059 HPE ProLiant Compute DL384 Gen12 (1x GH200-144GB_aarch64, TensorRT) NVIDIA NVIDIA GH200 Grace Hopper Superchip 144GB x 1 4350.3 4686.1 4350.3 4686.1 2526.8 2824.8 2526.8 2824.8 2.3 2.5 80994.2 87268.0 50991.7 52549.1
5.0-0060 NVIDIA H200 (8x H200-SXM-141GB, TensorRT) NVIDIA NVIDIA H200-SXM-141GB x 8 33071.5 34988.2 33071.5 34988.2 21544.6 21182.5 21544.6 21182.5 18.3 19.0 585164.0 641629.0 370054.0 385327.0 13588.8 14568.6 632194.0 760715.0 54.6 54.6
5.0-0061 NVIDIA H200 (8x H200-SXM-141GB, TensorRT, Triton) NVIDIA NVIDIA H200-SXM-141GB x 8 33024.7 34300.2 33024.7 34300.2
5.0-0062 NVIDIA H200 (8x H200-SXM-141GB, TensorRT) Oracle NVIDIA H200-SXM-141GB x 8 33001.0 34556.6 33001.0 34556.6 21527.4 21104.1 21527.4 21104.1 13588.8 14693.2 632198.0 755069.0
5.0-0063 1-node-2S-GNR_86C Quanta_Cloud_Technology 168.7 300.9 11789.7 12391.5 350.9 456.7 27987.9 31091.4 2.2
5.0-0064 QuantaGrid D54U-3U (4x H100-PCIe-80GB, TensorRT) Quanta_Cloud_Technology NVIDIA H100-PCIe-80GB x 4 4889.9 7013.2 4889.9 7013.2 6251.3 6319.1 6251.3 6319.1 4.2 5.3 175419.0 187064.0 100187.0 109408.0 4440.0 4709.6 188014.0 226268.0 18.5 18.5
5.0-0065 QuantaGrid D74H-7U (8x H100-SXM-80GB, TensorRT) Quanta_Cloud_Technology NVIDIA H100-SXM-80GB x 8 29916.0 31083.6 29916.0 31083.6 19316.9 20464.9 19316.9 20464.9 16.0 18.4 512121.0 586194.0 340044.0 372632.0 12869.8 14356.4 584161.0 712859.0 51.4 51.4
5.0-0066 QuantaGrid S74G-2U (1x GH200-96GB_aarch64, TensorRT) Quanta_Cloud_Technology NVIDIA GH200 Grace Hopper Superchip 96GB x 1 3203.9 3144.2 3203.9 3144.2 2824.6 2808.2 2824.6 2808.2 1.9 2.4 82792.8 83504.2 45990.4 50606.5 1730.7 1925.5 72995.1 96157.6
5.0-0067 SYS-822GA-NGR3 Supermicro 251.3 493.9 18987.0 19577.8 585.8 726.7 40285.5 46041.4 3.7
5.0-0068 AS-8126GS-TNMR Supermicro AMD Instinct MI325X 256GB HBM3E x 8 28770.2 33069.1 28770.2 33069.1
5.0-0069 ARS-111GL-NHR (1x GH200-96GB_aarch64) Supermicro NVIDIA GH200 Grace Hopper Superchip 96GB x 1 80992.9 85986.9 50468.9 51030.9
5.0-0070 AS-4125GS-TNHR2-LCC (8x H200-SXM-141GB, TensorRT) Supermicro NVIDIA H200-SXM-141GB x 8 33045.7 35026.8 33045.7 35026.8 21757.3 21477.4 21757.3 21477.4 18.3 19.4 14589.3 15200.3 54.6 54.6
5.0-0071 SYS-522GA-NRT(8x H200-NVL-141GB) Supermicro NVIDIA H200-NVL-141GB x 8 18571.1 18724.2 18571.1 18724.2 15.9 16.8 11829.1 13802.9 49.4 49.4
5.0-0072 SYS-421GE-NBRT-LCC (8x B200-SXM-180GB, TensorRT) Supermicro NVIDIA B200-SXM-180GB x 8 97629.8 98782.4 97629.8 98782.4
5.0-0073 SYS-821GE-TNHR (8x H200-SXM-141GB, TensorRT) Supermicro NVIDIA H200-SXM-141GB x 8 33052.9 34628.3 33052.9 34628.3 21544.2 21304.3 21544.2 21304.3 18.3 19.2 14488.7 14955.3 640203.0 759826.0 54.6 54.6
5.0-0074 SYS-A21GE-NBRT (8x B200-SXM-180GB, TensorRT) Supermicro NVIDIA B200-SXM-180GB x 8 97552.1 97416.9 97552.1 97416.9 28.9 30.3
5.0-0075 Dell PowerEdge XE9680 (8xH200-SXM-141GBx8, TensorRT) Sustainable_Metal_Cloud NVIDIA H200-SXM-141GB x 8 33027.3 34264.0 21359.6 20999.6 21359.6 20999.6 570145.0 631064.0 13588.8 14391.3 632197.0 749810.0 54.8 54.8
5.0-0076 (4 x GB200-186GB_aarch64, TensorRT) coreweave NVIDIA GB200 x 4
5.0-0077 NVIDIA H200 (8x H200-SXM-141GB, TensorRT) coreweave NVIDIA H200-SXM-141GB x 8 33066.5 34403.5 33066.5 34403.5

Datacenter Category: Preview submissions in Closed division

ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
5.0-0078 NVIDIA DGX B200 (8x B200-SXM-180GB, TensorRT) Google NVIDIA B200-SXM-180GB x 8 92338.7 97124.0 92203.7 97089.9 28.4 30.3

Count of Results

Submitter LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9 Total
AMD 2 2 0 0 0 0 2 0 0 0 0 0 0 6
ASUSTeK 6 6 4 4 0 0 2 2 2 2 2 1 1 32
Broadcom_Supermicro 0 0 2 2 0 0 0 0 0 2 0 1 1 8
Cisco 8 4 10 6 0 0 4 8 0 8 10 4 1 63
Dell 10 10 10 12 0 0 6 0 2 8 6 5 6 75
Fujitsu 2 2 2 2 0 0 0 0 0 2 0 1 1 12
GATEOverflow 0 0 0 0 2 2 0 0 0 0 4 2 2 12
GigaComputing 4 4 2 2 0 0 2 2 2 2 2 1 1 24
Google 4 4 2 2 0 0 4 2 2 2 0 0 0 22
HPE 14 14 16 14 0 0 14 12 14 14 12 7 7 138
Intel 0 0 2 2 0 0 0 2 2 2 2 1 1 14
Lambda 2 2 2 2 0 0 0 2 2 0 0 0 0 12
Lenovo 6 6 8 8 0 0 8 0 0 8 8 4 4 60
MangoBoost 2 2 0 0 0 0 0 0 0 0 0 0 0 4
NVIDIA 12 12 4 4 0 0 6 4 4 2 2 1 1 52
Oracle 2 2 2 2 0 0 0 0 0 2 2 0 0 12
Quanta_Cloud_Technology 6 6 6 8 0 0 6 6 8 8 8 2 3 67
Supermicro 10 10 6 8 0 0 8 2 4 8 4 3 4 67
Sustainable_Metal_Cloud 2 0 2 2 0 0 0 2 0 2 2 1 1 14
coreweave 2 2 0 0 0 0 0 0 0 0 0 0 0 4
Total 94 88 80 80 2 2 62 44 42 72 64 34 34 698

Select Category and Division