MLPerf automations

Collective Mind automation framework (CM and CMX) have helped the community learn how to modularize and automate MLPerf inference benchmarks through unified MLOps and MLPerf automations with extensible metadata.

Here, we maintain an archive of various unified CM and CMX commands for running different versions of MLPerf benchmarks.

You can also check the CM/CMX commands to run experiments from the HPCA'25 paper "MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI".