mlperf-automations
MLPerf Automations and Scripts
Welcome to the MLPerf Automations and Scripts repository! This repository provides tools, automations, and scripts to facilitate running MLPerf benchmarks, with a primary focus on MLPerf Inference benchmarks.
The automations build upon and extend the powerful Collective Mind (CM) script automations to streamline benchmarking and workflow processes.
🚀 Key Features
- Automated Benchmarking – Simplifies running MLPerf Inference benchmarks with minimal manual intervention.
- Modular and Extensible – Easily extend the scripts to support additional benchmarks and configurations.
- Seamless Integration – Compatible with Docker, cloud environments, and local machines.
- Collective Mind (CM) Integration – Utilizes the CM framework to enhance reproducibility and automation.
🧰 Collective Mind (CM) Automations
The Collective Mind (CM) framework is a Python-based package offering both CLI and API support for creating and managing automations. CM automations enhance ML workflows by simplifying complex tasks such as Docker container management and caching.
Core Automations
- Script Automation – Automates script execution across different environments.
- Cache Management – Manages reusable cached results to accelerate workflow processes.
Learn more about CM in the CM4MLOps documentation.
🤝 Contributing
We welcome contributions from the community! To contribute:
- Submit pull requests (PRs) to the
devbranch. - Review our CONTRIBUTORS.md for guidelines and best practices.
- Explore more about MLPerf Inference automation in the official MLPerf Inference Documentation.
Your contributions help drive the project forward!
📰 News
Stay tuned for upcoming updates and announcements.
📄 License
This project is licensed under the Apache 2.0 License.
💡 Acknowledgments and Funding
This project is made possible through the generous support of:
We appreciate their contributions and sponsorship!
Thank you for your interest and support in MLPerf Automations and Scripts!