MLPerf - AshokBhat/ml GitHub Wiki
About
- A broad ML benchmark suite
- To measure the performance of ML software frameworks, ML hardware accelerators, and ML cloud platforms.
Variants
Overall Goals
Learning from the 40-year history of benchmarks, MLPerf has these primary goals:
- Accelerate progress in ML via fair and useful measurement
- Serve both the commercial and research communities
- Enable fair comparison of competing systems yet encourage innovation to improve the state-of-the-art of ML
- Enforce replicability to ensure reliable results
- Keep benchmarking effort affordable so all can participate