The most popular and comprehensive Open Source ECM platform
Artificial Intelligence: Top AI Organizations Announce new MLPerf Tool to Benchmark Machine Learning
A consortium of industry and academic organizations recently announced support for a new set of benchmarks for machine learning frameworks and hardware. The organizations include Google, Baidu, Intel, AMD, Harvard and Stanford. The new benchmark is called MLPerf and is available on GitHub.
AI pioneer Andrew Ng said that “AI is transforming multiple industries, but for it to reach its full potential, we still need faster hardware and software.”
MLPerf is modeled after the Standard Performance Evaluation Corporation (SPEC) benchmark released in 1988 which was used to evaluate CPU performance. The introduction of SPEC helped CPU performance to improve 1.6 times every year over 15 years. The hope is that MLPerf can have a similar positive impact on MLPerf as SPEC did with CPUs.
Peter Mattson, an engineer working at Google Brain, told The Register that AI benchmarks are useful because “in the short term because hardware is a huge investment, both for companies making R&D decisions and companies making purchasing decisions, and in the long term [because] benchmarks enable researchers and vendors to evolve performance in a common direction, unlocking the power of machine learning faster to benefit all of us.”













