{"id":10506,"date":"2021-01-29T07:00:00","date_gmt":"2021-01-29T15:00:00","guid":{"rendered":"https:\/\/formtek.com\/blog\/?p=10506"},"modified":"2020-10-28T08:17:03","modified_gmt":"2020-10-28T16:17:03","slug":"artificial-intelligence-designing-accurate-benchmarks","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/artificial-intelligence-designing-accurate-benchmarks\/","title":{"rendered":"Artificial Intelligence: Designing Accurate Benchmarks"},"content":{"rendered":"\n

As both startups and more established chip makers design and build computer chips that target the acceleration of the processing of AI algorithms, benchmarking becomes very important as a way to compare the capabilities of the different chips.<\/p>\n\n\n\n

Until recently AI benchmarks have been flawed.<\/p>\n\n\n\n

Anoop Saha<\/a>, market development manager at Mentor, said that<\/a> “in recent years, we have seen a lot of advancements in hardware choices available for AI \u2013 from GPUs to FPGAs to custom hardware ASICs. However, the existing benchmarks are not suitable for measuring how the hardware will work for AI applications \u2013 either in training or in inference.”<\/p>\n\n\n\n

To come up with better AI chip benchmarks, a consortium of more than 70 academic, research, and commercial organizations formed MLPerf, a group that focuses on developing benchmarks for Machine Learning performance criteria like speed and energy efficiency.<\/p>\n\n\n\n

David Kanter<\/a>, MLPerf Inference Working Group cochair, said that<\/a> “if you\u2019re a researcher or you\u2019re an engineer designing these next generation systems, it\u2019s important to know what are the workloads and metrics that matter, because ultimately at the end of the day, all the engineers working on this stuff are very smart and talented folks, but we\u2019ve got to point them in the right direction and make sure they\u2019re optimizing for the right things so that the solutions that come out \u2014 whether it\u2019s 2 or 5 years from now \u2014 are designed for the workloads of today and tomorrow.”<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

As both startups and more established chip makers design and build computer chips that target the acceleration of the processing of AI algorithms, benchmarking becomes very important as a way to compare the capabilities of the different chips. Until recently…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69],"tags":[],"class_list":["post-10506","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10506","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=10506"}],"version-history":[{"count":1,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10506\/revisions"}],"predecessor-version":[{"id":10507,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10506\/revisions\/10507"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=10506"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=10506"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=10506"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}