{"id":8875,"date":"2018-11-19T07:00:38","date_gmt":"2018-11-19T15:00:38","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=8875"},"modified":"2018-09-28T10:03:19","modified_gmt":"2018-09-28T18:03:19","slug":"ai-and-machine-learning-chip-sets-is-the-battle-against-fpgas-and-asics-one-that-gpus-ultimately-cannot-win","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/ai-and-machine-learning-chip-sets-is-the-battle-against-fpgas-and-asics-one-that-gpus-ultimately-cannot-win\/","title":{"rendered":"AI and Machine Learning Chip Sets: Is the Battle Against FPGAs and ASICs one that GPUs Ultimately Cannot Win?"},"content":{"rendered":"

GPUs have sped the development of machine learning and artificial intelligence in recent years.\u00a0 GPUs are bandwidth optimized to be able to do large amounts of matrix multiplication and convolution.\u00a0 CPUs are highly programmable and not as specialized in what they can do. CPUs are optimized for performing tasks very quickly but they are limited in data throughput processed at a time.<\/p>\n

Competing with CPUs and GPUs are two other types of chips that are beginning to be more commonly used for AI and ML tasks: FPGAs and ASICSs.\u00a0 The advantage of FPGAs are that they run at very low power and allow the designer to change the underlying hardware to support the software algorithm that is being run.\u00a0 FPGAs tend to be run for smaller, more specialized tasks.\u00a0 Because FPGAs have the advantage of being able to morph to an optimal hardware, but they have the huge disadvantage that they need a skilled designer to be able to design the changes. Further, the performance of an GGPA is not as good as what you’d get with high-end GPU’s, although that is highly dependent on the algorithm being compared.<\/p>\n

Jensen Huang<\/a>, CEO of NVIDIA, said that<\/a> “FPGA is not the right answer. FPGA is really for prototyping. If you want the [self-driving] car to be perfect, I would build myself an ASIC because self-driving cars deserve it.”<\/p>\n

The other option to GPUs and CPUs are ASICs (application-specific integrated circuits).\u00a0 Many analysts are predicting that for machine learning ASICs\u00a0 will likely become the preferred chip set.\u00a0 Tractica predicts<\/a> that the deep learning chip set market size will increase from $1.6 billion in 2017 to $66.3 billion by 2025.<\/p>\n

FPGAs and ASICs are generally faster<\/a> than GPUs and CPUs because they need no operating system and run on “bare metal.”<\/p>\n

ASICs are designed to perform fixed operations and optimized for efficiency.\u00a0 It is like implementing a software algorithm directly in hardware.\u00a0 The chips logic is dedicated to running a very narrow type of problem.\u00a0 ASICs can also be incredibly expensive to manufacture and require many highly trained engineers to design and implement.\u00a0 But if an ASIC can be deployed in volume, the costs are worth it.<\/p>\n

The alternative is to design a custom ASIC dedicated to performing fixed operations extremely fast since the entire chip\u2019s logic area can be dedicated to a set of narrow functions. In the case of the Google TPU, they lend themselves well to a high degree of parallelism, and processing neural networks is an \u201cembarrassingly parallel\u201d workload.<\/p>\n

Chris Rolland<\/a>, investor analyst, wrote that GPU leader<\/a> “Nvidia was in the right place at the right time. However, our discussions with numerous thought leaders in the industry suggest ASICs may replace much of today’s GPU infrastructure over time… 2017 was the year of Artificial Intelligence GPU but might 2018 be the year of the ASIC?”<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

GPUs have sped the development of machine learning and artificial intelligence in recent years.\u00a0 GPUs are bandwidth optimized to be able to do large amounts of matrix multiplication and convolution.\u00a0 CPUs are highly programmable and not as specialized in what…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69,62],"tags":[],"class_list":["post-8875","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/8875","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=8875"}],"version-history":[{"count":2,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/8875\/revisions"}],"predecessor-version":[{"id":8877,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/8875\/revisions\/8877"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=8875"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=8875"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=8875"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}