{"id":10621,"date":"2021-03-31T07:00:00","date_gmt":"2021-03-31T15:00:00","guid":{"rendered":"https:\/\/formtek.com\/blog\/?p=10621"},"modified":"2020-12-14T14:33:44","modified_gmt":"2020-12-14T22:33:44","slug":"apache-arrow-solving-ai-hardware-impedance-mismatch","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/apache-arrow-solving-ai-hardware-impedance-mismatch\/","title":{"rendered":"Apache Arrow: Solving AI-Hardware Impedance Mismatch"},"content":{"rendered":"\n

Object oriented databases were devised as a solution to a problem frequently called ‘impedance mismatch’<\/a>. The problem was that there is a huge overhead of constantly reformatting object data to move back and forth from object-based programming languages like Java and C++ into a structured table format of a relational database.<\/p>\n\n\n\n

AI is experiencing its own kind of ‘impedance mismatch’ headache between AI algorithms and hardware.<\/p>\n\n\n\n

Wes McKinney<\/a>, author of the Pandas Python library, told EETimes<\/a> that “the data science tools themselves in languages like Python and R lagged significantly behind advances in computing hardware. Most such tools are not designed to run on multi-cores, GPUs, or systems with lots of RAM because they were designed a decade ago when you didn\u2019t have things like a CPU with 16 cores. Similarly, a massive acceleration of memory has occurred. Disk drives are getting a lot faster. You also have solid-state drives. It\u2019s not just about memory speeds, but your ability to get access to data is getting faster.”<\/p>\n\n\n\n

\"\"<\/a>
Apache Arrow<\/a><\/figcaption><\/figure><\/div>\n\n\n\n

McKinney has joined the Apache Arrow project <\/a>which is an open-source programming-language-independent tool to make AI software, data, and AI hardware work together more smoothly. Arrow supports modern CPUs and GPUs and provides fast data transfer and access. It supports efficient in-memory computing, serialization of data into columnar format, and the efficient exchange of data.<\/p>\n\n\n\n

\"\"<\/a>
Source: EETimes, Wes McKinney<\/a><\/figcaption><\/figure>\n
\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Object oriented databases were devised as a solution to a problem frequently called ‘impedance mismatch’. The problem was that there is a huge overhead of constantly reformatting object data to move back and forth from object-based programming languages like Java…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-10621","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10621","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=10621"}],"version-history":[{"count":2,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10621\/revisions"}],"predecessor-version":[{"id":10627,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10621\/revisions\/10627"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=10621"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=10621"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=10621"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}