{"id":5922,"date":"2015-12-21T07:00:19","date_gmt":"2015-12-21T15:00:19","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=5922"},"modified":"2015-11-06T08:24:04","modified_gmt":"2015-11-06T16:24:04","slug":"big-data-and-nomadic-computing-speeding-up-analytics-of-complex-data-sets","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-and-nomadic-computing-speeding-up-analytics-of-complex-data-sets\/","title":{"rendered":"Big Data and Nomadic Computing: Speeding up Analytics of Complex Data Sets"},"content":{"rendered":"

Researchers at The University of Texas at Austin and the Texas Advanced Computing Center (TACC) are developing ways to speed up analytics processing of massive data sets. \u00a0One of the techniques developed by the university team is called nomadic computing.<\/p>\n

Nomadic computing has nothing to do with\u00a0bedouins or gypsies. \u00a0Actually, the tool developed by the researchers is\u00a0called NOMAD, which stands for “non-locking, stochastic multi-machine algorithm for asynchronous and decentralized matrix completion.” \u00a0Data analysis using NOMAD is significantly faster than by using other techniques that are considered to be\u00a0state-of-the-art. \u00a0The tool enables analysis on data sets so large that most other analytic tools are just not able to handle them.<\/p>\n

The NOMAD technique involves simplifying the complexity of data sets. \u00a0The idea is that if data comes with many parameters or dimensions that it can be simplified by identifying\u00a0just the subset of the dimensions that are the most meaningful.<\/p>\n

Inderjit Dhillon<\/a>, a professor of computer science at The University of Texas at Austin, said that<\/a> “suppose you have a massive computational problem and you need to run it on datasets that do not fit in a computer’s memory. \u00a0If you want the answer in a reasonable amount of time, the logical thing to do would be to distribute the computations over different machines. We are trying to develop an asynchronous method where each parameter is, in a sense, a nomad. \u00a0The parameters go to different processors, but instead of synchronizing this computation followed by communication, the nomadic framework does its work whenever a variable is available at a particular processor.”<\/p>\n

Amy Apon<\/a>, a program director at NSF, said that<\/a>\u00a0“traditionally, machine learning inference algorithms run on a single large–and sometimes expensive–server, and this limits the size of the problem that can be addressed. \u00a0This team has noticed a property of some machine learning algorithms that if a few slowly changing variables can be only occasionally synchronized, then the work can be more easily distributed across different computers. \u00a0Their clever mathematical approach is opening doors to running machine algorithms on the kind of massive-scale, distributed, commodity computers that we find in today’s cloud computing environment.”<\/p>\n

 <\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Researchers at The University of Texas at Austin and the Texas Advanced Computing Center (TACC) are developing ways to speed up analytics processing of massive data sets. \u00a0One of the techniques developed by the university team is called nomadic computing.…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,58],"tags":[],"class_list":["post-5922","post","type-post","status-publish","format-standard","hentry","category-big-data","category-data-analytics"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5922","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=5922"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5922\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=5922"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=5922"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=5922"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}