{"id":2549,"date":"2011-11-15T07:00:08","date_gmt":"2011-11-15T15:00:08","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=2549"},"modified":"2011-11-15T07:00:08","modified_gmt":"2011-11-15T15:00:08","slug":"big-data-extreme-information-processing","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-extreme-information-processing\/","title":{"rendered":"Big Data — Extreme Information Processing"},"content":{"rendered":"

We hear a lot about Big Data nowadays. \u00a0But just what is Big Data?<\/p>\n

 <\/div>\n
You’ll find that there is no lack of definitions for Big Data<\/a> is, but then, there is no single standard and widely accepted definition.<\/div>\n
 <\/div>\n
Wikipedia defines Big data as “datasets that grow so large that they become awkward to work with using on-hand database management tools.”<\/div>\n
 <\/div>\n
When does data become \u2018Big\u2019 and when is the size of a data set just \u2018Normal\u2019 or \u2018Small\u2019? \u00a0Are data sets on the order of terabytes in size considered to be \u2018Big\u2019? \u00a0Or does a data set need to be on the order of petabytes of data before it is considered to be \u2018Big\u2019? \u00a0Just what is the threshold that a data set\u2019s size must be before it can be called \u2018Big\u2019? \u00a0And if there such a threshold, does the threshold for \u2018Big\u2019 need to be a sliding one that gets continually bumped upwards as storage costs drop and as people and organizations continue to collect ever more data.<\/div>\n
 <\/div>\n
Because there is no mutually agreed on definition of Big Data, there are no right answers to these questions. \u00a0As of now — late 2011, the term Big Data has typically been applied to data sets that exceed 100 Terabytes in size.<\/div>\n
 <\/div>\n
The ‘Big’ in Big Data is actually a misnomer because it distorts how the technology is portrayed by focusing on just a single characteristic of the technology \u2013 the size, and there is really much more to Big Data than just collecting data sets that are huge in size. \u00a0Size doesn\u2019t really adequately capture the whole picture of what people are trying to describe when they use the term Big Data. \u00a0An organization, for example, that passively collects hundreds of terabytes of data but which doesn\u2019t attempt in any way to analyze or derive any insight from the data that they\u2019ve collected isn\u2019t practicing Big Data.<\/div>\n
 <\/div>\n
Research firms Gartner Inc.<\/a> and Forrester Research<\/a> both agree that the word \u2018Big\u2019 really doesn\u2019t adequately describe what people mean by Big Data; \u2018Big\u2019 describes only a single parameter and is much more linear in description of something that is really very multi-dimensional. \u00a0Big Data is about processing huge data sets, but it\u2019s also about performing complex analysis and visualization that can lead to insights and finding answers to difficult problems.<\/div>\n
 <\/div>\n
Brian Hopkins, Forrester Research analyst, says that the emphasis should not just be on the size or volume of data, which the descriptor \u2018Big\u2019 emphasizes, but should include other factors that better define what people are trying to describe when they use the term Big Data. \u00a0Both Forrester and IBM have begun to use additional adjectives to describe the characteristics of Big Data. \u00a0Forrester, for example, says that there are four V\u2019s when it comes to Big Data. \u00a0Big Data is not just about large volumes<\/em>, it is also characterized by velocity<\/em>, variety <\/em>of format, and variability <\/em>of meaning.<\/div>\n
 <\/div>\n
Cisco\u2019s Senior Vice President of Engineering and Chief Technology Officer, Padmasree Warrior<\/a>, \u00a0identified Big Data in the future as being generated from two main areas<\/a>: things or people. \u00a0In the area of things, enormous amounts of data sets are being generated from scientific research in areas like astrophysics, and from hardware in smart grids, and from machine to machine communications. \u00a0People-generated Big Data sets will come from things like social media, genetics, health care records, and general communication.<\/div>\n
\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

We hear a lot about Big Data nowadays. \u00a0But just what is Big Data?   You’ll find that there is no lack of definitions for Big Data is, but then, there is no single standard and widely accepted definition.  …<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-2549","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/2549","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=2549"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/2549\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=2549"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=2549"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=2549"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}