{"id":5234,"date":"2015-02-27T07:00:10","date_gmt":"2015-02-27T15:00:10","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=5234"},"modified":"2015-01-23T11:43:57","modified_gmt":"2015-01-23T19:43:57","slug":"big-data-choosing-medium-instead-of-big-when-right-sizing-your-data","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-choosing-medium-instead-of-big-when-right-sizing-your-data\/","title":{"rendered":"Big Data:  Choosing &#8216;Medium&#8217; Instead of &#8216;Big&#8217; When &#8216;Right-Sizing&#8217; Your Data"},"content":{"rendered":"<p>Big Data is the rage, but the reality now is that most businesses really don&#8217;t have data sets that large to be classified as &#8216;Big Data&#8217;.<\/p>\n<p>Gartner analysts\u00a0<a title=\"Merv Adrian bio\" href=\"http:\/\/blogs.gartner.com\/merv-adrian\/\" target=\"_blank\">Merv Adrian<\/a>\u00a0and\u00a0<a title=\"Nick Huedecker bio\" href=\"http:\/\/www.gartner.com\/analyst\/45472\/NickHeudecker\" target=\"_blank\">Nick Huedecker<\/a>\u00a0<a title=\"Gartner analysts on Big Data\" href=\"http:\/\/readwrite.com\/2014\/12\/19\/big-data-why-companies-are-so-bad-at-it\" target=\"_blank\">note that Hadoop and Big Data projects have been<\/a>\u00a0&#8220;slow to grow so far.&#8221;<\/p>\n<p><a title=\"Harper Reed bio\" href=\"http:\/\/harperreed.com\/\" target=\"_blank\">Harper Reed<\/a>, Chief Technology Officer at Obama for America 2012,\u00a0<a href=\"http:\/\/www.theregister.co.uk\/2013\/05\/28\/big_data_is_bovine_excrement_says_obamas_big_data_man\/\" target=\"_blank\">said that<\/a>\u00a0most businesses\u00a0&#8220;probably have medium data. \u00a0Big Data has now come to represent analytics tools, not the data itself.&#8221;<\/p>\n<p><a title=\"Matt Hunt bio\" href=\"https:\/\/www.linkedin.com\/pub\/matthew-hunt\/1\/a37\/519\" target=\"_blank\">Matt Hunt<\/a>, open source project lead at Bloomberg,\u00a0<a title=\"Matt Hunt on open source\" href=\"http:\/\/highscalability.com\/blog\/2014\/12\/17\/the-big-problem-is-medium-data.html\" target=\"_blank\">said that<\/a>\u00a0&#8220;what we have is a &#8216;medium data&#8217; problem &#8212; and so does everyone else. \u00a0 Systems such as Hadoop and Spark are less efficient and mature for these typical low latency enterprise uses in general. High core counts, SSDs, and large RAM footprints are common today &#8211; but many of the commodity platforms have yet to take full advantage of them, and challenges remain.&#8221;<\/p>\n<p>Tableau calls Medium Data the &#8220;<a title=\"Tableau data and the new sweet spot\" href=\"https:\/\/www.tableau.com\/medium-data\" target=\"_blank\">New sweet spot.<\/a>&#8221; \u00a0It is a way to &#8216;<a title=\"Right Sizing your Medium data projects\" href=\"http:\/\/www.geekwire.com\/2014\/april-fools-megapost\/\" target=\"_blank\">right size<\/a>&#8216; your data analytics efforts.<\/p>\n<p><a title=\"David Rothschild bio\" href=\"http:\/\/research.microsoft.com\/en-us\/people\/davidmr\/\" target=\"_blank\">David Rothschild<\/a>, an economist with Microsoft Research,\u00a0<a title=\"Medium Data quote\" href=\"http:\/\/read.uberflip.com\/i\/370054\/179\" target=\"_blank\">is quoted<\/a>\u00a0in a piece by \u00a0<a title=\"Haniya Rae bio\" href=\"http:\/\/digiday.com\/author\/haniya-rae\/\" target=\"_blank\">Haniya Rae<\/a>\u00a0saying that &#8220;people have gotten really excited about big data. \u00a0It\u2019s a massive amount of discussion about individual products, but in some ways it\u2019s thinner than we give it credit for.&#8221; \u00a0Rothschild says that &#8216;Big Data&#8217; analytics tools can &#8216;supercharge&#8217; smaller data-source projects. \u00a0&#8220;Not to say that Big Data isn&#8217;t valuable, but medium data proves to be more valuable on a day-to-day basis.&#8221;<\/p>\n<p>Tableau\u00a0<a title=\"Tableau on the definition of Medium Data\" href=\"https:\/\/www.youtube.com\/watch?v=fEyrlgcBGzQ\" target=\"_blank\">notes that<\/a>\u00a0\u2018medium\u2019 isn\u2019t bad, in fact, with &#8220;a bell curve, when you&#8217;re in the middle, you&#8217;re really on top.&#8221;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-choosing-medium-instead-of-big-when-right-sizing-your-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Big Data is the rage, but the reality now is that most businesses really don&#8217;t have data sets that large to be classified as &#8216;Big Data&#8217;. Gartner analysts\u00a0Merv Adrian\u00a0and\u00a0Nick Huedecker\u00a0note that Hadoop and Big Data projects have been\u00a0&#8220;slow to grow<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/big-data-choosing-medium-instead-of-big-when-right-sizing-your-data\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,58],"tags":[],"class_list":["post-5234","post","type-post","status-publish","format-standard","hentry","category-big-data","category-data-analytics"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5234","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=5234"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5234\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=5234"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=5234"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=5234"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}