{"id":6697,"date":"2016-10-06T07:00:59","date_gmt":"2016-10-06T15:00:59","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=6697"},"modified":"2016-09-06T07:53:07","modified_gmt":"2016-09-06T15:53:07","slug":"data-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/data-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis\/","title":{"rendered":"Data Lakes: Recipe for Big Data Success or Roadblock to Data Analysis?"},"content":{"rendered":"<p>The Data Lakes Market is expected to grow from $2.53 billion to $8.81 billion over the next five years, at an average yearly growth rate of more than 28 percent, according to an estimate by <a href=\"http:\/\/www.prnewswire.com\/news-releases\/data-lakes-market-worth-881-billion-usd-by-2021-592149261.html\">analyst firm\u00a0MarketsandMarkets<\/a>. \u00a0The analysis breaks down the market into subsegments of:\u00a0Data Discovery, Data Integration, Data Lakes Analytics, Data Visualization.<\/p>\n<p>A data lake is a vast storage repository that holds raw data in its original format in a flat architecture. \u00a0A data lake contrasts to data warehouses which\u00a0typically involves processing and curating of data that is then\u00a0stored hierarchically in files and folders.<\/p>\n<p>The term &#8220;data lake&#8221; was an idea first explained by\u00a0\u00a0<a href=\"http:\/\/www.pentaho.com\/personnel-overview\/leadership\">James Dixon<\/a>, CTO at Pentaho. \u00a0<a href=\"https:\/\/jamesdixon.wordpress.com\/2010\/10\/14\/pentaho-hadoop-and-data-lakes\/\">He said that<\/a> &#8220;If you think of a data mart as a store of bottled water \u2013 cleansed and packaged and structured for easy consumption \u2013 the data lake is a large body of water in a more natural state.&#8221;<\/p>\n<p><a href=\"http:\/\/blogs.gartner.com\/nick-heudecker\/\">Nick Heudecker<\/a>, research director at Gartner, described the utility of data lakes, <a href=\"http:\/\/www.gartner.com\/newsroom\/id\/2809117\">saying that<\/a> &#8220;in broad terms, data lakes are marketed as enterprise-wide data management platforms for analyzing disparate sources of data in its native format. \u00a0The idea is simple: instead of placing data in a purpose-built data store, you move it into a data lake in its original format. This eliminates the upfront costs of data ingestion, like transformation. Once data is placed into the lake, it&#8217;s available for analysis by everyone in the organization.&#8221;<\/p>\n<p>The popularity of data lakes can be attributed to businesses looking for better competitiveness\u00a0and agility, increased adoption of the Internet of Things (IoT), and growing volumes of data.<\/p>\n<p>But not everyone agrees that data lakes are good. \u00a0 \u00a0Andrew White, Gartner vice president, <a href=\"http:\/\/www.gartner.com\/newsroom\/id\/2809117\">said that<\/a>\u00a0&#8220;data is simply dumped into the data lake&#8230; Getting value out of the data remains the responsibility of the business end user. Of course, technology could be applied or added to the lake to do this, but without at least some semblance of information governance, the lake will end up being a collection of disconnected data pools or information silos all in one place.&#8221;<\/p>\n<p><a href=\"http:\/\/www.evolvedmedia.com\/who-we-are\/\">Dan Woods<\/a>, writer and technologist,\u00a0<a href=\"http:\/\/www.forbes.com\/sites\/danwoods\/2016\/08\/26\/why-data-lakes-are-evil\/#5e1975b28ecd\">wrote on Forbes<\/a> that &#8220;with data lakes there\u2019s no inherent way to prioritize what data is going into the supply chain and how it will eventually be used. The result is like a museum with a huge collection of art, but no curator with the eye to tell what is worth displaying and what\u2019s not.&#8221;<\/p>\n<p>&nbsp;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>The Data Lakes Market is expected to grow from $2.53 billion to $8.81 billion over the next five years, at an average yearly growth rate of more than 28 percent, according to an estimate by analyst firm\u00a0MarketsandMarkets. \u00a0The analysis breaks<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/data-lakes-recipe-for-big-data-success-or-roadblock-to-data-analysis\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-6697","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/6697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=6697"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/6697\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=6697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=6697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=6697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}