{"id":4723,"date":"2014-07-15T07:00:57","date_gmt":"2014-07-15T15:00:57","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=4723"},"modified":"2014-06-19T06:41:50","modified_gmt":"2014-06-19T14:41:50","slug":"big-data-and-data-lakes-a-new-generation-of-the-data-warehouse","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-and-data-lakes-a-new-generation-of-the-data-warehouse\/","title":{"rendered":"Big Data and Data Lakes: A New Generation of the Data Warehouse"},"content":{"rendered":"

“If you think of a datamart as a store of bottled water \u2013 cleansed and packaged and structured for easy consumption \u2013 the data lake<\/em> is a large body of water in a more natural state. The contents of the data lake<\/em> stream in from a source to fill the lake, and various users of the lake can come to examine, dive in, or take samples,” said<\/a>\u00a0Pentaho CTO James Dixon<\/a>, creator of the term ‘Data Lake’.<\/p>\n

Joe McKendrick<\/a> explains <\/a>that “Data lakes are part of the Apache Hadoop ecosystem, serving as low-cost repositories for data of all types and sizes. Since data can be quickly poured into them with little fuss or muss, they’re relatively low cost to operate, unlike data warehouses, which require ETL, cleaning and normalization of data.”<\/p>\n

Cesar Rojas<\/a>, Product Marketing Director at\u00a0Teradata, said <\/a>that “one of the main appeals of data lakes is that they incorporate data from any source, from social media to clickstream data, into a single location that empowers enterprises to capitalize on this information.”<\/p>\n

Over the last year, vendors in the Big Data space have been building products based on the concept of the Data Lake. \u00a0Both\u00a0Teradata\u00a0<\/a>and\u00a0Hortonworks<\/a>, for example, offer platforms now that can store and process large amounts of data, and data is pushed into these systems at very rapid velocities.<\/p>\n

Tasso Argyros<\/a>, member of a stealth data startup,\u00a0said that<\/a>\u00a0“in many ways, this is not unlike the operational data store we\u2019ve seen between transactional systems and the data warehouse, but the data lake is bigger and less structured. Any file can be \u201cdumped\u201d in the lake with no attention to data integration or transformation. New technologies like Hadoop provide a file-based approach to capturing large amounts of data without requiring ETL in advance. This enables large-scale data processing for data refining, structuring, and exploring data prior to downstream analysis in workload-specific systems, which are used to discover new insights and then move those insights into business operations for use by hundreds of end-users and applications.”<\/p>\n

Bill Schmarzo<\/a>, chief technology officer at EMC, said that<\/a> “we\u2019re going to see company after company who have already jumped into the lake. The data lake is going to be a great enabler. It\u2019s going through its overhyped status right now, but a year from now we\u2019re going to see a lot of different organizations that have implemented the data lake and are running not only their analytics on top of that but, in some cases, have actually moved some of their data warehouse capabilities of that as well.”<\/p>\n

 <\/p>\n

 <\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

“If you think of a datamart as a store of bottled water \u2013 cleansed and packaged and structured for easy consumption \u2013 the data lake is a large body of water in a more natural state. The contents of the…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-4723","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4723","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=4723"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4723\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=4723"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=4723"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=4723"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}