{"id":5738,"date":"2015-10-15T07:00:47","date_gmt":"2015-10-15T15:00:47","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=5738"},"modified":"2015-09-02T06:25:29","modified_gmt":"2015-09-02T14:25:29","slug":"big-data-challenges-facing-hadoop-in-the-enterprise","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-challenges-facing-hadoop-in-the-enterprise\/","title":{"rendered":"Big Data: Challenges Facing Hadoop in the Enterprise"},"content":{"rendered":"<p>Hadoop has become the de facto tool for managing Big Data. \u00a0Hadoop provides a way to organize, search, share and analyze data that was collected from many different data sources. \u00a0And scalability from a few to dozens to thousands of servers is one of Hadoop&#8217;s most attractive features.<\/p>\n<p>But will enterprises be able to fully take advantage of the\u00a0benefits of Big Data analytics that Hadoop offers?<\/p>\n<p><a href=\"http:\/\/www.wandisco.com\/about\/team\" target=\"_blank\">David Richards<\/a>, CEO at WANdisco, took on that question and\u00a0<a href=\"http:\/\/www.computerworlduk.com\/data\/hadoop-economics-is-driving-big-data-push-into-enterprise-says-wandisco-ceo-3624333\/\" target=\"_blank\">said:\u00a0<\/a>&#8220;imagine a world in which one bank has Hadoop and everyone else is using proprietary storage \u2013 it is not going to work. \u00a0One bank will have a massive competitive advantage because they can scale up storage at ten percent the cost of everybody else. \u00a0The market for big data has got nothing to do with anything other than this: the requirement for data storage is growing at a sixty percent compound annual growth rate and budgets are not. So you can\u2019t use proprietary storage to solve that problem. \u00a0It isn\u2019t a technologically-driven market place; it is an economically-driven market place.&#8221;<\/p>\n<p>The problem is that Hadoop isn&#8217;t easy &#8212; at least not yet, although it is getting easier. \u00a0Enterprises are finding that taking advantage of Hadoop is challenging. \u00a0<a href=\"http:\/\/www.ovum.com\/authors\/tony-baer\/\" target=\"_blank\">Tony Baer<\/a>, principal analyst at Ovum, <a href=\"http:\/\/www.itworldcanada.com\/article\/hadoop-in-the-enterprise-it-departments-are-struggling-with-two-perennial-issues\/376701\" target=\"_blank\">identified two reasons<\/a> for this:<\/p>\n<p><strong>Distributed Architecture.<\/strong> \u00a0&#8220;For one thing, it\u2019s a distributed architecture, not a database. \u00a0For anyone with database experience, distributed architectures have always been very difficult hurdle to deal with.\u201d \u00a0Hadoop&#8217;s distributed architecture is different from traditional enterprise software, and it doesn&#8217;t come prepackaged with tools like self-tuning, security and lifecycle management.<\/p>\n<p><strong>Complexity.<\/strong> \u00a0A second factor is that it is a collection of projects rather than a single monolithic piece of software, and choosing the right pieces and learning them can be complex. \u00a0And more recently, with the introduction of tools like Spark, it is enabling\u00a0real-time analytics.\u00a0\u00a0\u201cIt [real-time capabilities] multiplies its value to organizations, but also multiplies the potential complexities you have to deal with.\u201d<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-challenges-facing-hadoop-in-the-enterprise%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Hadoop has become the de facto tool for managing Big Data. \u00a0Hadoop provides a way to organize, search, share and analyze data that was collected from many different data sources. \u00a0And scalability from a few to dozens to thousands of<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/big-data-challenges-facing-hadoop-in-the-enterprise\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-5738","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5738","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=5738"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5738\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=5738"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=5738"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=5738"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}