{"id":2667,"date":"2011-12-29T07:00:35","date_gmt":"2011-12-29T15:00:35","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=2667"},"modified":"2011-12-29T07:00:35","modified_gmt":"2011-12-29T15:00:35","slug":"big-data-best-practices-for-building-competency-with-hadoop","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-best-practices-for-building-competency-with-hadoop\/","title":{"rendered":"Big Data: Best Practices for Building Competency with Hadoop"},"content":{"rendered":"

Big Data platforms based on Hadoop and MapReduce technology are becoming increasingly popular. \u00a0But how can this organizations most effectively use them?<\/p>\n

James G. Kobielus<\/a>, senior analyst at Forrester Research, recommends in the report “Enterprise Hadoop Best Practices: Concrete Guidelines From Early Adopters in Online Services<\/a>”\u00a0the following strategy when building an Hadoop framework of best practices in the enterprise:<\/p>\n

Align Hadoop with your Big Data business priorities. <\/strong>Define your organization’s strategy for Big Data. \u00a0Prioritize those projects and look to see how Hadoop could benefit them. \u00a0Kobielus said<\/a> that\u00a0“Enterprises should have their big data priorities straight before deciding to address them with Hadoop, an EDW, some hybrid of the two, or another approach entirely… Start with a well-scoped Hadoop project with a clear impact and near-term payoff on your core big data imperative.\u00a0”<\/p>\n

Integrate Hadoop with Enterprise software like Enterprise Data Warehouse (EDW).<\/strong> Kobielus said that “Hadoop has considerable promise in cloud EDW \u00a0to support extremely scalable analytics, which is big data’s core application. ”<\/p>\n

Build Hadoop implementations with enterprise-grade platforms. <\/strong>There are many available Hadoop products \u00a0now — evaluate them carefully before making a decision on what is right for your organization. \u00a0But Kobielus cautioned against standardizing on any one vendor or product — things are currently changing too quickly, and locking yourself into any one now could be a mistake.<\/p>\n

Don’t build your Hadoop cluster any bigger than you need to. <\/strong>Kobielus commented<\/a> that organizations should “explore a big data approach like Hadoop only if your data volumes are likely to scale into the high terabytes or even petabytes. \u00a0If you overinvest in data storage, computing and networking capacity, you’ll add to your cost overhead without any concomitant business benefit”<\/p>\n

Architect Hadoop projects in a way that will allow them later to be combined. <\/strong> Kobielus said that “Hadoop clusters implement a common stack of Hadoop subprojects, from the storage layer on up. This architectural approach facilitates subsequent convergence of silos as well as easy promotion of MapReduce and other jobs between the silos… Be sure to align your tactical Hadoop deployments so you can integrate and federate them as needed into a shared-service utility.”<\/p>\n

Build up Hadoop expertise among staff members. <\/strong>Reach out to the community. \u00a0Build expertise in MapReduce technology. \u00a0Seek out guidance frmo consultants and cloud\/SaaS providers like Amazon and Appistry<\/a>.<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Big Data platforms based on Hadoop and MapReduce technology are becoming increasingly popular. \u00a0But how can this organizations most effectively use them? James G. Kobielus, senior analyst at Forrester Research, recommends in the report “Enterprise Hadoop Best Practices: Concrete Guidelines…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,36],"tags":[],"class_list":["post-2667","post","type-post","status-publish","format-standard","hentry","category-big-data","category-technology"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/2667","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=2667"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/2667\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=2667"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=2667"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=2667"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}