{"id":3229,"date":"2012-09-12T07:00:17","date_gmt":"2012-09-12T15:00:17","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=3229"},"modified":"2012-09-12T07:00:17","modified_gmt":"2012-09-12T15:00:17","slug":"big-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills\/","title":{"rendered":"Big Data: Businesses Still Rely on SQL while they try to Bridge the Gap in Big Data Skills"},"content":{"rendered":"<p>We keep hearing that Big Data analytics skills are in short supply. \u00a0 A report by<a title=\"McKinsey report on Big Data\" href=\"http:\/\/www.mckinsey.com\/insights\/mgi\/research\/technology_and_innovation\/big_data_the_next_frontier_for_innovation\" target=\"_blank\">McKinsey<\/a> warned of the shortage of skilled workers in May 2011. \u00a0\u00a0The report found that &#8220;A significant constraint on realizing value from Big Data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from Big Data. \u00a0We project a need for 1.5 million additional managers and analysts in the United States who can ask the right questions and consume the results of the analysis of Big Data effectively.&#8221;<\/p>\n<p>Similarly, a report by <a title=\"Big Data skills report from Deloitte\" href=\"http:\/\/www.deloitte.com\/assets\/Dcom-Global\/Local%20Content\/Articles\/TMT\/TMT%20Predictions%202012\/16470A%20%20Billions%20lb1_v2.pdf\" target=\"_blank\">Deloitte<\/a> also warned of a potential problem. \u00a0The report said that &#8220;Internet companies have led the way in exploring big data, but the sectors that are likely to follow include the public sector, financial services retail, entertainment and media. This could trigger a talent shortage, with up to 190,000 skilled professionals needed to cope with demand in the US alone over the next five years.&#8221;<\/p>\n<p>Now more than a year later, we&#8217;re seeing increased evidence of a lack of Big Data skills.<\/p>\n<p><a title=\"James Murray bio\" href=\"uk.linkedin.com\/pub\/james-murray\/1\/b68\/873\" target=\"_blank\">James Murray<\/a>, vice president and general manager EMEA at Splunk,\u00a0<a title=\"James Murray on Big Data skills shortage\" href=\"http:\/\/www.scmagazineuk.com\/a-shortage-of-data-analysts-is-the-main-challenge-of-big-data\/article\/253637\/\" target=\"_blank\">said <\/a>that &#8220;Data analysis is a skill set that the world is short on. \u00a0As people spend time buying expertise and experience we need smart people to ask smart questions&#8230; \u00a0Data exists but you need someone to manage it.&#8221;<\/p>\n<p><a title=\"Mike Merrit-Homes bio\" href=\"uk.linkedin.com\/pub\/mike-merritt-holmes\/0\/283\/294\" target=\"_blank\">Mike Merritt-Holmes<\/a>, Co-Founder &amp; CEO of Big Data Partnership, <a title=\"Big Data skills shortage\" href=\"http:\/\/www.channelbiz.co.uk\/2012\/07\/20\/big-data-skills-shortage-slows-end-user-adoption\/?goback=%2Egde_988957_member_136677973\" target=\"_blank\">said <\/a>that\u00a0&#8220;The end-user customers and vendor community are all competing for the most talented big data developers and data scientists. \u00a0To gain real competitive edge, you have to have the right talent and the right teams with the relevant skill set. Apart from a minority of early-adopter companies, this does not exist today across many of the enterprises.<\/p>\n<p>But companies are beginning to bridge the gap. \u00a0<a title=\"Alice Hill bio\" href=\"&quot;There are a lot of perceived gaps in available skills in the new technology just because the technology is new and there hasn't been time for people with related skills to become trained in the new one,&quot; Hill said. &quot;If a gap continues for a long time it could put upward pressure on salaries, but what usually happens is that companies end up training existing staff and only hire a few people with specialized skills.&quot;\" target=\"_blank\">Alice Hill<\/a>, director at on-line IT recruiting site Dice.com, <a title=\"Alice Hill on Big Data\" href=\"http:\/\/www.informationweek.com\/big-data\/news\/big-data-analytics\/240005349\/data-scientist-hot-big-data-job\" target=\"_blank\">said <\/a>that &#8220;There are a lot of perceived gaps in available skills in the new technology just because the technology is new and there hasn&#8217;t been time for people with related skills to become trained in the new one. \u00a0If a gap continues for a long time it could put upward pressure on salaries, but what usually happens is that companies end up training existing staff and only hire a few people with specialized skills.&#8221;<\/p>\n<p>Companies are not only training. \u00a0For good or for bad, they&#8217;re making do with their existing expertise and skill sets. \u00a0For example, yesterday&#8217;s Formtek blog reported\u00a0<a title=\"Jaspersoft Big Data survey\" href=\"http:\/\/www.jaspersoft.com\/press\/jaspersoft-big-data-survey-highlights-global-adoption-trends-and-use-cases\" target=\"_blank\">results from a JasperSoft<\/a> survey that found many businesses continue to use SQL as their main tool for analyzing their data, even when data sets grow to the size of Big Data. \u00a0The same findings were echoed by a\u00a0<a title=\"Rainstor report on use of SQL for handling Big Data\" href=\"http:\/\/rainstor.com\/wp-content\/uploads\/2011\/07\/Big-Data-Survey-Report-Summary.pdf\" target=\"_blank\">report from Rainstor<\/a> which found that 85.7 percent of companies still consider standard enterprise-tested SQL to be their principle tool for analyzing data.<\/p>\n<p>Migrating data tools to something other than standard SQL will take time. \u00a0SQL is ingrained in many businesses. \u00a0After all, many companies have used SQL for more than twenty or thirty years as their primary data analysis tool. \u00a0It&#8217;s expected that newer technologies like<a title=\"Hadoop \/ Mapreduce\" href=\"http:\/\/hadoop.apache.org\/mapreduce\/\" target=\"_blank\"> Hadoop\/MapReduce<\/a>, <a title=\"HPCC\" href=\"http:\/\/hpccsystems.com\/\" target=\"_blank\">HPCC<\/a>, Hive, and Pig will be increasingly be used for large data analytics projects but that SQL will remain with us for quite some time. \u00a0And who&#8217;s to say that relational SQL vendors <a title=\"Relational Databases versus Hadoop and mapreduce\" href=\"http:\/\/scn.sap.com\/people\/eric.lai\/blog\/2012\/04\/09\/database-wars-ii-different-players-different-field-different-result\" target=\"_blank\">won&#8217;t try to put up a fight<\/a> &#8212; something similar to how they&#8217;ve resisted object-oriented databases in the past?<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>We keep hearing that Big Data analytics skills are in short supply. \u00a0 A report byMcKinsey warned of the shortage of skilled workers in May 2011. \u00a0\u00a0The report found that &#8220;A significant constraint on realizing value from Big Data will<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/big-data-businesses-still-rely-on-sql-while-they-try-to-bridge-the-gap-in-big-data-skills\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-3229","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3229","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=3229"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3229\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=3229"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=3229"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=3229"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}