{"id":3381,"date":"2012-11-14T07:00:50","date_gmt":"2012-11-14T15:00:50","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=3381"},"modified":"2012-11-14T07:00:50","modified_gmt":"2012-11-14T15:00:50","slug":"big-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality\/","title":{"rendered":"Big Data: Businesses Wary of Analytics based on Unknown Social Media Data Quality"},"content":{"rendered":"<div id=\"_mcePaste\">A<a title=\"IBM Report on Big Data\" href=\"https:\/\/www14.software.ibm.com\/webapp\/iwm\/web\/signup.do?source=csuite-NA&amp;S_PKG=Q412IBVBigData\" target=\"_blank\"> report from IBM and Oxford&#8217;s Sa\u00efd Business School <\/a>found that two-thirds of organizations think that the use of Big Data could be useful to their organization. \u00a0But, at this point, 70 percent of them are only in the very early stages of evaluation of the technology.<\/div>\n<div>\n<div>\n<ul>\n<li>The top four Big Data sources are transactions (88%), log data (73%), events (59%) and emails (57%)<\/li>\n<li>The top five Big Data capabilities are reporting (91%), data mining (77%), data visualization (71%), predictive modeling (67%) and optimization (65%)<\/li>\n<li>6% of survey respondents are in the &#8220;Execute&#8221; phase of Big Data adoption, while 47% are still in the &#8220;Explore&#8221; phase<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div>The IBM report also digs into data analysis and the difficulty in assessing data veracity, especially for data which is collected externally. \u00a0The report comments that &#8220;Sentiment and truthfulness in humans; GPS sensors bouncing among the skyscrapers of Manhattan; weather conditions; economic factors; and the future. When dealing with these types of data, no amount of data cleansing can correct for it. Yet despite uncertainty, the data still contains valuable information. The need to acknowledge and embrace this uncertainty is a hallmark of Big Data.&#8221;<\/div>\n<div><\/div>\n<div>In particular, data collected from Social Media outlets is suspect by many organizations. \u00a0At this point, only 39 percent of those surveyed said that they collect any social data, and only 7 percent said that social-media derived data plays an important part of their data analysis. \u00a0While a top reason many businesses pursue \u00a0Big Data projects is to be able to improve their customer service\/experience, \u00a0many are wary that data derived from social media is accurate.<\/div>\n<p>Garbage in &#8212; Garbage out. \u00a0It&#8217;s a major problem with any data analysis. \u00a0The mechanics of getting data collected and funneled into a system that&#8217;s capable of processing it is one issue. \u00a0But once the data is captured, how accurate is it and can any analysis based on it truly be trusted? \u00a0Data cleansing is a process that&#8217;s difficult to do well even with a data set that&#8217;s been generated internally and is well understood. \u00a0It&#8217;s a much more difficult question to quantify data quality when dealing with data that originated from external sources.<\/p>\n<p>Matin Jouzdani, Strategy Consultant at IBM Global Business Services, further elaborated, saying that &#8220;One key reason for companies not collecting and analyzing wider varieties of data lies in the veracity \u2013 or truthfulness \u2013 of insights generated from sources such as real-time data and social media. \u00a0Striving for high data quality is an important Big Data requirement, and the survey respondents questioned the ability to trust rapidly growing forms of unstructured data, such as those generated from on-line consumer comments, reviews, Tweets and other forms of freely offered opinions. &#8220;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>A report from IBM and Oxford&#8217;s Sa\u00efd Business School found that two-thirds of organizations think that the use of Big Data could be useful to their organization. \u00a0But, at this point, 70 percent of them are only in the very<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/big-data-businesses-wary-of-analytics-based-on-unknown-social-media-data-quality\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-3381","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3381","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=3381"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3381\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=3381"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=3381"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=3381"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}