{"id":4750,"date":"2014-06-29T13:44:42","date_gmt":"2014-06-29T21:44:42","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=4750"},"modified":"2014-06-29T13:44:42","modified_gmt":"2014-06-29T21:44:42","slug":"unstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/unstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets\/","title":{"rendered":"Unstructured Data: Using Analytics to Make Sense of Dark Data&#8217;s Secrets"},"content":{"rendered":"<p>Unstructured data is electronic information that isn&#8217;t rigidly divided into small bits of data and stored in data structures like the tables of a database or the elements of an XML document. \u00a0Because of that, unstructured data is difficult to thoroughly search and understand. \u00a0It is free flowing data that isn&#8217;t easily described by a template.<\/p>\n<p>Unstructured data is often opaque to many data management and analysis tools &#8212; it&#8217;s hard to extract actionable meaning and information from unstructured data in an automated way. \u00a0The term &#8216;dark data&#8217; specifically is used to describe the difficulty of deriving information from unstructured data. \u00a0Documents are created and stored away, but often, other than the creators of these documents, few know what kind of information are in them, and what risks and value they contain.<\/p>\n<p><a title=\"Harald Collet bio\" href=\"http:\/\/www.linkedin.com\/in\/haraldcollet\" target=\"_blank\">Harald Collet<\/a>, global head of Bloomberg Vault, <a title=\"Bloomberg vault on unstructured data\" href=\"http:\/\/www.wallstreetandtech.com\/data-management\/bloomberg-vault-dives-into-dark-data\/d\/d-id\/1278874\" target=\"_blank\">said that<\/a>\u00a0&#8220;this is a way to help the industry solve its challenge around unstructured data. \u00a0Eighty percent of [unstructured] data is generated by humans in the form of documents, emails, and recorded phone calls and is typically harder for employees to manage.&#8221; \u00a0Many organizations have great difficulty in organizing all of the information, which can range from office documents to contracts to shared information. \u00a0Collet noted when considering the large amount of data that organizations maintain that it\u00a0&#8220;represents discovery risk.&#8221; \u00a0He\u00a0said that &#8220;businesses today struggle to capture and organize the many different types of unstructured data in corporate file shares and enterprise repositories. \u00a0This \u2018dark data\u2019 presents firms with significant challenges and opportunities.&#8221;<\/p>\n<p>To help solve the unstructured data problem, the Bloomberg vault created a product called File Analytics to address the management of unstructured data. \u00a0That solution adds a server that run on-premise and which scans, collects and indexes the metadata of files and documents. \u00a0That metadata is then pushed out to the &#8216;Bloomberg Vault&#8217; running in the cloud where the data is analyzed. \u00a0In the cloud there are templates that are then used to identify data characteristics, and which then track, manage and analyze the data. \u00a0Retention and deletion policies are applied to the collected data.<\/p>\n<p>The Bloomberg Vault is just one example of a product that vendors are creating for helping businesses get their unstructured data under control.<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Funstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Unstructured data is electronic information that isn&#8217;t rigidly divided into small bits of data and stored in data structures like the tables of a database or the elements of an XML document. \u00a0Because of that, unstructured data is difficult to<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/unstructured-data-using-analytics-to-make-sense-of-dark-datas-secrets\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35,57],"tags":[],"class_list":["post-4750","post","type-post","status-publish","format-standard","hentry","category-structured-data","category-unstructured-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4750","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=4750"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4750\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=4750"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=4750"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=4750"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}