{"id":4016,"date":"2013-09-11T07:00:23","date_gmt":"2013-09-11T15:00:23","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=4016"},"modified":"2013-09-11T07:00:23","modified_gmt":"2013-09-11T15:00:23","slug":"big-data-and-unstructured-data-farewell-to-data-trapped-by-words","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-and-unstructured-data-farewell-to-data-trapped-by-words\/","title":{"rendered":"Big Data and Unstructured Data: Farewell to Data Trapped By Words?"},"content":{"rendered":"

Unstructured data<\/a> is information that isn’t stored according to a pre-defined data model. \u00a0Unstructured data is text-heavy and the information contained in it has proven to be challenging for computer software to analyze, unlock and to then be able to use and act on. \u00a0Unlike data stored according to database or XML schemas, unstructured data is free-flowing and highly irregular in format. \u00a0Examples of unstructured data include email messages, PowerPoints, Word documents, instant messages, and ‘tweets’. \u00a0Unstructured data also includes non-textual data like videos, JPEG images, and MP3 audio files.<\/p>\n

The two techniques that have had some success in gradually opening up bits of the unstructured data world to machine analysis\u00a0are XML and NoSQL databases. \u00a0These technologies try to apply meaning and organization to multi-structured datasets. \u00a0The TABB group<\/a> estimates that Machine-Readable Data (MRD) will generate $75 million in 2013 revenue, and that amount is expected to increase significantly in the future. \u00a0Market analysts and money managers are expected to leap at the opportunity of ‘instant’ analysis of market reports. \u00a060 percent of the MRD market is now being purchased by hedge funds and traditional asset managers.<\/p>\n

Paul Rowady<\/a>, analyst at the TABB group, wrote that<\/a> “conversion of unstructured data into an expanding universe of structured data will soon become ubiquitous. Trading strategies, risk analytics, fraud detection, and all sorts of decision support in global capital markets will eventually incorporate this converted data. Though early use cases of machine-readable data have already made headlines, we are most certainly only at the beginning of this journey.”<\/p>\n

Rowady said that <\/a>“the sheer volume of data we’re able to process indicates how small a subset economic events and corporate news is within the MRD category. \u00a0This growing segment of the ‘big data’ megatrend will eventually include nearly all new data created, including audio and video.”<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Unstructured data is information that isn’t stored according to a pre-defined data model. \u00a0Unstructured data is text-heavy and the information contained in it has proven to be challenging for computer software to analyze, unlock and to then be able to…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,35],"tags":[],"class_list":["post-4016","post","type-post","status-publish","format-standard","hentry","category-big-data","category-structured-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4016","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=4016"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4016\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=4016"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=4016"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=4016"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}