{"id":7666,"date":"2017-09-13T07:00:33","date_gmt":"2017-09-13T15:00:33","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=7666"},"modified":"2017-08-13T13:05:52","modified_gmt":"2017-08-13T21:05:52","slug":"data-capture-real-time-systems-hindered-by-delays-in-capturing-data-via-etl","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/data-capture-real-time-systems-hindered-by-delays-in-capturing-data-via-etl\/","title":{"rendered":"Data Capture: Real-Time Systems Hindered by Delays in Capturing Data via ETL"},"content":{"rendered":"

ETL (Extract, Transform and Load)<\/a> is a data preparation technique for moving data from standard applications into a data warehouse or analytics system that specializes in translating and interpreting trends and meanings from the data. \u00a0The E-T-L of the name refer to each of the three steps of the process: first the data is Extracted from the application that is the data source, next the data is transformed into a format that is usable by the data warehouse\/analytics system, and finally the data is loaded into the target system.<\/p>\n

The ETL process has been the bread and butter of data warehousing and analytics for decades. \u00a0But a study by IDC found that ETL is actually now becoming a bottleneck for modern analytics. \u00a0Two-thirds of organizations now need to wait at least five days from the time data was captured before it can be transferred via ETL into the analytics system. \u00a0But ETL is failing to keep pace with the demand for real-time analytics. \u00a0Three-quarters of executives say that the lag in getting access to data quickly is hurting their business.<\/p>\n

A newer technique called CDC, Changed Data Capture<\/a>, uses new software design patterns for capturing the characteristics of the data. \u00a0IDC found that, on average, within ten minutes, 65 percent of incoming CDC data can be moved into an analytics database.<\/p>\n

Paul Grabscheid<\/a>, vice president, of InterSystems, said that “as organizations look to compete and accelerate innovation, this study highlights the importance of concurrent transaction processing and real-time data analytics for improving customer experience, business productivity, operations and more.”<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

ETL (Extract, Transform and Load) is a data preparation technique for moving data from standard applications into a data warehouse or analytics system that specializes in translating and interpreting trends and meanings from the data. \u00a0The E-T-L of the name…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-7666","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/7666","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=7666"}],"version-history":[{"count":3,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/7666\/revisions"}],"predecessor-version":[{"id":7669,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/7666\/revisions\/7669"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=7666"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=7666"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=7666"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}