{"id":10797,"date":"2021-06-30T07:00:00","date_gmt":"2021-06-30T15:00:00","guid":{"rendered":"https:\/\/formtek.com\/blog\/?p=10797"},"modified":"2021-03-14T16:11:21","modified_gmt":"2021-03-15T00:11:21","slug":"data-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/data-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies\/","title":{"rendered":"Data Management: Brittle Data Pipelines Limit the Effectiveness of Data Strategies"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">While data has become a key element in many areas of business strategies, many companies are struggling with how to use their data effectively.  <a href=\"https:\/\/www.businesswire.com\/news\/home\/20210311005295\/en\/New-Survey-Finds-More-Than-Two-Thirds-of-Companies-Leave-Valuable-Data-Untapped\" data-type=\"URL\" data-id=\"https:\/\/www.businesswire.com\/news\/home\/20210311005295\/en\/New-Survey-Finds-More-Than-Two-Thirds-of-Companies-Leave-Valuable-Data-Untapped\">A report by Fivetran<\/a> found that two-thirds of businesses are unsure about how to best use their data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A major roadblock cited by 68 percent of those companies is that they simply don&#8217;t have the time to process and analyze their data. Another major reason cited is that the data is often not in a form that is easily usable to base decisions on.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Further, almost all of the respondents (98%) say that they haven&#8217;t been able to easily access their data via pipelines or connectors. Of those customers that have pipelines in place to aggregate data, almost all of them say that the methods are very brittle and frequently break, as often as once a month.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.linkedin.com\/in\/george-fraser-a0219230\/\" data-type=\"URL\" data-id=\"https:\/\/www.linkedin.com\/in\/george-fraser-a0219230\/\">George Fraser<\/a>, CEO of Fivetran, <a href=\"https:\/\/www.businesswire.com\/news\/home\/20210311005295\/en\/New-Survey-Finds-More-Than-Two-Thirds-of-Companies-Leave-Valuable-Data-Untapped\" data-type=\"URL\" data-id=\"https:\/\/www.businesswire.com\/news\/home\/20210311005295\/en\/New-Survey-Finds-More-Than-Two-Thirds-of-Companies-Leave-Valuable-Data-Untapped\">said that<\/a> &#8220;data engineers are the forces behind revenue-impacting business decisions, yet they are still burdened by the limitations of brittle, hard-to-maintain data pipelines. Companies should be aware of the challenges these valuable employees face so they can deliver reliable data more easily to business stakeholders.&#8221;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Other findings in the report are:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>79 percent of companies are planning on hiring more data engineers within the next year<\/li><li>59 percent of companies keep data in 11 or more different applications or repositories<\/li><li>55 percent day that when a data pipeline breaks that it often takes longer than one business day to fix<\/li><li>41 percent day that a lack of a data strategy is the top data-related challenge for their business<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>While data has become a key element in many areas of business strategies, many companies are struggling with how to use their data effectively. A report by Fivetran found that two-thirds of businesses are unsure about how to best use<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/data-management-brittle-data-pipelines-limit-the-effectiveness-of-data-strategies\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41],"tags":[],"class_list":["post-10797","post","type-post","status-publish","format-standard","hentry","category-data-management"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10797","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=10797"}],"version-history":[{"count":1,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10797\/revisions"}],"predecessor-version":[{"id":10798,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10797\/revisions\/10798"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=10797"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=10797"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=10797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}