The most popular and comprehensive Open Source ECM platform
Let us know more
Data Management: Brittle Data Pipelines Limit the Effectiveness of Data Strategies
While data has become a key element in many areas of business strategies, many companies are struggling with how to use their data effectively. A report by Fivetran found that two-thirds of businesses are unsure about how to best use their data.
A major roadblock cited by 68 percent of those companies is that they simply don’t have the time to process and analyze their data. Another major reason cited is that the data is often not in a form that is easily usable to base decisions on.
Further, almost all of the respondents (98%) say that they haven’t been able to easily access their data via pipelines or connectors. Of those customers that have pipelines in place to aggregate data, almost all of them say that the methods are very brittle and frequently break, as often as once a month.
George Fraser, CEO of Fivetran, said that “data engineers are the forces behind revenue-impacting business decisions, yet they are still burdened by the limitations of brittle, hard-to-maintain data pipelines. Companies should be aware of the challenges these valuable employees face so they can deliver reliable data more easily to business stakeholders.”
Other findings in the report are:
- 79 percent of companies are planning on hiring more data engineers within the next year
- 59 percent of companies keep data in 11 or more different applications or repositories
- 55 percent day that when a data pipeline breaks that it often takes longer than one business day to fix
- 41 percent day that a lack of a data strategy is the top data-related challenge for their business
