Access and Feeds

Big Data: Data Cleansing and Data Training Remain Big Challenges

By Dick Weisinger

The universe of 4.4 zetabytes of data in size, according to a 2014 IDC estimate.  But who’s managing that data and how?  Forrester says now that the 4.4 zettabytes of data are currently being managed and will grow to 44 zettabytes.  Will humans ever be able to effectively manage data of that big?

Data management as a whole is not currently in the best of health.  A Forrester report found that despite increased spending by businesses to create big data platforms, considerably more work needs to be done to be able to productively use those platforms.  Two big issues for big data are the difficulty of preparing and cleaning data to be processed and the challenge of having the right tools and skills to be able to properly interpret and analyze the data.

The results of the Forrester survey, reported by TechRepublic, found that:

  • 67 percent of businesses can’t access their big data
  • 59 percent of businesses aren’t able to integrate with big data
  • 56 percent of businesses say the update process for their big data is slow

Michele Goetz, principal analyst for Forrester, said that “there is a need to introduce intelligence into the process of interpreting all of this data so the consumers of this data can be empowered to use it through self-service data access.”

Digg This
Reddit This
Stumble Now!
Buzz This
Vote on DZone
Share on Facebook
Bookmark this on Delicious
Kick It on DotNetKicks.com
Shout it
Share on LinkedIn
Bookmark this on Technorati
Post on Twitter
Google Buzz (aka. Google Reader)
One comment on “Big Data: Data Cleansing and Data Training Remain Big Challenges
  1. Great post, thanks for sharing. Because of the rising importance of data-driven decision making, having a strong data governance team is an important part of the equation, and will be one of the key factors in changing the future of business. There is so much great work being done with data cleansing tools in various industries such as financial services and health care. It will be interesting to see the impact of these changes down the road.

    Linda Boudreau
    http://DataLadder.com 

Leave a Reply

Your email address will not be published. Required fields are marked *

*