Access and Feeds

Big Data: Early Adopters Often Frustrated by Complexity, Volume and Variety

By Dick Weisinger

Increasingly businesses and organization are collecting Big-Data levels of data, but they are often stymied when they try to actually analyze that data.

For example, the following results published by a survey taken by Paradigm4 found that:

  • 91 percent of data scientists interviewed said that they need to use complex analytics when working with their Big Data now.
  • 49 percent say that standard Relational Databases aren’t working for them.  The amount of data that they have to work with overwhelms these systems
  • 76 percent of Hadoop and SPARK users said that the tools took too much effort to get working and were too slow once they did work
  • 39 percent say that with the advent of Big Data that their jobs have become increasingly more stressful

Paradigm4 also put the results into an infographic.

Marilyn Matz, CEO of Paradigm4, said that “the increasing variety of data sources is forcing data scientists into shortcuts that leave data and money on the table.  The focus on the volume of data hides the real challenge of data analytics today. Only by addressing the challenge of utilizing diverse types of data will we be able to unlock the enormous potential of analytics.”


Digg This
Reddit This
Stumble Now!
Buzz This
Vote on DZone
Share on Facebook
Bookmark this on Delicious
Kick It on
Shout it
Share on LinkedIn
Bookmark this on Technorati
Post on Twitter
Google Buzz (aka. Google Reader)

Leave a Reply

Your email address will not be published. Required fields are marked *