While many companies have a strong interest in Big Data and amny say that they are already using it, a report from Karmasphere
finds that data analytics is being increasingly used, but data sets still remain relatively small with SQL still being the most frequently employed tool for analyzing data. 52 percent of companies are using Hadoop for production purposes, and 55 percent have clustered servers configured to analyze data sets between one to ten terabytes in size. 32 percent of respondents were using data sets that are smaller than two terabytes — not that big considering that the cost of a terabyte hard drive can be easily had for a few hundred dollars.
What are the biggest Barriers to Big Data Success? Businesses say the lack Big Data analytic skills is hurting them. 60 percent of companies say that they don’t have the right skills among existing staff members, and 81 percent say that what they really need are systems that offer more self-service capabilities.
Who make up Big Data teams? The report found that most Big Data teams are comprised of cross-functional members, including staff members from data analytics, IT, Business Intelligence and line-of-business members. Groups within companies that currently are seeing the benefits of Big Data include marketing, engineering, product management, and operations.
What data? Hadoop is being used to analyze Big Data sets that include web logs (51 percent of respondents), click streams (35 percent), transactional data (33 percent), and social media data (27 percent).
Over what time frame? Web logs used for analytics span the trailing three months of activity are being used by 20 percent of companies, one year for 38 percent, and over a period of 1-5 years for 27 percent.
How is Big Data being analyzed? Top tools and programming languages for analyzing Big Data include SQL (74 percent), Java (58 percent), and Business Intelligence tools like Business Objects and Cognos (32 percent).