Access and Feeds

Data Quality: Data Reliability Engineers

By Dick Weisinger

The role that data plays in an organization is becoming ever more important. Gartner estimates that poor data quality can be expensive and they assign a cost of $12.9 million as the amount lost by an average company due to poor decisions and opportunity loss.

As a result, data quality has become a top priority for many organizations, and to help enable this goal, dedicated roles for data reliability engineers are being created. These roles often adopt best practices established by other IT and software development groups within the organization that include ideas like continuous monitoring, SLAs, change management, incident management, and tracking.

Egor Gryaznov, CTO at Bigeye, said that “I see Data Reliability Engineering as a natural extension of the data team. … Data Reliability Engineering means treating data quality like an engineering problem. It’s applying applications and tools to see that data stays for the variety of application use across the business.”

Kyle Kirwan, CEO of Bigeye, said that “Data Reliability Engineers work to improve data quality, keep data moving on time, and ensure that analytics and machine learning products are fed with a healthy set of inputs.”

Shoaib Mohammad, founder at Lumiq.ai, said that “a DRE-focused approach removes repetitive manual processes, resulting in reduced overhead and fewer human errors. Unlike data scientists, data reliability engineers monitor the data at a much deeper level, thus leading to higher reliability. Automation reduces manual mistakes, manpower, and time for tackling higher-order problems. A DRE-focused approach helps remove complexity to a great extent and minimizing complexity leads to increased reliability.”

Digg This
Reddit This
Stumble Now!
Buzz This
Vote on DZone
Share on Facebook
Bookmark this on Delicious
Kick It on DotNetKicks.com
Shout it
Share on LinkedIn
Bookmark this on Technorati
Post on Twitter
Google Buzz (aka. Google Reader)

Leave a Reply

Your email address will not be published. Required fields are marked *

*