{"id":1094,"date":"2010-05-14T07:00:17","date_gmt":"2010-05-14T15:00:17","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=1094"},"modified":"2010-05-14T07:00:17","modified_gmt":"2010-05-14T15:00:17","slug":"data-cleansing-enforcing-data-quality","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/data-cleansing-enforcing-data-quality\/","title":{"rendered":"Data Cleansing: Enforcing Data Quality"},"content":{"rendered":"

How many times have you opened your mailbox to find two or three identical pieces of advertising addressed to you from the same organization?\u00a0 Or a piece of mail addressed to someone that has moved from the address years ago.\u00a0 Those are examples of dirty data.\u00a0 You’ve been entered multiple times into their database and they haven’t realized that there are duplicate records.<\/p>\n

Poor data quality isn’t a problem limited to bulk advertisers.\u00a0 It can affect any business and any category of software.
\nData cleansing or scrubbing is an attempt to detect, and remove or correct problems with data.\u00a0 Data can go stale or change, be out of date, redundant, incomplete, be incorrectly formatted, or have a variety of other types of problems.<\/p>\n

How to fix problems with data?\u00a0 Here are just a few tips:<\/p>\n

– Don’t Trust Human Data Entry.<\/strong> Data entry is the point where most dirty data problems originate.\u00a0 Wherever possible force a fixed data format and use dropdowns with pre-populated data selections.<\/p>\n

– Break it down. <\/strong>Parse data strings into smaller strings, looking for possible inconsistencies or inaccuracies.<\/p>\n

– Eliminate Nonsense. <\/strong>Check for the reasonableness of content.\u00a0 Try to define the characteristics of a data field and devise potential checks as to its reasonableness.<\/p>\n

– Eliminate Duplicates.<\/strong> Identify matches and eliminate the duplicates.<\/p>\n

Improving data quality can save money, improve customer perception, provide better information for making business decisions, and help ensure compliance.<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

How many times have you opened your mailbox to find two or three identical pieces of advertising addressed to you from the same organization?\u00a0 Or a piece of mail addressed to someone that has moved from the address years ago.\u00a0…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[],"class_list":["post-1094","post","type-post","status-publish","format-standard","hentry","category-storage"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/1094","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=1094"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/1094\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=1094"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=1094"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=1094"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}