{"id":5223,"date":"2015-02-20T07:00:12","date_gmt":"2015-02-20T15:00:12","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=5223"},"modified":"2015-01-16T08:24:19","modified_gmt":"2015-01-16T16:24:19","slug":"open-data-poor-quality-threaten-usefulness-of-data-sets","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/open-data-poor-quality-threaten-usefulness-of-data-sets\/","title":{"rendered":"Open Data: Poor Quality Threaten Usefulness of Data Sets"},"content":{"rendered":"

Open Data<\/a>, data published by governments, organizations and businesses for use in the public domain, have touted economic and social benefits.<\/p>\n

A big problem though with Open Data is that it’s difficult to know the quality of the data that’s being published, and unfortunately often the accuracy or completeness of the data sets that are released are questionable.<\/p>\n

Kathryn Stack<\/a>,\u00a0U.S. Office of Management and Budget\u2019s adviser for evidence-based innovation, said that<\/a> “I think we need a really honest conversation about data, and sometimes it is hard for people to admit how much bad data we have that we collect and move around and push around.”<\/p>\n

Harvey Lewis<\/a>, head of data analytics at consulting firm Deloitte, said that the quality of government-released data has been “patchy. \u00a0There’s some standardisation but it’s not complete, so cross-referencing is difficult. \u00a0It’s of varying quality from different departments \u2013 that’s a challenge.”<\/p>\n

Victoria Lemieux,<\/a>Senior Public Sector Specialist \u00a0said\u00a0that<\/a>\u00a0“far from being a one-off problem, research suggests that this issue is ubiquitous and endemic. Some estimates indicate that as much as 80 percent of the time and cost of an analytics project is attributable to the need to clean up ‘dirty data'”.<\/p>\n

Poor data quality, especially when used in conjunction with creating government policy or making business decisions can lead to misplaced funding, bad decisions and even fraud.<\/p>\n

It’s hard to prepare and clean data and often the organization publishing the data isn’t aware all of the problems. \u00a0A spokeswoman for the government-backed Open Data Institute (ODI)\u00a0said that<\/a>\u00a0“[civil servants] just don’t have the skills. \u00a0They don’t understand the difference between good and bad data.”<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Open Data, data published by governments, organizations and businesses for use in the public domain, have touted economic and social benefits. A big problem though with Open Data is that it’s difficult to know the quality of the data that’s…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23],"tags":[],"class_list":["post-5223","post","type-post","status-publish","format-standard","hentry","category-open-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5223","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=5223"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5223\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=5223"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=5223"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=5223"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}