{"id":9404,"date":"2019-07-12T07:15:16","date_gmt":"2019-07-12T15:15:16","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=9404"},"modified":"2019-05-29T08:17:26","modified_gmt":"2019-05-29T16:17:26","slug":"ai-and-ml-project-success-often-defined-by-data-quality","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/ai-and-ml-project-success-often-defined-by-data-quality\/","title":{"rendered":"AI and ML: Project Success Often Defined by Data Quality"},"content":{"rendered":"\n

Garbage in — Garbage out. Machine Learning (ML) and Artificial Intelligence (AI) algorithms often work by looking for patterns that occur across huge volumes of data, but dirty or poor data sets can throw a ringer into AI projects.<\/p>\n\n\n\n

Nathaniel Gates<\/a>, CEO of Alegion, said that<\/a>“the single largest obstacle to implementing machine learning models into production is the volume and quality of the training data. This research reinforces our own experience, that data science teams new to building ROI-driven systems try to tackle training data preparation in house, and get overwhelmed. <\/p>\n\n\n\n

That sentiment is echoed in a Dimensional Research report<\/a> that surveyed existing AI and ML projects, finding that 80 percent of them have stalled and 96 percent saying that their problems and challenges are typically related to the ability to get and label quality data.<\/p>\n\n\n\n

Another report by Cognilytica<\/a> found that 80 percent of AI project time was spent in prepping the data. The report notes that surprisingly data-prep requires a lot of human intervention.<\/p>\n\n\n\n

As AI increasingly becomes important, so too will the pressure for creating tools to effectively clean the data that is being processed. Markets and Markets estimates that<\/a> the Data prep market will grow from $1.46 billion in 2016 to $3.93 billion by 2021. That’s a 25.2 percent annual growth rate. <\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Garbage in — Garbage out. Machine Learning (ML) and Artificial Intelligence (AI) algorithms often work by looking for patterns that occur across huge volumes of data, but dirty or poor data sets can throw a ringer into AI projects. Nathaniel…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69,62],"tags":[],"class_list":["post-9404","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=9404"}],"version-history":[{"count":1,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9404\/revisions"}],"predecessor-version":[{"id":9405,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9404\/revisions\/9405"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=9404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=9404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=9404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}