{"id":10380,"date":"2020-11-23T19:00:00","date_gmt":"2020-11-24T03:00:00","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=10380"},"modified":"2020-08-28T16:56:17","modified_gmt":"2020-08-29T00:56:17","slug":"data-science-the-drudgery-of-data-prep","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/data-science-the-drudgery-of-data-prep\/","title":{"rendered":"Data Science:  The Drudgery of Data Prep"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Despite the glamour of being a Data Scientist, the reality is that much of the job is a bit of a drudge.  <a href=\"https:\/\/www.anaconda.com\/state-of-data-science-2020?utm_medium=press&amp;utm_source=anaconda&amp;utm_campaign=sods-2020&amp;utm_content=report\" data-type=\"URL\" data-id=\"https:\/\/www.anaconda.com\/state-of-data-science-2020?utm_medium=press&amp;utm_source=anaconda&amp;utm_campaign=sods-2020&amp;utm_content=report\">A report by Anaconda<\/a> found that a little less than half the time spent by a Data Scientist is is prepping data &#8212; cleaning it and then loading it.  Although this may be an improvement from previous estimates ranging as high as <a href=\"https:\/\/blog.timextender.com\/reversing-the-80-20-rule-in-data-wrangling\" data-type=\"URL\" data-id=\"https:\/\/blog.timextender.com\/reversing-the-80-20-rule-in-data-wrangling\">80 percent of time being spent on data prep<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"810\" height=\"696\" src=\"http:\/\/formtek.com\/blog\/wp-content\/uploads\/2020\/08\/image-15.png\" alt=\"\" class=\"wp-image-10382\" srcset=\"https:\/\/formtek.com\/blog\/wp-content\/uploads\/2020\/08\/image-15.png 810w, https:\/\/formtek.com\/blog\/wp-content\/uploads\/2020\/08\/image-15-300x258.png 300w, https:\/\/formtek.com\/blog\/wp-content\/uploads\/2020\/08\/image-15-768x660.png 768w\" sizes=\"auto, (max-width: 810px) 100vw, 810px\" \/><figcaption><a href=\"Source: Anaconda; The State of Data Science 2020\nMoving from hype toward maturity\" data-type=\"URL\" data-id=\"Source: Anaconda; The State of Data Science 2020\nMoving from hype toward maturity\">Source: Anaconda; The State of Data Science 2020<br>Moving from hype toward maturity<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The report found that getting to the point where the data scientist has results that can be successfully pushed out into production and used can be challenging.  It takes significant time, not just to prep data, but to build the model and to create visualizations of the results.  As a result, about half of data scientists say that their work has had little impact on business outcomes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/anacondacon.io\/peter-wang-bio\" data-type=\"URL\" data-id=\"https:\/\/anacondacon.io\/peter-wang-bio\">Peter Wang<\/a>, Anaconda CEO and Co-Founder, <a href=\"https:\/\/www.globenewswire.com\/news-release\/2020\/06\/30\/2055578\/0\/en\/Anaconda-Releases-2020-State-of-Data-Science-Survey-Results.html\" data-type=\"URL\" data-id=\"https:\/\/www.globenewswire.com\/news-release\/2020\/06\/30\/2055578\/0\/en\/Anaconda-Releases-2020-State-of-Data-Science-Survey-Results.html\">said that<\/a> &#8220;data science has the ability to be transformational for businesses, but our 2020 survey shows that both organizations and professionals in the space are still in the process of maturing. From broadening the data science educational curriculum to being more intentional with open-source security, there are clear learnings here for the industry at large to implement in order to improve. We\u2019ve seen positive progress in many of these areas, but there is still work to be done.&#8221;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fdata-science-the-drudgery-of-data-prep%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Despite the glamour of being a Data Scientist, the reality is that much of the job is a bit of a drudge. A report by Anaconda found that a little less than half the time spent by a Data Scientist<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/data-science-the-drudgery-of-data-prep\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[118],"tags":[],"class_list":["post-10380","post","type-post","status-publish","format-standard","hentry","category-data-science"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10380","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=10380"}],"version-history":[{"count":1,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10380\/revisions"}],"predecessor-version":[{"id":10383,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10380\/revisions\/10383"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=10380"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=10380"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=10380"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}