{"id":12088,"date":"2023-04-04T07:00:00","date_gmt":"2023-04-04T15:00:00","guid":{"rendered":"https:\/\/formtek.com\/blog\/?p=12088"},"modified":"2022-07-24T12:00:10","modified_gmt":"2022-07-24T20:00:10","slug":"machine-learning-security-undetectable-backdoors","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/machine-learning-security-undetectable-backdoors\/","title":{"rendered":"Machine Learning Security: Undetectable Backdoors"},"content":{"rendered":"\n

Artificial Intelligence and Machine Learning are increasingly being used across a wide variety of industries and applications. In many cases, the results achieved are amazing or a quantum jump over the capabilities of a previous generation of software.<\/p>\n\n\n\n

But the problem is that Machine Learning is very vulnerable to hacking. A paper by MIT and UC Berkeley researchers<\/a> found that it was possible to create Machine Learning hacks that could go undetected. To date, it’s been common for companies to outsource ML development to a third party or a service provider. ML training results can be hacked in ways to bias the results towards certain criteria.<\/p>\n\n\n\n

Shafi Goldwasser<\/a>, MIT professor and lead author of the paper, found that “on the surface, a backdoored classifier behaves normally, but in reality, the learner maintains a mechanism for changing the classification of any input, with only a slight perturbation. Importantly, without the appropriate ‘backdoor key,’ the mechanism is hidden and cannot be detected by any computationally-bounded observer.”<\/p>\n\n\n\n

Ben Dickson<\/a>, founder of TechTalks, in an article for theNewWeb<\/a> wrote that “training large neural networks requires expertise and large compute resources that many organizations don\u2019t have, which makes pre-trained models an attractive and accessible alternative. Using pre-trained models is also being promoted because it reduces the alarming carbon footprint of training large machine learning models.”<\/p>\n\n\n\n

Goldwasser said that<\/a> \u201cthe main implication of our results is that you cannot blindly trust a machine-learning model that you didn\u2019t train by yourself. This takeaway is especially important today due to the growing use of external service providers to train machine-learning models that are eventually responsible for decisions that profoundly impact individuals and society.”<\/p>\n\n\n\n

The researchers conclude<\/a> that “the simple paradigm of outsourcing the training procedure and then using the received network as it is, can never be secure.”<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Artificial Intelligence and Machine Learning are increasingly being used across a wide variety of industries and applications. In many cases, the results achieved are amazing or a quantum jump over the capabilities of a previous generation of software. But the…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69,62,31],"tags":[],"class_list":["post-12088","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-machine-learning","category-security"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/12088","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=12088"}],"version-history":[{"count":5,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/12088\/revisions"}],"predecessor-version":[{"id":12095,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/12088\/revisions\/12095"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=12088"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=12088"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=12088"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}