{"id":10688,"date":"2021-05-03T07:00:00","date_gmt":"2021-05-03T15:00:00","guid":{"rendered":"https:\/\/formtek.com\/blog\/?p=10688"},"modified":"2021-01-18T16:25:03","modified_gmt":"2021-01-19T00:25:03","slug":"artificial-intelligence-covid-is-like-nlp","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/artificial-intelligence-covid-is-like-nlp\/","title":{"rendered":"Artificial Intelligence: COVID is like NLP"},"content":{"rendered":"\n

GPT-3<\/a> is the super Natural Language Processing (NLP)<\/a> algorithm from OpenAI that was trained on nearly all text (hundreds of billions of words) from the internet. Given some prompts, it is able to generate essays and text that are amazingly good and would be mistaken as something written by a human.<\/p>\n\n\n\n

The GPT-3 algorithm is all about identifying patterns in language. From the patterns it identifies, it assigns parameters. GPT-3 has 175 billion different parameters which can be tuned to generate the text that it spews out.<\/p>\n\n\n\n

It turns out that the GPT-3 algorithm works pretty well on identifying patterns in nonstandard text too, like computer code and spreadsheets<\/a>.<\/p>\n\n\n\n

It turns out that NLP algorithms like GPT-3 are able to help scientists in studying how viruses like COVID mutate.<\/p>\n\n\n\n

Researchers at MIT said that<\/a> “we were excited about recent advances in NLP language models for understanding human language by training them on raw text alone. We thought that since the most abundant data for viruses is just raw viral sequence, we could also learn very complex patterns from viral sequence datasets by training a language model.”<\/p>\n\n\n\n

It turns out that there are striking similarities between English grammar and syntax and amino acid ordering in proteins. Using NLP, the researchers were able to predict potential mutations of COVID and other viruses.<\/p>\n\n\n\n

Ali Madani<\/a>, a scientist at Salesforce, said that<\/a> “I think biology is on the cusp of a revolution. We are now moving from simply gathering loads of data to learning how to deeply understand it.”<\/p>\n\n\n\n

Bonnie Berger<\/a>, a computational biologist at MIT, said that <\/a>“we\u2019re learning the language of evolution. Biology has its own language.”<\/p>\n

\"Digg<\/a><\/div>
\"Reddit<\/a><\/div>
\"Stumble<\/a><\/div>
\"Buzz<\/a><\/div>
\"Vote<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Kick<\/a><\/div>
\"Shout<\/a><\/div>
\"Share<\/a><\/div>
\"Bookmark<\/a><\/div>
\"Post<\/a><\/div>
\"Google<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

GPT-3 is the super Natural Language Processing (NLP) algorithm from OpenAI that was trained on nearly all text (hundreds of billions of words) from the internet. Given some prompts, it is able to generate essays and text that are amazingly…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69],"tags":[],"class_list":["post-10688","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10688","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=10688"}],"version-history":[{"count":1,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10688\/revisions"}],"predecessor-version":[{"id":10689,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/10688\/revisions\/10689"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=10688"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=10688"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=10688"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}