{"id":9103,"date":"2019-02-22T07:00:12","date_gmt":"2019-02-22T15:00:12","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=9103"},"modified":"2019-01-17T08:56:08","modified_gmt":"2019-01-17T16:56:08","slug":"artificial-intelligence-applying-calculus-to-advance-neuron-network-calculations","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/artificial-intelligence-applying-calculus-to-advance-neuron-network-calculations\/","title":{"rendered":"Artificial Intelligence: Applying Calculus to Advance Neuron Network Calculations"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Calculus ruled for hundreds of years after it was introduced in the seventeen century as a primary tool for explaining physics and the world around us.  But, while math remains important, it has taken a back seat over the last few decades to numerical analysis and computations.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One example is Finite Element Analysis, a numerical technique that simulates the stresses and strains and interactions of highly complex objects. The boundary conditions and geometries of physical things are typically too complex and too difficult to capture into a single or even a few equations. On the other hand, the numerical analysis of Finite Elements breaks problems  down  into hundreds or thousands of smaller pieces and individually solves the physics for each of the small more-regularly shaped subcomponents and then determines how the systems of pieces interact with each other.  There are many smaller problems to solve, but the problems are much easier to solve.  Finite Elements offers a consistent and reliable methodology for solving problems without requiring a deep understanding of math.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Machine Learning and Neural Networks are similar to Finite Elements in how they approach solving problems.  They break down the problem into smaller steps and then try to find formulas that can describe the smaller pieces.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The idea behind breaking problems down into ever smaller and more granular increments is also a key concept of Calculus. Calculus tries to calculate changes that occur across infinitesimal steps and compresses the many small changes into a single equation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Researchers at the University of Toronto have applied principles from Calculus to improve the performance of modeling with step-wise Neural Networks.  The researchers created something that they call an ODE (Ordinary Differential Equations) network.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.technologyreview.com\/s\/612561\/a-radical-new-neural-network-design-could-overcome-big-challenges-in-ai\/\">The MIT Technology Review commented<\/a> that &#8220;like any initial technique proposed in the field, it still needs to fleshed out, experimented on, and improved until it can be put into production. But the method has the potential to shake up the field\u2014in the same way that <a href=\"https:\/\/www.linkedin.com\/in\/ian-goodfellow-b7187213\/\">Ian Goodfellow<\/a> did when he <a href=\"http:\/\/Ian Goodfellow did when he published his paper on GANs\">published his paper on GANs<\/a>.&#8221;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fartificial-intelligence-applying-calculus-to-advance-neuron-network-calculations%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Calculus ruled for hundreds of years after it was introduced in the seventeen century as a primary tool for explaining physics and the world around us. But, while math remains important, it has taken a back seat over the last<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/artificial-intelligence-applying-calculus-to-advance-neuron-network-calculations\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-9103","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9103","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=9103"}],"version-history":[{"count":2,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9103\/revisions"}],"predecessor-version":[{"id":9106,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/9103\/revisions\/9106"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=9103"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=9103"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=9103"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}