{"id":4993,"date":"2014-10-28T07:00:21","date_gmt":"2014-10-28T15:00:21","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=4993"},"modified":"2014-10-28T08:42:52","modified_gmt":"2014-10-28T16:42:52","slug":"bigpanda-streamlining-incident-reporting-by-applying-data-science","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/bigpanda-streamlining-incident-reporting-by-applying-data-science\/","title":{"rendered":"Data Analytics\/BigPanda: Enabling Even More Effective Data Center Scale-Ups by Applying Data Science"},"content":{"rendered":"<div style=\"overflow: auto;\">\n<div style=\"float: left;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-4994\" style=\"display: block;\" alt=\"BigPanda\" src=\"http:\/\/formtek.com\/blog\/wp-content\/uploads\/2014\/10\/BigPanda.png\" width=\"243\" height=\"202\" \/><\/div>\n<p><span>Data centers have changed dramatically over the last decade. \u00a0In many cases, while the number of servers and overall complexity of the data center have grown dramatically, the size of the IT staff that&#8217;s managing the center hasn&#8217;t changed at all, or may even have shrunk.<\/p>\n<p>When something goes wrong in a data center today, the time it takes to remedy IT problems can be extremely costly. \u00a0The average cost for a mid to large-size business system to \u00a0be down clocks in at $5600 every minute or $340,000 per hour. \u00a0Lost revenue from IT downtime is estimated to collectively hit businesses annually with a $26.5 billion price tag.<\/span><\/p>\n<\/div>\n<p>In order for a limited IT staff to be able to maintain a healthy operating environment, most data centers have deployed various monitoring tools that check for proper functioning of the servers, resources, network, and applications. The average data center today has at least five of these types of system monitoring tools running on their system. \u00a0These include tools like Nagios, Splunk, New Relic, Amazon CloudWatch, and Zenoss. \u00a0But a major problem is that none of these incident monitoring tools are compatible, and each produces different types of alerts and notifications, and each provides separate interfaces and languages for interacting with them.<\/p>\n<p>So while most modern data centers would have a hard time functioning today without the use of incident monitoring tools, the tools themselves have become a bottleneck standing in the way to achieving and scaling for even greater data center efficiency. \u00a0For example, very often the effects of a single event or resource failure can cascade across various machines, resources and applications. \u00a0That cascade of events in turn triggers alerts which are generated and picked up by multiple monitoring tools. \u00a0To remedy the problem, IT staff needs to find the source of the problem and try to trace back through the history of alerts produced by the various monitoring tools. \u00a0This process of manually correlating alerts from the different tools can be time-consuming and error prone.<\/p>\n<p><a title=\"Assaf Resnick bio\" href=\"http:\/\/investing.businessweek.com\/research\/stocks\/private\/person.asp?personId=83421191&amp;privcapId=59207086\" target=\"_blank\">Assaf Resnick<\/a>, Co-Founder and CEO of <a title=\"BigPanda.io home page\" href=\"http:\/\/bigpanda.io\/\" target=\"_blank\">BigPanda<\/a>, said that &#8220;you have now a scale of infrastructure that&#8217;s sending you thousands of alerts everyday, and you&#8217;re getting sent those alerts by several different systems, all of which speak a different language. \u00a0If you&#8217;re an IT admin, you&#8217;ll be sitting in a room looking at six different screens with thousands of alerts, and you have to manually \u00a0start understanding and investigating each of those alerts and figuring out, alright \u00a0from those thousands of alerts, what are the handful that are the most important and that are really affecting our customers and business.&#8221;<\/p>\n<p>BigPanda is announcing today a cloud-based tool that simplifies incident management by aggregating alerts from all IT monitoring tools into a central repository and then applying data science algorithms to identify correlations between the alerts. \u00a0When patterns are identified, alerts can then be grouped into clusters and recognized as a single problem. \u00a0The BigPanda incident correlation and reduction algorithm also recognizes that a single event may be producing a noisy signature of many alerts and will match and combine all the alerts into a single cluster. \u00a0The data is then displayed visually in an easy to follow sequence of events on a problem timeline. \u00a0For the IT staff, this greatly simplifies the task of seeing exactly what the problem is and they can then concentrate on determining what the appropriate steps are to fix it.<\/p>\n<p>Resnick said that &#8220;the new generation of IT infrastructure requires a fundamentally different approach to Incident Management. We believe that only through leveraging data science can IT teams tackle the scale of machines, events and dependencies that must be understood and managed. That\u2019s why we founded BigPanda.&#8221;<\/p>\n<p><a title=\"Kevin Park bio\" href=\"http:\/\/www.itproportal.com\/2013\/10\/31\/dropbox-hires-ex-facebook-tech-man-kevin-park-it-continues-expansion-effort\/\" target=\"_blank\">Kevin Park<\/a>, Head of Tech Ops and IT at Dropbox, said that &#8220;any modern Ops environment at scale will hit the pain-points BigPanda is solving. There&#8217;s a strong need for this product.&#8221;<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbigpanda-streamlining-incident-reporting-by-applying-data-science%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Data centers have changed dramatically over the last decade. \u00a0In many cases, while the number of servers and overall complexity of the data center have grown dramatically, the size of the IT staff that&#8217;s managing the center hasn&#8217;t changed at<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/bigpanda-streamlining-incident-reporting-by-applying-data-science\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[],"class_list":["post-4993","post","type-post","status-publish","format-standard","hentry","category-data-analytics"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4993","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=4993"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/4993\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=4993"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=4993"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=4993"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}