{"id":388,"date":"2007-09-17T11:49:03","date_gmt":"2007-09-17T19:49:03","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=388"},"modified":"2007-09-17T11:49:03","modified_gmt":"2007-09-17T19:49:03","slug":"storage-wasted-storage-clogs-servers","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/storage-wasted-storage-clogs-servers\/","title":{"rendered":"Storage:  Wasted Storage Clogs Servers"},"content":{"rendered":"<p><a title=\"Sun Microsystems\" target=\"_blank\" href=\"http:\/\/www.sun.com\/\">Sun Microsystems<\/a> <a title=\"Only 30% of storage space used productively\" target=\"_blank\" href=\"http:\/\/www.informationweek.com\/news\/showArticle.jhtml?articleID=201803314&#038;subSection=All+Stories\">reports <\/a>that only 30% of enterprise storage space is being productively used.  The rest of the data being stored consists of seldom or never accessed files and unallocated space.\u00a0 Redundant data can often be found scattered across multiple storage locations, documents like annual reports, project reviews and spreadsheets.<\/p>\n<p>Part of the problem can be that there is no composite global view of all data in the enterprise.  Enterprise Content Management systems are one <a title=\"Formtek Inc.\" target=\"_blank\" href=\"http:\/\/www.formtek.com\">solution<\/a>.  Enterprise Search can help too.  Another type of system new on the horizon is called Global Storage Resource Management (<a title=\"SRM\" target=\"_blank\" href=\"http:\/\/searchstorage.techtarget.com\/sDefinition\/0,,sid5_gci967890,00.html\">SRM<\/a>) Systems.  SRM can track down, identify, and remove or relocatel redundant and seldom used files.<\/p>\n<p><a title=\"Deduplication\" target=\"_blank\" href=\"http:\/\/www.formtek.com\/blog\/?p=203\">Deduplication <\/a>is a technique often used by SRM systems that can reduce storage utilizations up to one twentieth of their size.<br \/>\nDeduplication is particularly useful for backups because only unique data block differences need to be backed up.  The deduplication process can be broken down into three steps:<\/p>\n<ul>\n<li>Analysis \u0096 An image of the backup data is analyzed.  The analysis may use hints from information like metadata, and file and path names.<\/li>\n<li>Redundancy Identification \u0097 Based on the analysis, identify which data pieces are redundant.  Rather than bit-by-bit comparisons, a hash algorithm is typically applied to a block of data which creates a unique signature for that block.  Redundant blocks are identified when their hash signatures match.  Common hash algorithms used might be SHA-1, MD5 or some proprietary method.<br \/>\nBit-by-bit comparisons are sometimes done too, and that produces the most efficient identification, but the method is very I\/O and compute intensive.<\/li>\n<li>Redundancy Elimination \u0097 Reference pointers need to be created.  Depending on the product vendor, either forward or reverse referencing is used.  Reverse references point to the first occurrence of the data.  Forward references writes out the current data and updates the previous occurence to be a pointer to the new area.<\/li>\n<\/ul>\n<p><!--23c9d5b2a6ddc2fd4ef8dc2e83b6cea5--><\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-wasted-storage-clogs-servers%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Sun Microsystems reports that only 30% of enterprise storage space is being productively used. The rest of the data being stored consists of seldom or never accessed files and unallocated space.\u00a0 Redundant data can often be found scattered across multiple<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/storage-wasted-storage-clogs-servers\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13,34],"tags":[],"class_list":["post-388","post","type-post","status-publish","format-standard","hentry","category-enterprise-content-management","category-storage"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/388","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=388"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/388\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=388"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=388"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=388"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}