{"id":1065,"date":"2010-03-12T07:00:12","date_gmt":"2010-03-12T15:00:12","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=1065"},"modified":"2010-03-12T07:00:12","modified_gmt":"2010-03-12T15:00:12","slug":"storage-data-preservation-is-a-growing-problem","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/storage-data-preservation-is-a-growing-problem\/","title":{"rendered":"Storage:  Data Preservation is a Growing Problem"},"content":{"rendered":"<p>The King Tut exhibit has recently been at the de Young museum in San Francisco.\u00a0 The artifacts at the exhibit included statues and even wooden boxes that were amazingly well preserved after three thousand years.\u00a0 Obviously the dry desert Egyptian climate has much to do with enabling the artifacts to have remained in such great condition.<\/p>\n<p>If only we could manage to preserve the world&#8217;s data as well as the Egyptians succeeded with King Tut&#8217;s remains and artifacts! Most of the data being created today is being stored on media with life expectancy of just a few of decades, at best.<\/p>\n<p>While data storage technology is evolving to improve both capacity and performance, the problem is that data formats and storage hardware are being continually obsoleted and that media storage devices aren&#8217;t being built to last for extended periods of time.<br \/>\nSo, while supermarket plastic bags need 1000 years to decompose in landfill sites, many of today&#8217;s storage media devices are nonfunctional in less than a decade.\u00a0 A <a target=\"_blank\" title=\"Digital Doomsday\" href=\"http:\/\/www.newscientist.com\/article\/mg20527451.300-digital-doomsday-the-end-of-knowledge.html?full=true\">NewScientist <\/a>article estimates that some of today&#8217;s most popular media used for storing important data backups, like magnetic tapes and optical discs, are being stored in formats that are often outdated after only five years.<\/p>\n<p>On the hardware side, optical discs constructed with a reflective layer of gold and a phthalocyanine dye look like the best bet for longer-term storage.\u00a0 These type of optical discs can last for a hundred years.\u00a0 But most other media hardware have lifetimes of five to ten years.<\/p>\n<p>Another example is flash memory.\u00a0 Flash-memory drives have become extremely popular, but their design has focused on speed and capacity rather than stability.\u00a0 Flash drive makers estimate about a 10 year lifespan for their products.<\/p>\n<p>The environment where the media is stored is a major factor in how long the media will ultimately survive.\u00a0 Heat and humidity are the main causes for media to rapidly degrade.\u00a0 To guarantee longevity of your data, you could invest in the infrastructure to maintain a perfect environment for preserving storage media, or then again you could ship your media off to a buried site somewhere in Egypt.<\/p>\n<p>The biggest problem is that data storage technology is changing rapidly.\u00a0 For example, when scientists from NASA wanted to resurrect data stored by Lunar Orbiter missions from the 1960&#8217;s, it took a team of people and three months of time to figure out how to retrieve and use the data stored on a set of magnetic discs.<\/p>\n<p>A solution to one piece of the problem might be to adopt something like ILM for long-term data archival.\u00a0 With ILM, frequently accessed data is stored in fast-access expensive memory, and the data is gradually migrated to cheaper storage media as the data is accessed less frequently or as the content of the data loses its value.\u00a0 ILM has the interesting property that data can flow easily from one storage media type to another.<br \/>\nA key point of ILM is that even though there are many types of storage media, all data remains accessible.\u00a0 With this kind of a system using interconnected storage media types, as storage is obsoleted, data can flow and be managed by newer types of storage technologies and eventually older technology can be emptied and retired.<\/p>\n<p>The bottom line is that making a tape, putting it on a shelf and then waiting is a sure way for your data to quickly become unusable.<\/p>\n<div id=\"refHTML\" \/><input type=\"hidden\" id=\"gwProxy\" \/><!--Session data--><input type=\"hidden\" onclick=\"jsCall();\" id=\"jsProxy\" \/><\/p>\n<div id=\"refHTML\" \/>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-data-preservation-is-a-growing-problem%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>The King Tut exhibit has recently been at the de Young museum in San Francisco.\u00a0 The artifacts at the exhibit included statues and even wooden boxes that were amazingly well preserved after three thousand years.\u00a0 Obviously the dry desert Egyptian<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/storage-data-preservation-is-a-growing-problem\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[],"class_list":["post-1065","post","type-post","status-publish","format-standard","hentry","category-storage"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/1065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=1065"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/1065\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=1065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=1065"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=1065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}