{"id":3219,"date":"2012-09-07T07:00:08","date_gmt":"2012-09-07T15:00:08","guid":{"rendered":"http:\/\/www.formtek.com\/blog\/?p=3219"},"modified":"2012-09-07T07:00:08","modified_gmt":"2012-09-07T15:00:08","slug":"storage-innovation-in-data-storage-the-engine-behind-big-data","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/storage-innovation-in-data-storage-the-engine-behind-big-data\/","title":{"rendered":"Storage: Innovation in Data Storage &#8212; the Engine Behind Big Data"},"content":{"rendered":"<div id=\"_mcePaste\">Big data and the current wave of data analytics is a direct result of the <a title=\"Explosive growth of data\" href=\"http:\/\/www.emc.com\/leadership\/programs\/digital-universe.htm\" target=\"_blank\">explosive growth of data<\/a> that&#8217;s been occurring over the last decade. \u00a0And the ability to collect massive amounts of data has been directly enabled by ever improving and ever-cheaper storage technologies. \u00a0Consider that\u00a0<a title=\"Cost of a Gig of RAM\" href=\"http:\/\/www.mkomo.com\/cost-per-gigabyte\" target=\"_blank\">30 years ago 1 Gig of RAM would cost close to $200,000<\/a> while today the cost is on the order of pennies.<\/div>\n<div>&nbsp;<\/div>\n<div>The focus on data is becoming ever more intense, and that focus is driving continued innovation in storage technology. \u00a0Major vendors like\u00a0EMC, Hitachi Data Systems, NetApp, and Oracle Exadata are being challenged by upstarts with new sets of ideas. \u00a0<a title=\"Bill Roth bio\" href=\"http:\/\/www.linkedin.com\/in\/wgroth2\" target=\"_blank\">Bill Roth<\/a>, vice president of marketing at Nexenta, <a title=\"Bill Roth VP of nexenta\" href=\"http:\/\/sdt.bz\/36834#ixzz23iEhGt8L\" target=\"_blank\">said <\/a>that &#8220;In many ways, NetApp and EMC are saddled with the innovator\u2019s dilemma: They&#8217;ve got old file systems on proprietary hardware. \u00a0We&#8217;re seeing success with open-source software, with new file systems and commodity hardware. I don&#8217;t think the legacy vendors are going to be able to keep up.&#8221;<\/div>\n<div>&nbsp;<\/div>\n<div>Which are some of the new companies involved with new and innovative storage solutions? \u00a0<a title=\"InfoStor review of Storage Technology startups\" href=\"http:\/\/www.infostor.com\/storage-management\/6-storage-startups-to-watch.html\" target=\"_blank\">InfoStor <\/a>recently reviewed six promising new storage technology companies:<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Bitcasa\" href=\"http:\/\/www.bitcasa.com\/\" target=\"_blank\">Bitcasa <\/a>&#8211; Offers very low-cost &#8216;unlimited&#8217; cloud storage. \u00a0Bitcasa has <a title=\"Bitcasa storage technology\" href=\"http:\/\/techcrunch.com\/2012\/06\/20\/bitcasas-unlimited-cloud-storage-service-is-now-in-open-beta-raises-7-million-series-a-round\/\" target=\"_blank\">20 patents<\/a> on\u00a0\u00a0de-duplication, compression, and other storage\u00a0technologies. \u00a0To eliminate transfer latency between the cloud and the client, Bitcasa software makes a local cache of frequently accessed files and data and stores them on your local computer.<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Zadara\" href=\"http:\/\/vimeo.com\/43273768\" target=\"_blank\">Zadara <\/a>&#8211; Develops smart software to take advantage of commodity hardware by building a private cloud storage. \u00a0Key to the technology is the ability to create virtualized separated storage areas, something they&#8217;re calling <a title=\"Virtual Private Storage Arrays -- Zadara\" href=\"http:\/\/www.zadarastorage.com\/features\/\" target=\"_blank\">Virtual Private Storage Arrays<\/a> (VPSA).<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Starboard Storage\" href=\"http:\/\/www.starboardstorage.com\/\" target=\"_blank\">Starboard Storage<\/a> &#8211; \u00a0Their solution optimizes the best use of storage resources by dynamically provisioning storage. \u00a0Starboard Storage provides hybrid storage management, overseeing a mix of SSDs and hard drives, balancing both performance and cost per Gigabyte requirements.<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Inktank\" href=\"http:\/\/www.inktank.com\/\" target=\"_blank\">Inktank <\/a>&#8211; Makers of <a title=\"Ceph Open Source\" href=\"www.ceph.com\" target=\"_blank\">Ceph<\/a>, Open Source software with the goal of creating a &#8220;massively scalable, open source, distributed storage system.&#8221; \u00a0Ceph can use commodity hardware. \u00a0It is in the Linux kernel and included with the <a title=\"OpenStack\" href=\"http:\/\/www.openstack.org\/\" target=\"_blank\">OpenStack <\/a>cloud operating system.<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Avere Systems\" href=\"http:\/\/www.averesystems.com\/\" target=\"_blank\">Avere Systems<\/a> &#8211; The Avere solution uses new Flash media with real-time tiering capabilities. \u00a0The goal is to improve application performance scaling and to dramatically cut storage costs.<\/div>\n<div>&nbsp;<\/div>\n<div><a title=\"Kaminario\" href=\"http:\/\/www.kaminario.com\/\" target=\"_blank\">Kaminario <\/a>&#8211; Creates storage solutions that use both Flash and DRAM SSD SAN storage technologies. \u00a0The goal is to achieve high performance, low latency and high availability.<\/div>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fstorage-innovation-in-data-storage-the-engine-behind-big-data%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Big data and the current wave of data analytics is a direct result of the explosive growth of data that&#8217;s been occurring over the last decade. \u00a0And the ability to collect massive amounts of data has been directly enabled by<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/storage-innovation-in-data-storage-the-engine-behind-big-data\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,34],"tags":[],"class_list":["post-3219","post","type-post","status-publish","format-standard","hentry","category-big-data","category-storage"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3219","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=3219"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/3219\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=3219"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=3219"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=3219"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}