{"id":5539,"date":"2015-06-17T07:00:54","date_gmt":"2015-06-17T15:00:54","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=5539"},"modified":"2015-06-16T15:37:05","modified_gmt":"2015-06-16T23:37:05","slug":"big-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop\/","title":{"rendered":"Big Data: Spark, Storm and Now DataTorrent Compete for Open Source Real-time Streaming Data in Hadoop"},"content":{"rendered":"<p>There&#8217;s a new option available for\u00a0open-source real-time data processing in Hadoop: <a href=\"https:\/\/www.datatorrent.com\/\" target=\"_blank\">DataTorrent<\/a>. \u00a0After roughly <a href=\"http:\/\/www.marketwired.com\/press-release\/datatorrent-announces-release-first-hadoop-based-real-time-big-data-streaming-platform-1805921.htm\" target=\"_blank\">two years since the introduction<\/a> of DataTorrent, the platform has now moved to an open-source Apache 2.0 license to allow it to better compete against rival technologies <a href=\"https:\/\/spark.apache.org\/\" target=\"_blank\">Spark <\/a>and <a href=\"http:\/\/hortonworks.com\/hadoop\/storm\/\" target=\"_blank\">Storm<\/a>. \u00a0The software is available as <a href=\"https:\/\/www.datatorrent.com\/product\/project-apex\/\" target=\"_blank\">Project Apex<\/a>. \u00a0<a href=\"https:\/\/www.datatorrent.com\/press-releases\/datatorrent-open-sources-datatorrent-rts-industrys-only-enterprise-grade-unified-stream-and-batch-processing-platform\/\" target=\"_blank\">DataTorrent RTS now comes in three editions<\/a> &#8212;\u00a0Community, Standard and Enterprise. \u00a0DataTorrent\u00a0claims processing times ten to one hundred times faster than Spark and being\u00a0easier to develop with.<\/p>\n<p><a href=\"http:\/\/formtek.com\/blog\/wp-content\/uploads\/2015\/06\/DataTorrent_logo.png\"><img loading=\"lazy\" decoding=\"async\" class=\" size-full wp-image-5540 alignleft\" src=\"http:\/\/formtek.com\/blog\/wp-content\/uploads\/2015\/06\/DataTorrent_logo.png\" alt=\"DataTorrent_logo\" width=\"286\" height=\"57\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>Features of Project Apex include:<\/p>\n<ul>\n<li>Event processing guarantees<\/li>\n<li>In-memory performance and\u00a0scalability<\/li>\n<li>Fault tolerance and state management<\/li>\n<li>Native rolling and tumbling window support Hadoop-native YARN and HDFS implementation<\/li>\n<\/ul>\n<p><a href=\"https:\/\/www.crunchbase.com\/person\/phu-hoang\" target=\"_blank\">Phu Hoang<\/a>, co-founder and CEO of DataTorrent, said that &#8220;the DataTorrent RTS unified batch and streaming platform enables enterprises to dramatically\u00a0reduce time-to-insight and time-to-action on data-in-motion and data at rest. By joining the Open Data Platform and certifying DataTorrent RTS on the <a href=\"http:\/\/opendataplatform.org\/\" target=\"_blank\">ODP Core<\/a>, we demonstrate our continuing commitment to meeting the needs of customers on every commercial Hadoop distribution. \u00a0Becoming an ODP member aligns perfectly with our focus on ease of adoption and support for the larger Hadoop ecosystem.&#8221;<\/p>\n<p><a href=\"http:\/\/www.dealstreetasia.com\/stories\/datatorrent-raises-15m-series-b-involving-singtel-innov8-6112\/\" target=\"_blank\">DataTorrent recently closed a<\/a> $15 million Series B financing round led by Singtel Innov8.<\/p>\n<div class=\"lightsocial_container\"><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/digg.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/digg.png\" alt=\"Digg This\" title=\"Digg This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.reddit.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/reddit.png\" alt=\"Reddit This\" title=\"Reddit This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.stumbleupon.com\/submit?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F&amp;title=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/stumbleupon.png\" alt=\"Stumble Now!\" title=\"Stumble Now!\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/buzz.yahoo.com\/buzz?targetUrl=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F&amp;headline=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/yahoo_buzz.png\" alt=\"Buzz This\" title=\"Buzz This\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dzone.com\/links\/add.html?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dzone.png\" alt=\"Vote on DZone\" title=\"Vote on DZone\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.facebook.com\/sharer.php?t=&amp;u=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/facebook.png\" alt=\"Share on Facebook\" title=\"Share on Facebook\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/delicious.com\/save?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/delicious.png\" alt=\"Bookmark this on Delicious\" title=\"Bookmark this on Delicious\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.dotnetkicks.com\/kick\/?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetkicks.png\" alt=\"Kick It on DotNetKicks.com\" title=\"Kick It on DotNetKicks.com\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/dotnetshoutout.com\/Submit?title=&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/dotnetshoutout.png\" alt=\"Shout it\" title=\"Shout it\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.linkedin.com\/shareArticle?mini=true&amp;url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F&amp;title=&amp;summary=&amp;source=\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/linkedin.png\" alt=\"Share on LinkedIn\" title=\"Share on LinkedIn\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.technorati.com\/faves?add=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/technorati.png\" alt=\"Bookmark this on Technorati\" title=\"Bookmark this on Technorati\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/twitter.com\/home?status=Reading+https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/twitter.png\" alt=\"Post on Twitter\" title=\"Post on Twitter\" \/><\/a><\/div><div class=\"lightsocial_element\"><a class=\"lightsocial_a\" href=\"http:\/\/www.google.com\/buzz\/post?url=https%3A%2F%2Fformtek.com%2Fblog%2Fbig-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop%2F\" target=\"_blank\"><img decoding=\"async\" class=\"lightsocial_img\" src=\"https:\/\/formtek.com\/blog\/wp-content\/plugins\/light-social\/google_buzz.png\" alt=\"Google Buzz (aka. Google Reader)\" title=\"Google Buzz (aka. Google Reader)\" \/><\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>There&#8217;s a new option available for\u00a0open-source real-time data processing in Hadoop: DataTorrent. \u00a0After roughly two years since the introduction of DataTorrent, the platform has now moved to an open-source Apache 2.0 license to allow it to better compete against rival<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/formtek.com\/blog\/big-data-spark-storm-and-now-datatorrent-compete-for-open-source-real-time-streaming-data-in-hadoop\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-5539","post","type-post","status-publish","format-standard","hentry","category-big-data"],"_links":{"self":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5539","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/comments?post=5539"}],"version-history":[{"count":0,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/posts\/5539\/revisions"}],"wp:attachment":[{"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/media?parent=5539"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/categories?post=5539"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/formtek.com\/blog\/wp-json\/wp\/v2\/tags?post=5539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}