The most popular and comprehensive Open Source ECM platform
Let us know more
Big Data: Spark, Storm and Now DataTorrent Compete for Open Source Real-time Streaming Data in Hadoop
There’s a new option available for open-source real-time data processing in Hadoop: DataTorrent. After roughly two years since the introduction of DataTorrent, the platform has now moved to an open-source Apache 2.0 license to allow it to better compete against rival technologies Spark and Storm. The software is available as Project Apex. DataTorrent RTS now comes in three editions — Community, Standard and Enterprise. DataTorrent claims processing times ten to one hundred times faster than Spark and being easier to develop with.
Features of Project Apex include:
- Event processing guarantees
- In-memory performance and scalability
- Fault tolerance and state management
- Native rolling and tumbling window support Hadoop-native YARN and HDFS implementation
Phu Hoang, co-founder and CEO of DataTorrent, said that “the DataTorrent RTS unified batch and streaming platform enables enterprises to dramatically reduce time-to-insight and time-to-action on data-in-motion and data at rest. By joining the Open Data Platform and certifying DataTorrent RTS on the ODP Core, we demonstrate our continuing commitment to meeting the needs of customers on every commercial Hadoop distribution. Becoming an ODP member aligns perfectly with our focus on ease of adoption and support for the larger Hadoop ecosystem.”
DataTorrent recently closed a $15 million Series B financing round led by Singtel Innov8.
