{"id":4329,"date":"2013-11-19T07:00:08","date_gmt":"2013-11-19T15:00:08","guid":{"rendered":"http:\/\/formtek.com\/blog\/?p=4329"},"modified":"2013-11-15T20:43:12","modified_gmt":"2013-11-16T04:43:12","slug":"big-data-interacting-with-hadoop-2-data-using-standard-ansi-sql","status":"publish","type":"post","link":"https:\/\/formtek.com\/blog\/big-data-interacting-with-hadoop-2-data-using-standard-ansi-sql\/","title":{"rendered":"Big Data: Interacting with Hadoop 2 Data Using Standard ANSI SQL"},"content":{"rendered":"

Cascading is an Apache-licensed application framework\u00a0<\/a>\u00a0for building rich data processing and machine learning applications that run on Hadoop. \u00a0Cascading applications are built using a simple API that can be called from any\u00a0JVM-based language. \u00a0Over the past five years, it has been developed and supported commercially by\u00a0Concurrent, Inc<\/a>. \u00a0The flow of\u00a0Cascading is to first capture data from ‘sources’ , to then pass that data through ‘pipes’ where it is processed, and finally to push the results into output files or ‘sinks’. \u00a0This flow of data is known as the ‘source-pipe-sink’ paradigm. \u00a0Cascading runs as an abstraction at a higher level than MapReduce, so that while Cascading applications ultimately execute MapReduce jobs, when the Cascading application is written, no explicit interactions with MapReduce need to be programmed.<\/p>\n

Chris Wensel<\/a>, Founder and CTO of Concurrent, said that <\/a>“building applications on Hadoop, despite its growing adoption in the enterprise, is notoriously difficult. We are driving the future of application development and management on Hadoop, by allowing enterprises to quickly extract meaningful information from large amounts of distributed data and better understand the business implications. We make it easy for developers to build powerful data processing applications for Hadoop, without requiring months spent learning about the intricacies of MapReduce.”<\/p>\n

More than 110,000 user downloads of Cascading are made every month. \u00a0Cascading is used by businesses like\u00a0Twitter<\/a>, eBay,\u00a0The Climate Corporation<\/a>, Square and\u00a0Etsy<\/a>\u00a0for managing some or all of their Big Data requirements. \u00a0In fact, all of Twitter’s revenue-generating applications have been built with Cascading.<\/p>\n

Today, Cascading 2.5 is being introduced — a version-number jump from the previously available 2.2 point release. \u00a0The jump in numbering was intended to emphasise the significance of some of the new features in the release. Most significantly, the 2.5 release will include support for Hadoop 2 and YARN<\/a>. \u00a0Other highlights of the new 2.5 Cascading release include:<\/p>\n