4.2 Building

Cascading ships with several jars and dependencies in the download archive. Alternatively, Cascading is available over Maven and Ivy through the Conjars repository, along with a number of other Cascading-related projects. See http://conjars.org for more information.

The core Cascading artifacts include the following:

cascading-core-2.6.x.jar

This jar contains the Cascading Core class files. It should be packaged with lib/*.jar when using Hadoop.

cascading-local-2.6.x.jar

This jar contains the Cascading local mode class files. It is not needed when using Hadoop.

cascading-hadoop-2.6.x.jar

This jar contains the Cascading Hadoop 1 specific dependencies. It should be packaged with lib/*.jar when using Hadoop.

cascading-hadoop2-mr1-2.6.x.jar

This jar contains the Cascading Hadoop 2 specific dependencies. It should be packaged with lib/*.jar when using Hadoop.

cascading-xml-2.6.x.jar

This jar contains Cascading XML module class files and is optional. It should be packaged with lib/xml/*.jar when using Hadoop.

Cascading works with either of the Hadoop processing modes - the default local standalone mode and the distributed cluster mode. As specified in the Hadoop documentation, running in cluster mode requires the creation of a Hadoop job jar that includes the Cascading jars, plus any needed third-party jars, in its lib directory. This is true regardless of whether they are Cascading Hadoop-mode applications or raw Hadoop MapReduce applications.

Copyright © 2007-2012 Concurrent, Inc. All Rights Reserved.