cascading.tap.hadoop
Class Lfs

java.lang.Object
  extended by cascading.tap.Tap<JobConf,RecordReader,OutputCollector>
      extended by cascading.tap.hadoop.Hfs
          extended by cascading.tap.hadoop.Lfs
All Implemented Interfaces:
cascading.flow.FlowElement, cascading.tap.type.FileType<JobConf>, Serializable

public class Lfs
extends Hfs

Class Lfs is a Tap class that provides access to the Local File System via Hadoop.

Note that using a Lfs Tap instance in a Flow will force a portion of not the whole Flow to be executed in "local" mode forcing the Flow to execute in the current JVM. Mixing with Dfs and other Tap types is possible, providing a means to implement complex file/data management functions.

Use Hfs if you need a Tap instance that inherits the default FileSystem used by Hadoop.

See Also:
Serialized Form

Field Summary
 
Fields inherited from class cascading.tap.hadoop.Hfs
stringPath, TEMPORARY_DIRECTORY
 
Constructor Summary
Lfs(cascading.tuple.Fields fields, String stringPath)
          Deprecated. 
Lfs(cascading.tuple.Fields fields, String stringPath, cascading.tap.SinkMode sinkMode)
          Deprecated. 
Lfs(cascading.scheme.Scheme scheme, String stringPath)
          Constructor Lfs creates a new Lfs instance.
Lfs(cascading.scheme.Scheme scheme, String stringPath, boolean replace)
          Deprecated. 
Lfs(cascading.scheme.Scheme scheme, String stringPath, cascading.tap.SinkMode sinkMode)
          Constructor Lfs creates a new Lfs instance.
 
Method Summary
protected  FileSystem getFileSystem(JobConf conf)
           
protected  void setStringPath(String stringPath)
           
 
Methods inherited from class cascading.tap.hadoop.Hfs
applySourceConfInitIdentifiers, createResource, deleteChildResource, deleteResource, getBlockSize, getChildIdentifiers, getChildIdentifiers, getCombinedInputSafeMode, getDefaultFileSystem, getDefaultFileSystemURIScheme, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getSize, getTemporaryDirectory, getTempPath, getURIScheme, getUseCombinedInput, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resourceExists, setTemporaryDirectory, setUriScheme, sinkConfInit, sourceConfInit, sourceConfInitAddInputPath, sourceConfInitComplete, verifyNoDuplicates
 
Methods inherited from class cascading.tap.Tap
commitResource, createResource, deleteResource, equals, flowConfInit, getConfigDef, getFullIdentifier, getModifiedTime, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasStepConfigDef, id, isEquivalentTo, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForWrite, outgoingScopeFor, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, taps, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

Lfs

@ConstructorProperties(value={"fields","stringPath"})
@Deprecated
public Lfs(cascading.tuple.Fields fields,
                                                 String stringPath)
Deprecated. 

Constructor Lfs creates a new Lfs instance.

Parameters:
fields - of type Fields
stringPath - of type String

Lfs

@ConstructorProperties(value={"scheme","stringPath"})
public Lfs(cascading.scheme.Scheme scheme,
                                      String stringPath)
Constructor Lfs creates a new Lfs instance.

Parameters:
scheme - of type Scheme
stringPath - of type String

Lfs

@ConstructorProperties(value={"scheme","stringPath","replace"})
@Deprecated
public Lfs(cascading.scheme.Scheme scheme,
                                                 String stringPath,
                                                 boolean replace)
Deprecated. 

Constructor Lfs creates a new Lfs instance.

Parameters:
scheme - of type Scheme
stringPath - of type String
replace - of type boolean

Lfs

@ConstructorProperties(value={"fields","stringPath","sinkMode"})
@Deprecated
public Lfs(cascading.tuple.Fields fields,
                                                 String stringPath,
                                                 cascading.tap.SinkMode sinkMode)
Deprecated. 

Constructor Lfs creates a new Lfs instance.

Parameters:
fields - of type Fields
stringPath - of type String
sinkMode - of type SinkMode

Lfs

@ConstructorProperties(value={"scheme","stringPath","sinkMode"})
public Lfs(cascading.scheme.Scheme scheme,
                                      String stringPath,
                                      cascading.tap.SinkMode sinkMode)
Constructor Lfs creates a new Lfs instance.

Parameters:
scheme - of type Scheme
stringPath - of type String
sinkMode - of type SinkMode
Method Detail

setStringPath

protected void setStringPath(String stringPath)
Overrides:
setStringPath in class Hfs

getFileSystem

protected FileSystem getFileSystem(JobConf conf)
Overrides:
getFileSystem in class Hfs


Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.