cascading.tap.partition
Class BasePartitionTap.PartitionScheme<Config,Input,Output>

java.lang.Object
  extended by cascading.scheme.Scheme<Config,Input,Output,Void,Void>
      extended by cascading.tap.partition.BasePartitionTap.PartitionScheme<Config,Input,Output>
All Implemented Interfaces:
Serializable
Enclosing class:
BasePartitionTap<Config,Input,Output>

public static class BasePartitionTap.PartitionScheme<Config,Input,Output>
extends Scheme<Config,Input,Output,Void,Void>

See Also:
Serialized Form

Constructor Summary
BasePartitionTap.PartitionScheme(Scheme scheme)
           
BasePartitionTap.PartitionScheme(Scheme scheme, Fields partitionFields)
           
 
Method Summary
 int getNumSinkParts()
          Method getNumSinkParts returns the numSinkParts of this Scheme object.
 Fields getSinkFields()
          Method getSinkFields returns the sinkFields of this Scheme object.
 Fields getSourceFields()
          Method getSourceFields returns the sourceFields of this Scheme object.
 void setNumSinkParts(int numSinkParts)
          Method setNumSinkParts sets the numSinkParts of this Scheme object.
 void setSinkFields(Fields sinkFields)
          Method setSinkFields sets the sinkFields of this Scheme object.
 void setSourceFields(Fields sourceFields)
          Method setSourceFields sets the sourceFields of this Scheme object.
 void sink(FlowProcess<Config> flowProcess, SinkCall<Void,Output> sinkCall)
          Method sink writes out the given Tuple found on SinkCall.getOutgoingEntry() to the SinkCall.getOutput().
 void sinkCleanup(FlowProcess<Config> flowProcess, SinkCall<Void,Output> sinkCall)
          Method sinkCleanup is used to destroy resources created by Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall).
 void sinkConfInit(FlowProcess<Config> flowProcess, Tap<Config,Input,Output> tap, Config conf)
          Method sinkInit initializes this instance as a sink.
 void sinkPrepare(FlowProcess<Config> flowProcess, SinkCall<Void,Output> sinkCall)
          Method sinkPrepare is used to initialize resources needed during each call of Scheme.sink(cascading.flow.FlowProcess, SinkCall).
 boolean source(FlowProcess<Config> flowProcess, SourceCall<Void,Input> sourceCall)
          Method source will read a new "record" or value from SourceCall.getInput() and populate the available Tuple via SourceCall.getIncomingEntry() and return true on success or false if no more values available.
 void sourceCleanup(FlowProcess<Config> flowProcess, SourceCall<Void,Input> sourceCall)
          Method sourceCleanup is used to destroy resources created by Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall).
 void sourceConfInit(FlowProcess<Config> flowProcess, Tap<Config,Input,Output> tap, Config conf)
          Method sourceInit initializes this instance as a source.
 void sourcePrepare(FlowProcess<Config> flowProcess, SourceCall<Void,Input> sourceCall)
          Method sourcePrepare is used to initialize resources needed during each call of Scheme.source(cascading.flow.FlowProcess, SourceCall).
 
Methods inherited from class cascading.scheme.Scheme
equals, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

BasePartitionTap.PartitionScheme

public BasePartitionTap.PartitionScheme(Scheme scheme)

BasePartitionTap.PartitionScheme

public BasePartitionTap.PartitionScheme(Scheme scheme,
                                        Fields partitionFields)
Method Detail

getSinkFields

public Fields getSinkFields()
Description copied from class: Scheme
Method getSinkFields returns the sinkFields of this Scheme object.

Overrides:
getSinkFields in class Scheme<Config,Input,Output,Void,Void>
Returns:
the sinkFields (type Fields) of this Scheme object.

setSinkFields

public void setSinkFields(Fields sinkFields)
Description copied from class: Scheme
Method setSinkFields sets the sinkFields of this Scheme object.

Overrides:
setSinkFields in class Scheme<Config,Input,Output,Void,Void>
Parameters:
sinkFields - the sinkFields of this Scheme object.

getSourceFields

public Fields getSourceFields()
Description copied from class: Scheme
Method getSourceFields returns the sourceFields of this Scheme object.

Overrides:
getSourceFields in class Scheme<Config,Input,Output,Void,Void>
Returns:
the sourceFields (type Fields) of this Scheme object.

setSourceFields

public void setSourceFields(Fields sourceFields)
Description copied from class: Scheme
Method setSourceFields sets the sourceFields of this Scheme object.

Overrides:
setSourceFields in class Scheme<Config,Input,Output,Void,Void>
Parameters:
sourceFields - the sourceFields of this Scheme object.

getNumSinkParts

public int getNumSinkParts()
Description copied from class: Scheme
Method getNumSinkParts returns the numSinkParts of this Scheme object.

Overrides:
getNumSinkParts in class Scheme<Config,Input,Output,Void,Void>
Returns:
the numSinkParts (type int) of this Scheme object.

setNumSinkParts

public void setNumSinkParts(int numSinkParts)
Description copied from class: Scheme
Method setNumSinkParts sets the numSinkParts of this Scheme object.

Overrides:
setNumSinkParts in class Scheme<Config,Input,Output,Void,Void>
Parameters:
numSinkParts - the numSinkParts of this Scheme object.

sourceConfInit

public void sourceConfInit(FlowProcess<Config> flowProcess,
                           Tap<Config,Input,Output> tap,
                           Config conf)
Description copied from class: Scheme
Method sourceInit initializes this instance as a source.

This method is executed client side as a means to provide necessary configuration parameters used by the underlying platform.

It is not intended to initialize resources that would be necessary during the execution of this class, like a "formatter" or "parser".

See Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall) if resources much be initialized before use. And Scheme.sourceCleanup(cascading.flow.FlowProcess, SourceCall) if resources must be destroyed after use.

Specified by:
sourceConfInit in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
tap - of type Tap
conf - of type Config

sourcePrepare

public void sourcePrepare(FlowProcess<Config> flowProcess,
                          SourceCall<Void,Input> sourceCall)
                   throws IOException
Description copied from class: Scheme
Method sourcePrepare is used to initialize resources needed during each call of Scheme.source(cascading.flow.FlowProcess, SourceCall).

Be sure to place any initialized objects in the SourceContext so each instance will remain threadsafe.

Overrides:
sourcePrepare in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
sourceCall - of type SourceCall
Throws:
IOException

source

public boolean source(FlowProcess<Config> flowProcess,
                      SourceCall<Void,Input> sourceCall)
               throws IOException
Description copied from class: Scheme
Method source will read a new "record" or value from SourceCall.getInput() and populate the available Tuple via SourceCall.getIncomingEntry() and return true on success or false if no more values available.

It's ok to set a new Tuple instance on the incomingEntry TupleEntry, or to simply re-use the existing instance.

Note this is only time it is safe to modify a Tuple instance handed over via a method call.

This method may optionally throw a TapException if it cannot process a particular instance of data. If the payload Tuple is set on the TapException, that Tuple will be written to any applicable failure trap Tap.

Specified by:
source in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
sourceCall - of SourceCall
Returns:
returns true when a Tuple was successfully read
Throws:
IOException

sourceCleanup

public void sourceCleanup(FlowProcess<Config> flowProcess,
                          SourceCall<Void,Input> sourceCall)
                   throws IOException
Description copied from class: Scheme
Method sourceCleanup is used to destroy resources created by Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall).

Overrides:
sourceCleanup in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of Process
sourceCall - of type SourceCall
Throws:
IOException

sinkConfInit

public void sinkConfInit(FlowProcess<Config> flowProcess,
                         Tap<Config,Input,Output> tap,
                         Config conf)
Description copied from class: Scheme
Method sinkInit initializes this instance as a sink.

This method is executed client side as a means to provide necessary configuration parameters used by the underlying platform.

It is not intended to initialize resources that would be necessary during the execution of this class, like a "formatter" or "parser".

See Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall) if resources much be initialized before use. And Scheme.sinkCleanup(cascading.flow.FlowProcess, SinkCall) if resources must be destroyed after use.

Specified by:
sinkConfInit in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
tap - of type Tap
conf - of type Config

sinkPrepare

public void sinkPrepare(FlowProcess<Config> flowProcess,
                        SinkCall<Void,Output> sinkCall)
                 throws IOException
Description copied from class: Scheme
Method sinkPrepare is used to initialize resources needed during each call of Scheme.sink(cascading.flow.FlowProcess, SinkCall).

Be sure to place any initialized objects in the SinkContext so each instance will remain threadsafe.

Overrides:
sinkPrepare in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
sinkCall - of type SinkCall
Throws:
IOException

sink

public void sink(FlowProcess<Config> flowProcess,
                 SinkCall<Void,Output> sinkCall)
          throws IOException
Description copied from class: Scheme
Method sink writes out the given Tuple found on SinkCall.getOutgoingEntry() to the SinkCall.getOutput().

This method may optionally throw a TapException if it cannot process a particular instance of data. If the payload Tuple is set on the TapException, that Tuple will be written to any applicable failure trap Tap. If not set, the incoming Tuple will be written instead.

Specified by:
sink in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of Process
sinkCall - of SinkCall
Throws:
IOException

sinkCleanup

public void sinkCleanup(FlowProcess<Config> flowProcess,
                        SinkCall<Void,Output> sinkCall)
                 throws IOException
Description copied from class: Scheme
Method sinkCleanup is used to destroy resources created by Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall).

Overrides:
sinkCleanup in class Scheme<Config,Input,Output,Void,Void>
Parameters:
flowProcess - of type FlowProcess
sinkCall - of type SinkCall
Throws:
IOException


Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.