cascading.flow.local
Class LocalFlow
java.lang.Object
cascading.flow.BaseFlow<Properties>
cascading.flow.local.LocalFlow
- All Implemented Interfaces:
- Flow<Properties>, UnitOfWork<FlowStats>
public class LocalFlow
- extends BaseFlow<Properties>
Class LocalFlow is the local mode specific implementation of a Flow
.
LocalFlow must be created through a LocalFlowConnector
instance.
If classpath paths are provided on the FlowDef
, the context classloader used to internally urn the current
Flow will be swapped out with an URLClassLoader pointing to each element.
- See Also:
LocalFlowConnector
Methods inherited from class cascading.flow.BaseFlow |
addListener, areSinksStale, areSourcesNewer, cleanup, complete, createConfig, deleteCheckpointsIfNotUpdate, deleteCheckpointsIfReplace, deleteSinks, deleteSinksIfNotUpdate, deleteSinksIfReplace, deleteTrapsIfNotUpdate, deleteTrapsIfReplace, fireOnCompleted, fireOnStarting, fireOnStopping, fireOnThrowable, getCascadeID, getCascadingServices, getCheckpointNames, getCheckpoints, getCheckpointsCollection, getClassPath, getFieldsFor, getFlowSession, getFlowSkipStrategy, getFlowStats, getFlowSteps, getFlowStepStrategy, getHolder, getID, getName, getPlatformInfo, getRunID, getSink, getSink, getSinkModified, getSinkNames, getSinks, getSinksCollection, getSource, getSourceNames, getSources, getSourcesCollection, getSpawnStrategy, getStats, getSubmitPriority, getTags, getTrapNames, getTraps, getTrapsCollection, handleExecutorShutdown, hasListeners, initFromProperties, initialize, initializeNewJobsMap, initSteps, internalStopAllJobs, isSkipFlow, isStopJobsOnExit, logInfo, openSink, openSink, openSource, openSource, openTapForRead, openTapForWrite, openTrap, openTrap, prepare, presentSinkFields, presentSourceFields, registerShutdownHook, removeListener, resourceExists, retrieveSinkFields, retrieveSourceFields, setCascade, setCheckpoints, setFlowSkipStrategy, setFlowStepGraph, setFlowStepStrategy, setName, setSinks, setSources, setSpawnStrategy, setSubmitPriority, setTraps, start, stop, toString, updateSchemes, writeDOT, writeStepsDOT |
LocalFlow
public LocalFlow(cascading.flow.planner.PlatformInfo platformInfo,
Map<Object,Object> properties,
Properties config,
FlowDef flowDef)
initConfig
protected void initConfig(Map<Object,Object> properties,
Properties parentConfig)
- Description copied from class:
BaseFlow
- This method creates a new internal Config with the parentConfig as defaults using the properties to override
the defaults.
- Specified by:
initConfig
in class BaseFlow<Properties>
- Parameters:
properties
- of type MapparentConfig
- of type Config
setConfigProperty
protected void setConfigProperty(Properties properties,
Object key,
Object value)
- Specified by:
setConfigProperty
in class BaseFlow<Properties>
newConfig
protected Properties newConfig(Properties defaultConfig)
- Specified by:
newConfig
in class BaseFlow<Properties>
getConfig
public Properties getConfig()
- Description copied from interface:
Flow
- Method getConfig returns the internal configuration object.
Any changes to this object will not be reflected in child steps. See
FlowConnector
for setting
default properties visible to children. Or see FlowStepStrategy
for setting properties on
individual steps before they are executed.
- Returns:
- the default configuration of this Flow
getConfigCopy
public Properties getConfigCopy()
- Description copied from interface:
Flow
- Method getConfigCopy returns a copy of the internal configuration object. This object can be safely
modified.
- Returns:
- a copy of the default configuration of this Flow
getConfigAsProperties
public Map<Object,Object> getConfigAsProperties()
- Description copied from interface:
Flow
- Method getConfiAsProperties converts the internal configuration object into a
Map
of
key value pairs.
- Returns:
- a Map of key/value pairs
getProperty
public String getProperty(String key)
getFlowProcess
public FlowProcess<Properties> getFlowProcess()
internalStart
protected void internalStart()
- Specified by:
internalStart
in class BaseFlow<Properties>
createFlowThread
protected Thread createFlowThread(String threadName)
- Overrides:
createFlowThread
in class BaseFlow<Properties>
internalClean
protected void internalClean(boolean stop)
- Specified by:
internalClean
in class BaseFlow<Properties>
stepsAreLocal
public boolean stepsAreLocal()
- Description copied from interface:
Flow
- Method jobsAreLocal returns true if all jobs are executed in-process as a single map and reduce task.
- Returns:
- boolean
getMaxNumParallelSteps
protected int getMaxNumParallelSteps()
- Specified by:
getMaxNumParallelSteps
in class BaseFlow<Properties>
internalShutdown
protected void internalShutdown()
- Specified by:
internalShutdown
in class BaseFlow<Properties>
Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.