|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object cascading.flow.BaseFlow<org.apache.hadoop.mapred.JobConf> cascading.flow.hadoop.HadoopFlow cascading.flow.hadoop.ProcessFlow<P>
public class ProcessFlow<P>
Class ProcessFlow is a Flow
subclass that supports custom Riffle jobs.
Cascade
scheduler. If
other Flow instances in the Cascade share resources with this Flow instance, all participants will be scheduled
according to their dependencies (topologically).
Though this class sub-classes HadoopFlow
, it does not support all the methods available or features.
Currently FlowListener
s are supported but the
FlowListener.onThrowable(cascading.flow.Flow, Throwable)
event is not.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class cascading.flow.BaseFlow |
---|
BaseFlow.FlowHolder |
Field Summary |
---|
Fields inherited from class cascading.flow.BaseFlow |
---|
flowStats, sinks, sources, stop, stopJobsOnExit, thread |
Fields inherited from interface cascading.flow.Flow |
---|
CASCADING_FLOW_ID |
Constructor Summary | |
---|---|
ProcessFlow(Map<Object,Object> properties,
String name,
P process)
Constructor ProcessFlow creates a new ProcessFlow instance. |
|
ProcessFlow(String name,
P process)
Constructor ProcessFlow creates a new ProcessFlow instance. |
Method Summary | |
---|---|
void |
cleanup()
|
void |
complete()
Method complete starts the current Flow instance if it has not be previously started, then block until completion. |
P |
getProcess()
Method getProcess returns the process of this ProcessFlow object. |
void |
prepare()
Method prepare is used by a Cascade to notify the given Flow it should initialize or clear any resources
necessary for Flow.start() to be called successfully. |
void |
setTapFromProcess()
Method setTapFromProcess build Tap instance for the give process incoming and outgoing dependencies. |
void |
start()
Method start begins the execution of this Flow instance. |
void |
stop()
Method stop stops all running jobs, killing any currently executing. |
String |
toString()
|
Methods inherited from class cascading.flow.hadoop.HadoopFlow |
---|
getConfig, getConfigAsProperties, getConfigCopy, getFlowProcess, getMaxNumParallelSteps, getProperty, initConfig, initFromProperties, internalClean, internalShutdown, internalStart, isPreserveTemporaryFiles, newConfig, setConfigProperty, stepsAreLocal |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Constructor Detail |
---|
@ConstructorProperties(value={"name","process"}) public ProcessFlow(String name, P process)
name
- of type Stringprocess
- of type JobConf@ConstructorProperties(value={"properties","name","process"}) public ProcessFlow(Map<Object,Object> properties, String name, P process)
properties
- of type MapMethod Detail |
---|
public void setTapFromProcess()
Tap
instance for the give process incoming and outgoing dependencies.
This method may be called repeatedly to re-configure the source and sink taps.
public P getProcess()
public void prepare()
Flow
Cascade
to notify the given Flow it should initialize or clear any resources
necessary for Flow.start()
to be called successfully.
Specifically, this implementation calls BaseFlow.deleteSinksIfNotUpdate()
&& BaseFlow.deleteTrapsIfNotUpdate()
.
prepare
in interface Flow<org.apache.hadoop.mapred.JobConf>
prepare
in interface UnitOfWork<FlowStats>
prepare
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
public void start()
Flow
Flow.complete()
to block until this Flow completes.
start
in interface Flow<org.apache.hadoop.mapred.JobConf>
start
in interface UnitOfWork<FlowStats>
start
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
public void stop()
Flow
stop
in interface Flow<org.apache.hadoop.mapred.JobConf>
stop
in interface UnitOfWork<FlowStats>
stop
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
public void complete()
Flow
complete
in interface Flow<org.apache.hadoop.mapred.JobConf>
complete
in interface UnitOfWork<FlowStats>
complete
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
public void cleanup()
cleanup
in interface Flow<org.apache.hadoop.mapred.JobConf>
cleanup
in interface UnitOfWork<FlowStats>
cleanup
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
public String toString()
toString
in class BaseFlow<org.apache.hadoop.mapred.JobConf>
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |