public interface FlowNode extends ProcessModel
FlowStep
and may have many siblings within the FlowStep.
A FlowNode is commonly executed as one or more slices, where a slice is a JVM executing against a portion
of data.
Most slices within a FlowNode are identical, except for the sub-set of data they will be processing against.
But on some platforms, like MapReduce, a slice is executing a single flow pipeline. Thus a FlowNode may consist of
some set of pipelines (or pipeline graph). One pipeline per 'streamed' input source Tap.
In a MapReduce model (like Apache Hadoop MapReduce) a FlowNode can by the Map or Reduce side of a job (where a job
is a FlowStep).
In a DAG model (like Apache Tez), a FlowNode is a 'vertex', and the 'DAG' is a FlowStep.Modifier and Type | Field and Description |
---|---|
static String |
CASCADING_FLOW_NODE |
Modifier and Type | Method and Description |
---|---|
Collection<? extends FlowElement> |
getFlowElementsFor(Enum annotation) |
Map<String,String> |
getFlowNodeDescriptor()
Returns an immutable map of properties giving more details about the FlowNode object.
|
FlowNodeStats |
getFlowNodeStats() |
FlowStep |
getFlowStep() |
String |
getID() |
Collection<? extends Scope> |
getNextScopes(FlowElement flowElement) |
ElementGraph |
getPipelineGraphFor(FlowElement streamedSource) |
List<? extends ElementGraph> |
getPipelineGraphs() |
Collection<? extends Scope> |
getPreviousScopes(FlowElement flowElement) |
Set<String> |
getSinkElementNames() |
Set<? extends FlowElement> |
getSinkElements(Enum annotation) |
Set<String> |
getSinkTapNames(Tap flowElement) |
Set<String> |
getSourceElementNames() |
Set<? extends FlowElement> |
getSourceElements(Enum annotation) |
Set<String> |
getSourceTapNames(Tap flowElement) |
Tap |
getTrap(String branchName) |
Collection<? extends Tap> |
getTraps() |
addProcessAnnotation, addProcessAnnotation, getElementGraph, getGroups, getName, getOrdinal, getProcessAnnotations, getSinkElements, getSinkTaps, getSourceElements, getSourceTaps, getSubmitPriority, getTrapMap
static final String CASCADING_FLOW_NODE
String getID()
getID
in interface ProcessModel
Map<String,String> getFlowNodeDescriptor()
FlowNodeDescriptors
.FlowNodeStats getFlowNodeStats()
FlowStep getFlowStep()
Collection<? extends FlowElement> getFlowElementsFor(Enum annotation)
Set<? extends FlowElement> getSourceElements(Enum annotation)
Set<? extends FlowElement> getSinkElements(Enum annotation)
Set<String> getSourceElementNames()
Set<String> getSinkElementNames()
Set<String> getSourceTapNames(Tap flowElement)
Set<String> getSinkTapNames(Tap flowElement)
Collection<? extends Tap> getTraps()
Collection<? extends Scope> getPreviousScopes(FlowElement flowElement)
Collection<? extends Scope> getNextScopes(FlowElement flowElement)
List<? extends ElementGraph> getPipelineGraphs()
ElementGraph getPipelineGraphFor(FlowElement streamedSource)
Copyright © 2007-2015 Concurrent, Inc. All Rights Reserved.