public class HadoopFlowConnector extends cascading.flow.FlowConnector
Tap
instances with an assembly of Pipe
instances into
an executable HadoopFlow
for execution on an Apache Hadoop cluster.AppProps
,
FlowConnectorProps
,
FlowDef
,
MapReduceFlow
Constructor and Description |
---|
HadoopFlowConnector()
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance.
|
HadoopFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance using the given
Properties instance as
default value for the underlying jobs. |
HadoopFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties,
cascading.flow.planner.rule.RuleRegistrySet ruleRegistrySet)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance using the given
Properties instance as
default value for the underlying jobs. |
HadoopFlowConnector(cascading.flow.planner.rule.RuleRegistrySet ruleRegistrySet)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance.
|
Modifier and Type | Method and Description |
---|---|
protected cascading.flow.planner.rule.RuleRegistrySet |
createDefaultRuleRegistrySet() |
protected cascading.flow.planner.FlowPlanner |
createFlowPlanner() |
protected java.lang.Class<? extends cascading.scheme.Scheme> |
getDefaultIntermediateSchemeClass() |
public HadoopFlowConnector()
JobConf
which pulls all properties from the local CLASSPATH.@ConstructorProperties(value="properties") public HadoopFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties)
Properties
instance as
default value for the underlying jobs. All properties are copied to a new native configuration instance.properties
- of type Map@ConstructorProperties(value="ruleRegistrySet") public HadoopFlowConnector(cascading.flow.planner.rule.RuleRegistrySet ruleRegistrySet)
JobConf
which pulls all properties from the local CLASSPATH.ruleRegistrySet
- of type RuleRegistry@ConstructorProperties(value={"properties","ruleRegistrySet"}) public HadoopFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties, cascading.flow.planner.rule.RuleRegistrySet ruleRegistrySet)
Properties
instance as
default value for the underlying jobs. All properties are copied to a new native configuration instance.properties
- of type MapruleRegistrySet
- of type RuleRegistryprotected java.lang.Class<? extends cascading.scheme.Scheme> getDefaultIntermediateSchemeClass()
getDefaultIntermediateSchemeClass
in class cascading.flow.FlowConnector
protected cascading.flow.planner.FlowPlanner createFlowPlanner()
createFlowPlanner
in class cascading.flow.FlowConnector
protected cascading.flow.planner.rule.RuleRegistrySet createDefaultRuleRegistrySet()
createDefaultRuleRegistrySet
in class cascading.flow.FlowConnector
Copyright © 2007-2015 Xplenty, Inc. All Rights Reserved.