|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object cascading.tap.hadoop.io.MultiInputFormat
public class MultiInputFormat
Class MultiInputFormat accepts multiple InputFormat class declarations allowing a single MR job to read data from incompatible file types.
Constructor Summary | |
---|---|
MultiInputFormat()
|
Method Summary | |
---|---|
static void |
addInputFormat(org.apache.hadoop.mapred.JobConf toJob,
org.apache.hadoop.mapred.JobConf... fromJobs)
Used to set the current JobConf with all sub jobs configurations. |
org.apache.hadoop.mapred.RecordReader |
getRecordReader(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf job,
org.apache.hadoop.mapred.Reporter reporter)
Method getRecordReader delegates to the appropriate InputFormat. |
org.apache.hadoop.mapred.InputSplit[] |
getSplits(org.apache.hadoop.mapred.JobConf job,
int numSplits)
Method getSplits delegates to the appropriate InputFormat. |
void |
validateInput(org.apache.hadoop.mapred.JobConf job)
|
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public MultiInputFormat()
Method Detail |
---|
public static void addInputFormat(org.apache.hadoop.mapred.JobConf toJob, org.apache.hadoop.mapred.JobConf... fromJobs)
toJob
- fromJobs
- public void validateInput(org.apache.hadoop.mapred.JobConf job) throws IOException
IOException
public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits) throws IOException
getSplits
in interface org.apache.hadoop.mapred.InputFormat
job
- of type JobConfnumSplits
- of type int
IOException
- whenpublic org.apache.hadoop.mapred.RecordReader getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter) throws IOException
getRecordReader
in interface org.apache.hadoop.mapred.InputFormat
split
- of type InputSplitjob
- of type JobConfreporter
- of type Reporter
IOException
- when
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |