|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object cascading.tap.hadoop.io.MultiInputFormat
public class MultiInputFormat
Class MultiInputFormat accepts multiple InputFormat class declarations allowing a single MR job to read data from incompatible file types.
Constructor Summary | |
---|---|
MultiInputFormat()
|
Method Summary | |
---|---|
static void |
addInputFormat(JobConf toJob,
JobConf... fromJobs)
Used to set the current JobConf with all sub jobs configurations. |
RecordReader |
getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
Method getRecordReader delegates to the appropriate InputFormat. |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
Method getSplits delegates to the appropriate InputFormat. |
void |
validateInput(JobConf job)
|
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public MultiInputFormat()
Method Detail |
---|
public static void addInputFormat(JobConf toJob, JobConf... fromJobs)
toJob
- fromJobs
- public void validateInput(JobConf job) throws IOException
IOException
public InputSplit[] getSplits(JobConf job, int numSplits) throws IOException
getSplits
in interface InputFormat
job
- of type JobConfnumSplits
- of type int
IOException
- whenpublic RecordReader getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException
getRecordReader
in interface InputFormat
split
- of type InputSplitjob
- of type JobConfreporter
- of type Reporter
IOException
- when
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |