cascading.scheme.hadoop
Class SequenceFile

java.lang.Object
  extended by cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>
      extended by cascading.scheme.hadoop.SequenceFile
All Implemented Interfaces:
Serializable
Direct Known Subclasses:
WritableSequenceFile

public class SequenceFile
extends cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>

A SequenceFile is a type of Scheme, which is a flat file consisting of binary key/value pairs. This is a space and time efficient means to store data.

See Also:
Serialized Form

Constructor Summary
protected SequenceFile()
          Protected for use by TempDfs and other subclasses.
  SequenceFile(cascading.tuple.Fields fields)
          Creates a new SequenceFile instance that stores the given field names.
 
Method Summary
 void sink(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.scheme.SinkCall<Void,OutputCollector> sinkCall)
           
 void sinkConfInit(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.tap.Tap<JobConf,RecordReader,OutputCollector> tap, JobConf conf)
           
 boolean source(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
           
 void sourceCleanup(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
           
 void sourceConfInit(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.tap.Tap<JobConf,RecordReader,OutputCollector> tap, JobConf conf)
           
 void sourcePrepare(cascading.flow.FlowProcess<JobConf> flowProcess, cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
           
 
Methods inherited from class cascading.scheme.Scheme
equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, sinkCleanup, sinkPrepare, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

SequenceFile

protected SequenceFile()
Protected for use by TempDfs and other subclasses. Not for general consumption.


SequenceFile

@ConstructorProperties(value="fields")
public SequenceFile(cascading.tuple.Fields fields)
Creates a new SequenceFile instance that stores the given field names.

Parameters:
fields -
Method Detail

sourceConfInit

public void sourceConfInit(cascading.flow.FlowProcess<JobConf> flowProcess,
                           cascading.tap.Tap<JobConf,RecordReader,OutputCollector> tap,
                           JobConf conf)
Specified by:
sourceConfInit in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>

sinkConfInit

public void sinkConfInit(cascading.flow.FlowProcess<JobConf> flowProcess,
                         cascading.tap.Tap<JobConf,RecordReader,OutputCollector> tap,
                         JobConf conf)
Specified by:
sinkConfInit in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>

sourcePrepare

public void sourcePrepare(cascading.flow.FlowProcess<JobConf> flowProcess,
                          cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
Overrides:
sourcePrepare in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>

source

public boolean source(cascading.flow.FlowProcess<JobConf> flowProcess,
                      cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
               throws IOException
Specified by:
source in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>
Throws:
IOException

sourceCleanup

public void sourceCleanup(cascading.flow.FlowProcess<JobConf> flowProcess,
                          cascading.scheme.SourceCall<Object[],RecordReader> sourceCall)
Overrides:
sourceCleanup in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>

sink

public void sink(cascading.flow.FlowProcess<JobConf> flowProcess,
                 cascading.scheme.SinkCall<Void,OutputCollector> sinkCall)
          throws IOException
Specified by:
sink in class cascading.scheme.Scheme<JobConf,RecordReader,OutputCollector,Object[],Void>
Throws:
IOException


Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.