public class Hadoop18TapUtil extends Object
Modifier and Type | Field and Description |
---|---|
static String |
TEMPORARY_PATH
The Hadoop temporary path used to prevent collisions
|
Constructor and Description |
---|
Hadoop18TapUtil() |
Modifier and Type | Method and Description |
---|---|
static void |
cleanupJob(Configuration conf)
May only be called once.
|
static void |
cleanupTapMetaData(Configuration conf,
Tap tap)
Called from flow step to remove temp dirs
|
static void |
commitTask(Configuration conf)
copies all files from the taskoutputpath to the outputpath
|
static void |
makeTempPath(Configuration conf) |
static boolean |
needsTaskCommit(Configuration conf) |
static void |
setupJob(Configuration conf)
should only be called if not in a Flow
|
static void |
setupTask(Configuration conf) |
public static final String TEMPORARY_PATH
public Hadoop18TapUtil()
public static void setupJob(Configuration conf) throws IOException
conf
- IOException
public static void setupTask(Configuration conf) throws IOException
IOException
public static boolean needsTaskCommit(Configuration conf) throws IOException
IOException
public static void commitTask(Configuration conf) throws IOException
conf
- IOException
public static void cleanupTapMetaData(Configuration conf, Tap tap) throws IOException
conf
- IOException
public static void cleanupJob(Configuration conf) throws IOException
conf
- IOException
public static void makeTempPath(Configuration conf) throws IOException
IOException
Copyright © 2007-2015 Concurrent, Inc. All Rights Reserved.