cascading.tap.hadoop.io
Class HttpFileSystem

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.hadoop.fs.FileSystem
          cascading.tap.hadoop.io.StreamedFileSystem
              cascading.tap.hadoop.io.HttpFileSystem

All Implemented Interfaces:

Closeable, org.apache.hadoop.conf.Configurable

public class HttpFileSystem
extends StreamedFileSystem

Class HttpFileSystem provides a basic read-only FileSystem for accessing remote HTTP and HTTPS data.

To use this FileSystem, just use regular http:// or https:// URLs.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FileSystem.Statistics

Field Summary

static String	HTTP_SCHEME Field HTTP_SCHEME
static String	HTTPS_SCHEME Field HTTPS_SCHEME

Fields inherited from class org.apache.hadoop.fs.FileSystem

FS_DEFAULT_NAME_KEY, statistics

Constructor Summary

HttpFileSystem()

Method Summary

boolean	exists(org.apache.hadoop.fs.Path path)
org.apache.hadoop.fs.FileStatus	getFileStatus(org.apache.hadoop.fs.Path path)
URI	getUri()
org.apache.hadoop.fs.FileStatus[]	globStatus(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.PathFilter pathFilter)
void	initialize(URI uri, org.apache.hadoop.conf.Configuration configuration)
org.apache.hadoop.fs.FSDataInputStream	open(org.apache.hadoop.fs.Path path, int i)

Methods inherited from class cascading.tap.hadoop.io.StreamedFileSystem

append, create, delete, delete, getMD5SumFor, getMD5SumFor, getWorkingDirectory, listStatus, mkdirs, rename, setMD5SumFor, setMD5SumFor, setWorkingDirectory

Methods inherited from class org.apache.hadoop.fs.FileSystem

addFileSystemForTesting, append, append, checkPath, clearStatistics, close, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, deleteOnExit, get, get, get, getAllStatistics, getBlockSize, getCanonicalServiceName, getCanonicalUri, getContentSummary, getDefaultBlockSize, getDefaultBlockSize, getDefaultPort, getDefaultReplication, getDefaultReplication, getDefaultUri, getDelegationToken, getFileBlockLocations, getFileChecksum, getHomeDirectory, getLength, getLocal, getName, getNamed, getReplication, getStatistics, getStatistics, getUsed, globStatus, isDirectory, isFile, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, open, printStatistics, processDeleteOnExit, setDefaultUri, setDefaultUri, setOwner, setPermission, setReplication, setTimes, setVerifyChecksum, startLocalOutput

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HTTP_SCHEME

public static final String HTTP_SCHEME

Field HTTP_SCHEME

See Also:

Constant Field Values

HTTPS_SCHEME

public static final String HTTPS_SCHEME

Field HTTPS_SCHEME

See Also:

Constant Field Values

Constructor Detail

HttpFileSystem

public HttpFileSystem()

Method Detail

initialize

public void initialize(URI uri,
                       org.apache.hadoop.conf.Configuration configuration)
                throws IOException

Overrides:

initialize in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getUri

public URI getUri()

Specified by:

getUri in class org.apache.hadoop.fs.FileSystem

globStatus

public org.apache.hadoop.fs.FileStatus[] globStatus(org.apache.hadoop.fs.Path path,
                                                    org.apache.hadoop.fs.PathFilter pathFilter)
                                             throws IOException

Overrides:

globStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

open

public org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path path,
                                                   int i)
                                            throws IOException

Specified by:

open in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

exists

public boolean exists(org.apache.hadoop.fs.Path path)
               throws IOException

Overrides:

exists in class org.apache.hadoop.fs.FileSystem

Throws:

IOException

getFileStatus

public org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path path)
                                              throws IOException

Specified by:

getFileStatus in class org.apache.hadoop.fs.FileSystem

Throws:

IOException