cascading.tap.hadoop.io
Class HttpFileSystem

java.lang.Object
  extended by org.apache.hadoop.conf.Configured
      extended by org.apache.hadoop.fs.FileSystem
          extended by cascading.tap.hadoop.io.StreamedFileSystem
              extended by cascading.tap.hadoop.io.HttpFileSystem
All Implemented Interfaces:
Closeable, org.apache.hadoop.conf.Configurable

public class HttpFileSystem
extends StreamedFileSystem

Class HttpFileSystem provides a basic read-only FileSystem for accessing remote HTTP and HTTPS data.

To use this FileSystem, just use regular http:// or https:// URLs.


Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem
org.apache.hadoop.fs.FileSystem.Statistics
 
Field Summary
static String HTTP_SCHEME
          Field HTTP_SCHEME
static String HTTPS_SCHEME
          Field HTTPS_SCHEME
 
Fields inherited from class org.apache.hadoop.fs.FileSystem
FS_DEFAULT_NAME_KEY, statistics
 
Constructor Summary
HttpFileSystem()
           
 
Method Summary
 boolean exists(org.apache.hadoop.fs.Path path)
           
 org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path path)
           
 URI getUri()
           
 org.apache.hadoop.fs.FileStatus[] globStatus(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.PathFilter pathFilter)
           
 void initialize(URI uri, org.apache.hadoop.conf.Configuration configuration)
           
 org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path path, int i)
           
 
Methods inherited from class cascading.tap.hadoop.io.StreamedFileSystem
append, create, delete, delete, getMD5SumFor, getMD5SumFor, getWorkingDirectory, listStatus, mkdirs, rename, setMD5SumFor, setMD5SumFor, setWorkingDirectory
 
Methods inherited from class org.apache.hadoop.fs.FileSystem
addFileSystemForTesting, append, append, checkPath, clearStatistics, close, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, deleteOnExit, get, get, get, getAllStatistics, getBlockSize, getCanonicalServiceName, getCanonicalUri, getContentSummary, getDefaultBlockSize, getDefaultBlockSize, getDefaultPort, getDefaultReplication, getDefaultReplication, getDefaultUri, getDelegationToken, getFileBlockLocations, getFileChecksum, getHomeDirectory, getLength, getLocal, getName, getNamed, getReplication, getStatistics, getStatistics, getUsed, globStatus, isDirectory, isFile, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, open, printStatistics, processDeleteOnExit, setDefaultUri, setDefaultUri, setOwner, setPermission, setReplication, setTimes, setVerifyChecksum, startLocalOutput
 
Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

HTTP_SCHEME

public static final String HTTP_SCHEME
Field HTTP_SCHEME

See Also:
Constant Field Values

HTTPS_SCHEME

public static final String HTTPS_SCHEME
Field HTTPS_SCHEME

See Also:
Constant Field Values
Constructor Detail

HttpFileSystem

public HttpFileSystem()
Method Detail

initialize

public void initialize(URI uri,
                       org.apache.hadoop.conf.Configuration configuration)
                throws IOException
Overrides:
initialize in class org.apache.hadoop.fs.FileSystem
Throws:
IOException

getUri

public URI getUri()
Specified by:
getUri in class org.apache.hadoop.fs.FileSystem

globStatus

public org.apache.hadoop.fs.FileStatus[] globStatus(org.apache.hadoop.fs.Path path,
                                                    org.apache.hadoop.fs.PathFilter pathFilter)
                                             throws IOException
Overrides:
globStatus in class org.apache.hadoop.fs.FileSystem
Throws:
IOException

open

public org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path path,
                                                   int i)
                                            throws IOException
Specified by:
open in class org.apache.hadoop.fs.FileSystem
Throws:
IOException

exists

public boolean exists(org.apache.hadoop.fs.Path path)
               throws IOException
Overrides:
exists in class org.apache.hadoop.fs.FileSystem
Throws:
IOException

getFileStatus

public org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path path)
                                              throws IOException
Specified by:
getFileStatus in class org.apache.hadoop.fs.FileSystem
Throws:
IOException


Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.