com.geoway.adf.gis.fs.hdfs

Class HDFSFileStorage

java.lang.Object

com.geoway.adf.gis.fs.hdfs.HDFSFileStorage

All Implemented Interfaces:

IFileStorage

public class HDFSFileStorage
extends Object
implements IFileStorage

HDFS文件存储

Field Summary

Fields

Modifier and Type	Field and Description
protected String	dataFolder
protected org.apache.hadoop.fs.FileSystem	fileSystem
protected String	url

Constructor Summary

Constructors

Constructor and Description
HDFSFileStorage(String path, String userName, String password, Map options)

Method Summary

Modifier and Type	Method and Description
void	close() 关闭连接
String	combinePaths(String firstFilePath, String... moreFilePath) 路径连接
boolean	connect() 连接
IFileset	createDirectory(String path, String name) 在指定目录下创建文件目录
boolean	deleteFile(String filePath) 删除文件或文件目录
boolean	fileExist(String filePath) 文件是否存在
IFileset	getFile(String filePath) 获取指定路径文件或文件目录
org.apache.hadoop.fs.Path	getHdfsPath(String filePath) 获取hdfs Path
IFileset	getParentFile(String filePath) 获取指定路径的父文件
String	getPassword() 获取密码
String	getSeparator() 文件目录分隔符
String	getStorageUrl() 获取文件存储连接地址
String	getType() 存储类型
String	getUserName() 获取用户名
List<IFileset>	listFile(String filePath, boolean recursion) 指定路径下的文件和文件目录列表
InputStream	openFileStream(String filePath) 打开文件流
IFileset	upload(InputStream srcInputStream, String destFile, boolean overwrite) 上传文件流
IFileset	upload(String srcFile, String destFile, boolean overwrite) 上传本地文件

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

url

protected final String url

dataFolder

protected String dataFolder

fileSystem

protected org.apache.hadoop.fs.FileSystem fileSystem

Constructor Detail

HDFSFileStorage

public HDFSFileStorage(String path,
                       String userName,
                       String password,
                       Map options)

Method Detail

getStorageUrl

public String getStorageUrl()

Description copied from interface: IFileStorage

获取文件存储连接地址

Specified by:

getStorageUrl in interface IFileStorage

Returns:

getUserName

public String getUserName()

Description copied from interface: IFileStorage

获取用户名

Specified by:

getUserName in interface IFileStorage

Returns:

getPassword

public String getPassword()

Description copied from interface: IFileStorage

获取密码

Specified by:

getPassword in interface IFileStorage

Returns:

getType

public String getType()

Description copied from interface: IFileStorage

存储类型

Specified by:

getType in interface IFileStorage

Returns:

getSeparator

public String getSeparator()

Description copied from interface: IFileStorage

文件目录分隔符

Specified by:

getSeparator in interface IFileStorage

Returns:

connect

public boolean connect()

Description copied from interface: IFileStorage

连接

Specified by:

connect in interface IFileStorage

Returns:

close

public void close()

Description copied from interface: IFileStorage

关闭连接

Specified by:

close in interface IFileStorage

listFile

public List<IFileset> listFile(String filePath,
                               boolean recursion)

Description copied from interface: IFileStorage

指定路径下的文件和文件目录列表

Specified by:

listFile in interface IFileStorage

Returns:

fileExist

public boolean fileExist(String filePath)

Description copied from interface: IFileStorage

文件是否存在

Specified by:

fileExist in interface IFileStorage

Returns:

getFile

public IFileset getFile(String filePath)

Description copied from interface: IFileStorage

获取指定路径文件或文件目录

Specified by:

getFile in interface IFileStorage

Returns:

getParentFile

public IFileset getParentFile(String filePath)

Description copied from interface: IFileStorage

获取指定路径的父文件

Specified by:

getParentFile in interface IFileStorage

Returns:

deleteFile

public boolean deleteFile(String filePath)

Description copied from interface: IFileStorage

删除文件或文件目录

Specified by:

deleteFile in interface IFileStorage

Returns:

createDirectory

public IFileset createDirectory(String path,
                                String name)

Description copied from interface: IFileStorage

在指定目录下创建文件目录

Specified by:

createDirectory in interface IFileStorage

Returns:

combinePaths

public String combinePaths(String firstFilePath,
                           String... moreFilePath)

Description copied from interface: IFileStorage

路径连接

Specified by:

combinePaths in interface IFileStorage

Returns:

upload

public IFileset upload(String srcFile,
                       String destFile,
                       boolean overwrite)

Description copied from interface: IFileStorage

上传本地文件

Specified by:

upload in interface IFileStorage

Parameters:

srcFile - 本地源文件路径

destFile - 目标文件路径

overwrite - 是否覆盖已有文件

Returns:

upload

public IFileset upload(InputStream srcInputStream,
                       String destFile,
                       boolean overwrite)

Description copied from interface: IFileStorage

上传文件流

Specified by:

upload in interface IFileStorage

Parameters:

srcInputStream - 源文件流

destFile - 目标文件路径

overwrite - 是否覆盖已有文件

Returns:

openFileStream

public InputStream openFileStream(String filePath)

Description copied from interface: IFileStorage

打开文件流

Specified by:

openFileStream in interface IFileStorage

Returns:

getHdfsPath

public org.apache.hadoop.fs.Path getHdfsPath(String filePath)

获取hdfs Path

Parameters:

filePath -

Returns: