org.apache.paimon.jindo

Class JindoFileIO

java.lang.Object

org.apache.paimon.jindo.HadoopCompliantFileIO

org.apache.paimon.jindo.JindoFileIO

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable, FileIO

public class JindoFileIO
extends HadoopCompliantFileIO

Jindo FileIO.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.paimon.jindo.HadoopCompliantFileIO

fsMap

Constructor Summary

Constructors

Constructor and Description
JindoFileIO()

Method Summary

Modifier and Type	Method and Description
void	close() Override this method to empty, many FileIO implementation classes rely on static variables and do not have the ability to close them.
void	configure(CatalogContext context) Configure by CatalogContext.
protected Pair<com.aliyun.jindodata.common.JindoHadoopSystem,String>	createFileSystem(org.apache.hadoop.fs.Path path)
FileStatus	getFileStatus(Path path) Return a file status object that represents the path.
boolean	isObjectStore()
RemoteIterator<FileStatus>	listFilesIterative(Path path, boolean recursive) List the statuses of the files iteratively in the given path if the path is a directory.
FileStatus[]	listStatus(Path path) List the statuses of the files/directories in the given path if the path is a directory.

Methods inherited from class org.apache.paimon.jindo.HadoopCompliantFileIO

delete, exists, getFileSystem, mkdirs, newInputStream, newOutputStream, path, rename

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.fs.FileIO

checkOrMkdirs, copyFile, copyFiles, deleteDirectoryQuietly, deleteFilesQuietly, deleteQuietly, discoverLoaders, get, getFileSize, isDir, listDirectories, listFiles, overwriteFileUtf8, overwriteHintFile, readFileUtf8, readOverwrittenFileUtf8, tryToWriteAtomic, writeFile

Constructor Detail

JindoFileIO

public JindoFileIO()

Method Detail

isObjectStore

public boolean isObjectStore()

configure

public void configure(CatalogContext context)

Description copied from interface: FileIO

Configure by CatalogContext.

createFileSystem

protected Pair<com.aliyun.jindodata.common.JindoHadoopSystem,String> createFileSystem(org.apache.hadoop.fs.Path path)

Specified by:

createFileSystem in class HadoopCompliantFileIO

close

public void close()

Description copied from interface: FileIO

Override this method to empty, many FileIO implementation classes rely on static variables and do not have the ability to close them.

getFileStatus

public FileStatus getFileStatus(Path path)
                         throws IOException

Description copied from interface: FileIO

Return a file status object that represents the path.

Specified by:

getFileStatus in interface FileIO

Overrides:

getFileStatus in class HadoopCompliantFileIO

Parameters:

path - The path we want information from

Returns:

a FileStatus object

Throws:

FileNotFoundException - when the path does not exist; IOException see specific implementation

IOException

listStatus

public FileStatus[] listStatus(Path path)
                        throws IOException

Description copied from interface: FileIO

List the statuses of the files/directories in the given path if the path is a directory.

Specified by:

listStatus in interface FileIO

Overrides:

listStatus in class HadoopCompliantFileIO

Parameters:

path - given path

Returns:

the statuses of the files/directories in the given path

Throws:

IOException

listFilesIterative

public RemoteIterator<FileStatus> listFilesIterative(Path path,
                                                     boolean recursive)
                                              throws IOException

Description copied from interface: FileIO

List the statuses of the files iteratively in the given path if the path is a directory.

Parameters:

path - given path

recursive - if set to true will recursively list files in subdirectories, otherwise only files in the current directory will be listed

Returns:

an RemoteIterator over FileStatus of the files in the given path

Throws:

IOException