org.apache.paimon.utils

Class HadoopUtils

java.lang.Object

org.apache.paimon.utils.HadoopUtils

public class HadoopUtils
extends Object

Utility class for working with Hadoop-related classes. This should only be used if Hadoop is on the classpath. Note: decoupled from specific engines.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HadoopUtils.HadoopConfigLoader Specifies the way of loading hadoop config.

Field Summary

Fields

Modifier and Type	Field and Description
static String	HADOOP_CONF_ENV
static ConfigOption<HadoopUtils.HadoopConfigLoader>	HADOOP_CONF_LOADER
static String	HADOOP_HOME_ENV
static ConfigOption<Boolean>	HADOOP_LOAD_DEFAULT_CONFIG
static String	PATH_HADOOP_CONFIG Path to Hadoop configuration.

Constructor Summary

Constructors

Constructor and Description
HadoopUtils()

Method Summary

Modifier and Type	Method and Description
static boolean	addHadoopConfIfFound(org.apache.hadoop.conf.Configuration configuration, String possibleHadoopConfPath, Options options) Search Hadoop configuration files in the given path, and add them to the configuration if found.
static org.apache.hadoop.conf.Configuration	getHadoopConfiguration(Options options)
static void	readHadoopXml(String xml, org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HADOOP_CONF_LOADER

public static final ConfigOption<HadoopUtils.HadoopConfigLoader> HADOOP_CONF_LOADER

HADOOP_LOAD_DEFAULT_CONFIG

public static final ConfigOption<Boolean> HADOOP_LOAD_DEFAULT_CONFIG

HADOOP_HOME_ENV

public static final String HADOOP_HOME_ENV

See Also:

Constant Field Values

HADOOP_CONF_ENV

public static final String HADOOP_CONF_ENV

See Also:

Constant Field Values

PATH_HADOOP_CONFIG

public static final String PATH_HADOOP_CONFIG

Path to Hadoop configuration.

See Also:

Constant Field Values

Constructor Detail

HadoopUtils

public HadoopUtils()

Method Detail

getHadoopConfiguration

public static org.apache.hadoop.conf.Configuration getHadoopConfiguration(Options options)

addHadoopConfIfFound

public static boolean addHadoopConfIfFound(org.apache.hadoop.conf.Configuration configuration,
                                           String possibleHadoopConfPath,
                                           Options options)

Search Hadoop configuration files in the given path, and add them to the configuration if found.

readHadoopXml

public static void readHadoopXml(String xml,
                                 org.apache.hadoop.conf.Configuration conf)