org.apache.parquet.hadoop

Class ParquetWriter<T>

java.lang.Object

org.apache.parquet.hadoop.ParquetWriter<T>

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParquetWriter<T>
extends Object
implements Closeable

Write records to a Parquet file.

NOTE: The file was copied and modified to reduce hadoop dependencies.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetWriter.Builder<T,SELF extends ParquetWriter.Builder<T,SELF>> An abstract builder class for ParquetWriter instances.

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_BLOCK_SIZE
static org.apache.parquet.hadoop.metadata.CompressionCodecName	DEFAULT_COMPRESSION_CODEC_NAME
static boolean	DEFAULT_IS_DICTIONARY_ENABLED
static boolean	DEFAULT_IS_VALIDATING_ENABLED
static int	DEFAULT_PAGE_SIZE
static org.apache.parquet.column.ParquetProperties.WriterVersion	DEFAULT_WRITER_VERSION
static int	MAX_PADDING_SIZE_DEFAULT
static String	OBJECT_MODEL_NAME_PROP

Method Summary

Modifier and Type	Method and Description
void	close()
long	getDataSize()
org.apache.parquet.hadoop.metadata.ParquetMetadata	getFooter()
void	write(T object)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_BLOCK_SIZE

public static final int DEFAULT_BLOCK_SIZE

See Also:

Constant Field Values

DEFAULT_PAGE_SIZE

public static final int DEFAULT_PAGE_SIZE

See Also:

Constant Field Values

DEFAULT_COMPRESSION_CODEC_NAME

public static final org.apache.parquet.hadoop.metadata.CompressionCodecName DEFAULT_COMPRESSION_CODEC_NAME

DEFAULT_IS_DICTIONARY_ENABLED

public static final boolean DEFAULT_IS_DICTIONARY_ENABLED

See Also:

Constant Field Values

DEFAULT_IS_VALIDATING_ENABLED

public static final boolean DEFAULT_IS_VALIDATING_ENABLED

See Also:

Constant Field Values

DEFAULT_WRITER_VERSION

public static final org.apache.parquet.column.ParquetProperties.WriterVersion DEFAULT_WRITER_VERSION

OBJECT_MODEL_NAME_PROP

public static final String OBJECT_MODEL_NAME_PROP

See Also:

Constant Field Values

MAX_PADDING_SIZE_DEFAULT

public static final int MAX_PADDING_SIZE_DEFAULT

See Also:

Constant Field Values

Method Detail

write

public void write(T object)
           throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

getFooter

public org.apache.parquet.hadoop.metadata.ParquetMetadata getFooter()

Returns:

the ParquetMetadata written to the (closed) file.

getDataSize

public long getDataSize()

Returns:

the total size of data written to the file and buffered in memory