org.apache.orc.impl

Class RecordReaderUtils

java.lang.Object

org.apache.orc.impl.RecordReaderUtils

public class RecordReaderUtils
extends Object

Stateless methods shared between RecordReaderImpl and EncodedReaderImpl.

NOTE: The file was copied and modified to support VectoredReadable.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RecordReaderUtils.ByteBufferAllocatorPool this is an implementation copied from ElasticByteBufferPool in hadoop-2, which lacks a clear()/clean() operation.

Constructor Summary

Constructors

Constructor and Description
RecordReaderUtils()

Method Summary

Modifier and Type	Method and Description
static org.apache.orc.DataReader	createDefaultDataReader(org.apache.orc.impl.DataReaderProperties properties)
static long	estimateRgEndOffset(boolean isCompressed, int bufferSize, boolean isLast, long nextGroupOffset, long streamLength)
static int	getIndexPosition(org.apache.orc.OrcProto.ColumnEncoding.Kind columnEncoding, org.apache.orc.TypeDescription.Category columnType, org.apache.orc.OrcProto.Stream.Kind streamType, boolean isCompressed, boolean hasNulls) Get the offset in the index positions for the column that the given stream starts.
static boolean	isDictionary(org.apache.orc.OrcProto.Stream.Kind kind, org.apache.orc.OrcProto.ColumnEncoding encoding) Is this stream part of a dictionary?
static String	stringifyDiskRanges(org.apache.hadoop.hive.common.io.DiskRangeList range) Build a string representation of a list of disk ranges.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecordReaderUtils

public RecordReaderUtils()

Method Detail

createDefaultDataReader

public static org.apache.orc.DataReader createDefaultDataReader(org.apache.orc.impl.DataReaderProperties properties)

estimateRgEndOffset

public static long estimateRgEndOffset(boolean isCompressed,
                                       int bufferSize,
                                       boolean isLast,
                                       long nextGroupOffset,
                                       long streamLength)

getIndexPosition

public static int getIndexPosition(org.apache.orc.OrcProto.ColumnEncoding.Kind columnEncoding,
                                   org.apache.orc.TypeDescription.Category columnType,
                                   org.apache.orc.OrcProto.Stream.Kind streamType,
                                   boolean isCompressed,
                                   boolean hasNulls)

Get the offset in the index positions for the column that the given stream starts.

Parameters:

columnEncoding - the encoding of the column

columnType - the type of the column

streamType - the kind of the stream

isCompressed - is the stream compressed?

hasNulls - does the column have a PRESENT stream?

Returns:

the number of positions that will be used for that stream

isDictionary

public static boolean isDictionary(org.apache.orc.OrcProto.Stream.Kind kind,
                                   org.apache.orc.OrcProto.ColumnEncoding encoding)

Is this stream part of a dictionary?

Returns:

is this part of a dictionary?

stringifyDiskRanges

public static String stringifyDiskRanges(org.apache.hadoop.hive.common.io.DiskRangeList range)

Build a string representation of a list of disk ranges.

Parameters:

range - ranges to stringify

Returns:

the resulting string