public class PaimonInputFormat extends Object implements org.apache.hadoop.mapred.InputFormat<Void,RowDataContainer>
InputFormat
for paimon. It divides all files into InputSplit
s (one split per
bucket) and creates RecordReader
for each split.Constructor and Description |
---|
PaimonInputFormat() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer> |
getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit,
org.apache.hadoop.mapred.JobConf jobConf,
org.apache.hadoop.mapred.Reporter reporter) |
org.apache.hadoop.mapred.InputSplit[] |
getSplits(org.apache.hadoop.mapred.JobConf jobConf,
int numSplits) |
public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf jobConf, int numSplits)
getSplits
in interface org.apache.hadoop.mapred.InputFormat<Void,RowDataContainer>
public org.apache.hadoop.mapred.RecordReader<Void,RowDataContainer> getRecordReader(org.apache.hadoop.mapred.InputSplit inputSplit, org.apache.hadoop.mapred.JobConf jobConf, org.apache.hadoop.mapred.Reporter reporter) throws IOException
getRecordReader
in interface org.apache.hadoop.mapred.InputFormat<Void,RowDataContainer>
IOException
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.