org.apache.paimon.table.source

Class DataTableBatchScan

java.lang.Object

org.apache.paimon.table.source.DataTableBatchScan

All Implemented Interfaces:

DataTableScan, InnerTableScan, TableScan

public class DataTableBatchScan
extends Object

TableScan implementation for batch planning.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.paimon.table.source.TableScan

TableScan.Plan

Field Summary

Fields

Modifier and Type	Field and Description
protected SnapshotReader	snapshotReader

Constructor Summary

Constructors

Constructor and Description
DataTableBatchScan(boolean pkTable, CoreOptions options, SnapshotReader snapshotReader, DefaultValueAssigner defaultValueAssigner)

Method Summary

Modifier and Type	Method and Description
protected StartingScanner	createStartingScanner(boolean isStreaming)
org.apache.paimon.table.source.AbstractDataTableScan	dropStats()
List<PartitionEntry>	listPartitionEntries()
CoreOptions	options()
TableScan.Plan	plan() Plan splits, throws EndOfScanException if the scan is ended.
org.apache.paimon.table.source.AbstractDataTableScan	withBucket(int bucket)
org.apache.paimon.table.source.AbstractDataTableScan	withBucketFilter(Filter<Integer> bucketFilter)
InnerTableScan	withFilter(Predicate predicate)
org.apache.paimon.table.source.AbstractDataTableScan	withLevelFilter(Filter<Integer> levelFilter)
InnerTableScan	withLimit(int limit)
org.apache.paimon.table.source.AbstractDataTableScan	withMetricsRegistry(MetricRegistry metricsRegistry)
org.apache.paimon.table.source.AbstractDataTableScan	withPartitionFilter(List<BinaryRow> partitions)
org.apache.paimon.table.source.AbstractDataTableScan	withPartitionFilter(Map<String,String> partitionSpec)
org.apache.paimon.table.source.AbstractDataTableScan	withPartitionsFilter(List<Map<String,String>> partitions)
DataTableScan	withShard(int indexOfThisSubtask, int numberOfParallelSubtasks) Specify the shard to be read, and allocate sharded files to read records.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.table.source.TableScan

listPartitions

Field Detail

snapshotReader

protected final SnapshotReader snapshotReader

Constructor Detail

DataTableBatchScan

public DataTableBatchScan(boolean pkTable,
                          CoreOptions options,
                          SnapshotReader snapshotReader,
                          DefaultValueAssigner defaultValueAssigner)

Method Detail

withFilter

public InnerTableScan withFilter(Predicate predicate)

withLimit

public InnerTableScan withLimit(int limit)

plan

public TableScan.Plan plan()

Description copied from interface: TableScan

Plan splits, throws EndOfScanException if the scan is ended.

listPartitionEntries

public List<PartitionEntry> listPartitionEntries()

withShard

public DataTableScan withShard(int indexOfThisSubtask,
                               int numberOfParallelSubtasks)

Description copied from interface: DataTableScan

Specify the shard to be read, and allocate sharded files to read records.

withBucket

@VisibleForTesting
public org.apache.paimon.table.source.AbstractDataTableScan withBucket(int bucket)

withBucketFilter

public org.apache.paimon.table.source.AbstractDataTableScan withBucketFilter(Filter<Integer> bucketFilter)

Specified by:

withBucketFilter in interface InnerTableScan

withPartitionFilter

public org.apache.paimon.table.source.AbstractDataTableScan withPartitionFilter(Map<String,String> partitionSpec)

Specified by:

withPartitionFilter in interface InnerTableScan

withPartitionFilter

public org.apache.paimon.table.source.AbstractDataTableScan withPartitionFilter(List<BinaryRow> partitions)

Specified by:

withPartitionFilter in interface InnerTableScan

withPartitionsFilter

public org.apache.paimon.table.source.AbstractDataTableScan withPartitionsFilter(List<Map<String,String>> partitions)

Specified by:

withPartitionsFilter in interface InnerTableScan

withLevelFilter

public org.apache.paimon.table.source.AbstractDataTableScan withLevelFilter(Filter<Integer> levelFilter)

Specified by:

withLevelFilter in interface InnerTableScan

withMetricsRegistry

public org.apache.paimon.table.source.AbstractDataTableScan withMetricsRegistry(MetricRegistry metricsRegistry)

Specified by:

withMetricsRegistry in interface InnerTableScan

dropStats

public org.apache.paimon.table.source.AbstractDataTableScan dropStats()

Specified by:

dropStats in interface InnerTableScan

options

public CoreOptions options()

createStartingScanner

protected StartingScanner createStartingScanner(boolean isStreaming)