Modifier and Type | Method and Description |
---|---|
Pair<String,String> |
CoreOptions.incrementalBetween() |
Constructor and Description |
---|
RefreshBlacklist(List<Pair<Long,Long>> timePeriodsBlacklist) |
Modifier and Type | Method and Description |
---|---|
Pair<SimpleColStats[],SimpleStatsExtractor.FileInfo> |
SimpleStatsExtractor.extractWithFileInfo(FileIO fileIO,
Path path) |
Modifier and Type | Method and Description |
---|---|
Pair<SimpleColStats[],SimpleStatsExtractor.FileInfo> |
AvroSimpleStatsExtractor.extractWithFileInfo(FileIO fileIO,
Path path) |
Modifier and Type | Method and Description |
---|---|
Pair<SimpleColStats[],SimpleStatsExtractor.FileInfo> |
OrcSimpleStatsExtractor.extractWithFileInfo(FileIO fileIO,
Path path) |
Modifier and Type | Method and Description |
---|---|
static Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,SimpleStatsExtractor.FileInfo> |
ParquetUtil.extractColumnStats(FileIO fileIO,
Path path)
Extract stats from specified Parquet files path.
|
Pair<SimpleColStats[],SimpleStatsExtractor.FileInfo> |
ParquetSimpleStatsExtractor.extractWithFileInfo(FileIO fileIO,
Path path) |
Modifier and Type | Field and Description |
---|---|
protected Map<Pair<String,String>,org.apache.hadoop.fs.FileSystem> |
HadoopFileIO.fsMap |
Modifier and Type | Method and Description |
---|---|
LinkedHashMap<String,Pair<Integer,Integer>> |
IndexFileMeta.deletionVectorsRanges() |
static LinkedHashMap<String,Pair<Integer,Integer>> |
IndexFileMetaSerializer.rowArrayDataToDvRanges(InternalArray arrayData) |
Map<Pair<BinaryRow,Integer>,List<IndexFileMeta>> |
IndexFileHandler.scan(long snapshot,
String indexType,
Set<BinaryRow> partitions) |
Map<Pair<BinaryRow,Integer>,List<IndexFileMeta>> |
IndexFileHandler.scan(Snapshot snapshot,
String indexType,
Set<BinaryRow> partitions) |
Modifier and Type | Method and Description |
---|---|
static InternalArray |
IndexFileMetaSerializer.dvRangesToRowArrayData(LinkedHashMap<String,Pair<Integer,Integer>> dvRanges) |
Constructor and Description |
---|
IndexFileMeta(String indexType,
String fileName,
long fileSize,
long rowCount,
LinkedHashMap<String,Pair<Integer,Integer>> deletionVectorsRanges) |
Modifier and Type | Method and Description |
---|---|
static void |
BucketEntry.merge(Collection<BucketEntry> from,
Map<Pair<BinaryRow,Integer>,BucketEntry> to) |
Modifier and Type | Method and Description |
---|---|
protected void |
OrphanFilesClean.collectWithoutDataFileWithManifestFlag(String branch,
Snapshot snapshot,
java.util.function.Consumer<Pair<String,Boolean>> usedFileWithFlagConsumer) |
protected void |
FileDeletionBase.doCleanUnusedDataFile(Map<Path,Pair<ManifestEntry,List<Path>>> dataFileToDelete,
java.util.function.Predicate<ManifestEntry> skipper) |
protected void |
FileDeletionBase.getDataFileToDelete(Map<Path,Pair<ManifestEntry,List<Path>>> dataFileToDelete,
List<ManifestEntry> dataFileEntries) |
Modifier and Type | Method and Description |
---|---|
static Pair<Pair<int[],RowType>,List<DataField>> |
PartitionUtils.constructPartitionMapping(TableSchema dataSchema,
List<DataField> dataFields) |
Modifier and Type | Method and Description |
---|---|
static Pair<Pair<int[],RowType>,List<DataField>> |
PartitionUtils.constructPartitionMapping(TableSchema dataSchema,
List<DataField> dataFields) |
Modifier and Type | Method and Description |
---|---|
static PartitionInfo |
PartitionUtils.create(Pair<int[],RowType> pair,
BinaryRow binaryRow) |
Modifier and Type | Method and Description |
---|---|
static <C,T> Pair<C,T> |
SparkUtils.catalogAndIdentifier(List<String> nameParts,
java.util.function.Function<String,C> catalogProvider,
java.util.function.BiFunction<String[],String,T> identifierProvider,
C currentCatalog,
String[] currentNamespace)
A modified version of Spark's LookupCatalog.CatalogAndIdentifier.unapply Attempts to find the
catalog and identifier a multipart identifier represents.
|
Constructor and Description |
---|
CatalogAndIdentifier(Pair<org.apache.spark.sql.connector.catalog.CatalogPlugin,org.apache.spark.sql.connector.catalog.Identifier> identifier) |
Modifier and Type | Method and Description |
---|---|
Pair<List<String>,SimpleStats> |
SimpleStatsConverter.toBinary(SimpleColStats[] stats) |
Modifier and Type | Method and Description |
---|---|
Pair<int[],RowType> |
BulkFormatMapping.getPartitionPair() |
static <L,R> Pair<L,R> |
Pair.of(L left,
R right) |
Modifier and Type | Method and Description |
---|---|
List<Pair<Tag,String>> |
TagManager.tagObjects()
Get all
Tag s. |
List<Pair<Path,Long>> |
SnapshotManager.tryGetNonChangelogFiles(java.util.function.Predicate<FileStatus> fileStatusFilter) |
List<Pair<Path,Long>> |
SnapshotManager.tryGetNonSnapshotFiles(java.util.function.Predicate<FileStatus> fileStatusFilter)
Try to get non snapshot files.
|
Constructor and Description |
---|
BulkFormatMapping(int[] indexMapping,
CastFieldGetter[] castMapping,
Pair<int[],RowType> partitionPair,
FormatReaderFactory bulkFormat,
TableSchema dataSchema,
List<Predicate> dataFilters) |
Constructor and Description |
---|
ParallelExecution(Serializer<T> serializer,
int pageSize,
int parallelism,
List<java.util.function.Supplier<Pair<RecordReader<T>,E>>> readers) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.