Uses of Class
org.apache.paimon.options.MemorySize

Packages that use MemorySize

Package	Description
org.apache.paimon
org.apache.paimon.append
org.apache.paimon.catalog
org.apache.paimon.deletionvectors
org.apache.paimon.disk
org.apache.paimon.flink
org.apache.paimon.flink.sink
org.apache.paimon.flink.sink.cdc
org.apache.paimon.flink.sorter
org.apache.paimon.flink.utils
org.apache.paimon.format
org.apache.paimon.iceberg.manifest
org.apache.paimon.io.cache
org.apache.paimon.lookup
org.apache.paimon.memory
org.apache.paimon.mergetree
org.apache.paimon.operation
org.apache.paimon.options
org.apache.paimon.sort
org.apache.paimon.utils

Uses of MemorySize in org.apache.paimon

Fields in org.apache.paimon with type parameters of type MemorySize

Modifier and Type	Field and Description
static ConfigOption<MemorySize>	CoreOptions.CACHE_PAGE_SIZE
static ConfigOption<MemorySize>	CoreOptions.DELETION_VECTOR_INDEX_FILE_TARGET_SIZE
static ConfigOption<MemorySize>	CoreOptions.FILE_BLOCK_SIZE
static ConfigOption<MemorySize>	CoreOptions.FILE_INDEX_IN_MANIFEST_THRESHOLD
static ConfigOption<MemorySize>	CoreOptions.FILE_READER_ASYNC_THRESHOLD
static ConfigOption<MemorySize>	CoreOptions.LOCAL_MERGE_BUFFER_SIZE
static ConfigOption<MemorySize>	CoreOptions.LOOKUP_CACHE_MAX_DISK_SIZE
static ConfigOption<MemorySize>	CoreOptions.LOOKUP_CACHE_MAX_MEMORY_SIZE
static ConfigOption<MemorySize>	CoreOptions.MANIFEST_FULL_COMPACTION_FILE_SIZE
static ConfigOption<MemorySize>	CoreOptions.MANIFEST_TARGET_FILE_SIZE
static ConfigOption<MemorySize>	CoreOptions.PAGE_SIZE
static ConfigOption<MemorySize>	CoreOptions.SORT_SPILL_BUFFER_SIZE
static ConfigOption<MemorySize>	CoreOptions.SOURCE_SPLIT_OPEN_FILE_COST
static ConfigOption<MemorySize>	CoreOptions.SOURCE_SPLIT_TARGET_SIZE
static ConfigOption<MemorySize>	CoreOptions.TARGET_FILE_SIZE
static ConfigOption<MemorySize>	CoreOptions.WRITE_BUFFER_MAX_DISK_SIZE
static ConfigOption<MemorySize>	CoreOptions.WRITE_BUFFER_SIZE
static ConfigOption<MemorySize>	CoreOptions.WRITE_MANIFEST_CACHE

Methods in org.apache.paimon that return MemorySize

Modifier and Type	Method and Description
MemorySize	CoreOptions.deletionVectorIndexFileTargetSize()
MemorySize	CoreOptions.fileReaderAsyncThreshold()
MemorySize	CoreOptions.lookupCacheMaxMemory()
MemorySize	CoreOptions.manifestFullCompactionThresholdSize()
MemorySize	CoreOptions.manifestTargetSize()
MemorySize	CoreOptions.writeBufferSpillDiskSize()
MemorySize	CoreOptions.writeManifestCache()

Uses of MemorySize in org.apache.paimon.append

Constructors in org.apache.paimon.append with parameters of type MemorySize

Constructor and Description

AppendOnlyWriter(FileIO fileIO, IOManager ioManager, long schemaId, FileFormat fileFormat, long targetFileSize, RowType writeSchema, long maxSequenceNumber, CompactManager compactManager, IOFunction<List<DataFileMeta>,RecordReaderIterator<InternalRow>> bucketFileRead, boolean forceCompact, DataFilePathFactory pathFactory, CommitIncrement increment, boolean useWriteBuffer, boolean spillable, String fileCompression, CompressOptions spillCompression, SimpleColStatsCollector.Factory[] statsCollectors, MemorySize maxDiskSize, FileIndexOptions fileIndexOptions, boolean asyncFileWrite, boolean statsDenseStore)

Uses of MemorySize in org.apache.paimon.catalog

Constructors in org.apache.paimon.catalog with parameters of type MemorySize

Constructor and Description
CachingCatalog(Catalog wrapped, java.time.Duration expirationInterval, MemorySize manifestMaxMemory, long manifestCacheThreshold, long cachedPartitionMaxNum, int snapshotMaxNumPerTable)
CachingCatalog(Catalog wrapped, java.time.Duration expirationInterval, MemorySize manifestMaxMemory, long manifestCacheThreshold, long cachedPartitionMaxNum, int snapshotMaxNumPerTable, org.apache.paimon.shade.caffeine2.com.github.benmanes.caffeine.cache.Ticker ticker)

Uses of MemorySize in org.apache.paimon.deletionvectors

Constructors in org.apache.paimon.deletionvectors with parameters of type MemorySize

Constructor and Description
DeletionVectorIndexFileWriter(FileIO fileIO, PathFactory pathFactory, MemorySize targetSizePerIndexFile)
DeletionVectorsIndexFile(FileIO fileIO, PathFactory pathFactory, MemorySize targetSizePerIndexFile)

Uses of MemorySize in org.apache.paimon.disk

Methods in org.apache.paimon.disk with parameters of type MemorySize

Modifier and Type	Method and Description
static RowBuffer	RowBuffer.getBuffer(IOManager ioManager, MemorySegmentPool memoryPool, AbstractRowDataSerializer<InternalRow> serializer, boolean spillable, MemorySize maxDiskSize, CompressOptions compression)

Uses of MemorySize in org.apache.paimon.flink

Fields in org.apache.paimon.flink with type parameters of type MemorySize

Modifier and Type	Field and Description
static ConfigOption<MemorySize>	FlinkConnectorOptions.SINK_COMMITTER_MEMORY
static ConfigOption<MemorySize>	FlinkConnectorOptions.SINK_CROSS_PARTITION_MANAGED_MEMORY
static ConfigOption<MemorySize>	FlinkConnectorOptions.SINK_MANAGED_WRITER_BUFFER_MEMORY Weight of writer buffer in managed memory, Flink will compute the memory size for writer according to the weight, the actual memory used depends on the running environment.

Uses of MemorySize in org.apache.paimon.flink.sink

Methods in org.apache.paimon.flink.sink with parameters of type MemorySize

Modifier and Type	Method and Description
static void	FlinkSink.configureGlobalCommitter(org.apache.flink.streaming.api.datastream.SingleOutputStreamOperator<?> committed, double cpuCores, MemorySize heapMemory)

Uses of MemorySize in org.apache.paimon.flink.sink.cdc

Constructors in org.apache.paimon.flink.sink.cdc with parameters of type MemorySize

Constructor and Description
FlinkCdcMultiTableSink(Catalog.Loader catalogLoader, double commitCpuCores, MemorySize commitHeapMemory, boolean commitChaining, String commitUser)

Uses of MemorySize in org.apache.paimon.flink.sorter

Constructors in org.apache.paimon.flink.sorter with parameters of type MemorySize

Constructor and Description
SortOperator(RowType keyType, RowType rowType, long maxMemory, int pageSize, int spillSortMaxNumFiles, CompressOptions spillCompression, int sinkParallelism, MemorySize maxDiskSize, boolean sequenceOrder)

Uses of MemorySize in org.apache.paimon.flink.utils

Methods in org.apache.paimon.flink.utils with parameters of type MemorySize

Modifier and Type	Method and Description
static void	ManagedMemoryUtils.declareManagedMemory(org.apache.flink.streaming.api.datastream.DataStream<?> dataStream, MemorySize memorySize)

Uses of MemorySize in org.apache.paimon.format

Methods in org.apache.paimon.format that return MemorySize

Modifier and Type	Method and Description
MemorySize	FileFormatFactory.FormatContext.blockSize()

Constructors in org.apache.paimon.format with parameters of type MemorySize

Constructor and Description
FormatContext(Options options, int readBatchSize, int writeBatchSize, int zstdLevel, MemorySize blockSize)

Uses of MemorySize in org.apache.paimon.iceberg.manifest

Constructors in org.apache.paimon.iceberg.manifest with parameters of type MemorySize

Constructor and Description
IcebergManifestFile(FileIO fileIO, RowType partitionType, FormatReaderFactory readerFactory, FormatWriterFactory writerFactory, String compression, PathFactory pathFactory, MemorySize targetFileSize)

Uses of MemorySize in org.apache.paimon.io.cache

Fields in org.apache.paimon.io.cache declared as MemorySize

Modifier and Type	Field and Description
protected MemorySize	CacheBuilder.memorySize

Constructors in org.apache.paimon.io.cache with parameters of type MemorySize

Constructor and Description
CacheManager(Cache.CacheType cacheType, MemorySize maxMemorySize, double highPriorityPoolRatio)
CacheManager(MemorySize maxMemorySize)
CacheManager(MemorySize dataMaxMemorySize, double highPriorityPoolRatio)

Uses of MemorySize in org.apache.paimon.lookup

Fields in org.apache.paimon.lookup with type parameters of type MemorySize

Modifier and Type	Field and Description
static ConfigOption<MemorySize>	RocksDBOptions.BLOCK_CACHE_SIZE
static ConfigOption<MemorySize>	RocksDBOptions.BLOCK_SIZE
static ConfigOption<MemorySize>	RocksDBOptions.LOG_MAX_FILE_SIZE
static ConfigOption<MemorySize>	RocksDBOptions.MAX_SIZE_LEVEL_BASE
static ConfigOption<MemorySize>	RocksDBOptions.METADATA_BLOCK_SIZE
static ConfigOption<MemorySize>	RocksDBOptions.TARGET_FILE_SIZE_BASE
static ConfigOption<MemorySize>	RocksDBOptions.WRITE_BUFFER_SIZE

Uses of MemorySize in org.apache.paimon.memory

Methods in org.apache.paimon.memory with parameters of type MemorySize

Modifier and Type	Method and Description
static MemorySegmentPool	MemorySegmentPool.createHeapPool(MemorySize maxMemory, MemorySize pageSize)

Uses of MemorySize in org.apache.paimon.mergetree

Methods in org.apache.paimon.mergetree with parameters of type MemorySize

Modifier and Type	Method and Description
static org.apache.paimon.shade.caffeine2.com.github.benmanes.caffeine.cache.Cache<String,LookupFile>	LookupFile.createCache(java.time.Duration fileRetention, MemorySize maxDiskSize)

Constructors in org.apache.paimon.mergetree with parameters of type MemorySize

Constructor and Description
MergeTreeWriter(boolean writeBufferSpillable, MemorySize maxDiskSize, int sortMaxFan, CompressOptions sortCompression, IOManager ioManager, CompactManager compactManager, long maxSequenceNumber, Comparator<InternalRow> keyComparator, MergeFunction<KeyValue> mergeFunction, KeyValueFileWriterFactory writerFactory, boolean commitForceCompact, CoreOptions.ChangelogProducer changelogProducer, CommitIncrement increment, FieldsComparator userDefinedSeqComparator)
SortBufferWriteBuffer(RowType keyType, RowType valueType, FieldsComparator userDefinedSeqComparator, MemorySegmentPool memoryPool, boolean spillable, MemorySize maxDiskSize, int sortMaxFan, CompressOptions compression, IOManager ioManager)

Uses of MemorySize in org.apache.paimon.operation

Constructors in org.apache.paimon.operation with parameters of type MemorySize

Constructor and Description

FileStoreCommitImpl(FileIO fileIO, SchemaManager schemaManager, String tableName, String commitUser, RowType partitionType, String partitionDefaultName, FileStorePathFactory pathFactory, SnapshotManager snapshotManager, ManifestFile.Factory manifestFileFactory, ManifestList.Factory manifestListFactory, IndexManifestFile.Factory indexManifestFileFactory, FileStoreScan scan, int numBucket, MemorySize manifestTargetSize, MemorySize manifestFullCompactionSize, int manifestMergeMinCount, boolean dynamicPartitionOverwrite, Comparator<InternalRow> keyComparator, String branchName, StatsFileHandler statsFileHandler, BucketMode bucketMode, Integer manifestReadParallelism, List<CommitCallback> commitCallbacks, int commitMaxRetries)

Uses of MemorySize in org.apache.paimon.options

Fields in org.apache.paimon.options declared as MemorySize

Modifier and Type	Field and Description
static MemorySize	MemorySize.MAX_VALUE
static MemorySize	MemorySize.VALUE_128_MB
static MemorySize	MemorySize.VALUE_256_MB
static MemorySize	MemorySize.ZERO

Fields in org.apache.paimon.options with type parameters of type MemorySize

Modifier and Type	Field and Description
static ConfigOption<MemorySize>	CatalogOptions.CACHE_MANIFEST_MAX_MEMORY
static ConfigOption<MemorySize>	CatalogOptions.CACHE_MANIFEST_SMALL_FILE_MEMORY
static ConfigOption<MemorySize>	CatalogOptions.CACHE_MANIFEST_SMALL_FILE_THRESHOLD

Methods in org.apache.paimon.options that return MemorySize

Modifier and Type	Method and Description
MemorySize	MemorySize.add(MemorySize that)
MemorySize	MemorySize.divide(long by)
MemorySize	MemorySize.multiply(double multiplier)
static MemorySize	MemorySize.ofBytes(long bytes)
static MemorySize	MemorySize.ofKibiBytes(long kibiBytes)
static MemorySize	MemorySize.ofMebiBytes(long mebiBytes)
static MemorySize	MemorySize.parse(String text) Parses the given string as as MemorySize.
static MemorySize	MemorySize.parse(String text, MemorySize.MemoryUnit defaultUnit) Parses the given string with a default unit.
MemorySize	MemorySize.subtract(MemorySize that)

Methods in org.apache.paimon.options that return types with arguments of type MemorySize

Modifier and Type	Method and Description
ConfigOptions.TypedConfigOptionBuilder<MemorySize>	ConfigOptions.OptionBuilder.memoryType() Defines that the value of the option should be of MemorySize type.

Methods in org.apache.paimon.options with parameters of type MemorySize

Modifier and Type	Method and Description
MemorySize	MemorySize.add(MemorySize that)
int	MemorySize.compareTo(MemorySize that)
MemorySize	MemorySize.subtract(MemorySize that)

Uses of MemorySize in org.apache.paimon.sort

Methods in org.apache.paimon.sort with parameters of type MemorySize

Modifier and Type	Method and Description
static BinaryExternalSortBuffer	BinaryExternalSortBuffer.create(IOManager ioManager, RowType rowType, int[] keyFields, long bufferSize, int pageSize, int maxNumFileHandles, CompressOptions compression, MemorySize maxDiskSize, boolean sequenceOrder)
static BinaryExternalSortBuffer	BinaryExternalSortBuffer.create(IOManager ioManager, RowType rowType, int[] keyFields, MemorySegmentPool pool, int maxNumFileHandles, CompressOptions compression, MemorySize maxDiskSize, boolean sequenceOrder)

Constructors in org.apache.paimon.sort with parameters of type MemorySize

Constructor and Description
BinaryExternalSortBuffer(BinaryRowSerializer serializer, RecordComparator comparator, int pageSize, BinaryInMemorySortBuffer inMemorySortBuffer, IOManager ioManager, int maxNumFileHandles, CompressOptions compression, MemorySize maxDiskSize)

Uses of MemorySize in org.apache.paimon.utils

Methods in org.apache.paimon.utils that return MemorySize

Modifier and Type	Method and Description
MemorySize	SegmentsCache.maxMemorySize()

Methods in org.apache.paimon.utils with parameters of type MemorySize

Modifier and Type	Method and Description
static <T> SegmentsCache<T>	SegmentsCache.create(int pageSize, MemorySize maxMemorySize, long maxElementSize)
static <T> SegmentsCache<T>	SegmentsCache.create(MemorySize maxMemorySize, long maxElementSize)

Constructors in org.apache.paimon.utils with parameters of type MemorySize

Constructor and Description
SegmentsCache(int pageSize, MemorySize maxMemorySize, long maxElementSize)