public interface StoreSinkWrite
PrepareCommitOperator
for different types of paimon sinks.Modifier and Type | Interface and Description |
---|---|
static interface |
StoreSinkWrite.Provider
Provider of
StoreSinkWrite . |
static interface |
StoreSinkWrite.WithWriteBufferProvider
Provider of
StoreSinkWrite that uses given write buffer. |
Modifier and Type | Method and Description |
---|---|
void |
close() |
void |
compact(BinaryRow partition,
int bucket,
boolean fullCompaction) |
void |
notifyNewFiles(long snapshotId,
BinaryRow partition,
int bucket,
List<DataFileMeta> files) |
List<Committable> |
prepareCommit(boolean waitCompaction,
long checkpointId) |
void |
replace(FileStoreTable newTable)
Replace the internal
TableWriteImpl with the one provided by newWriteProvider . |
void |
snapshotState() |
boolean |
streamingMode() |
SinkRecord |
toLogRecord(SinkRecord record) |
void |
withInsertOnly(boolean insertOnly)
This method is called when the insert only status of the records changes.
|
SinkRecord |
write(InternalRow rowData) |
SinkRecord |
write(InternalRow rowData,
int bucket) |
void withInsertOnly(boolean insertOnly)
insertOnly
- If true, all the following records would be of RowKind.INSERT
, and no two records would have the same primary
key.@Nullable SinkRecord write(InternalRow rowData) throws Exception
Exception
@Nullable SinkRecord write(InternalRow rowData, int bucket) throws Exception
Exception
SinkRecord toLogRecord(SinkRecord record)
void compact(BinaryRow partition, int bucket, boolean fullCompaction) throws Exception
Exception
void notifyNewFiles(long snapshotId, BinaryRow partition, int bucket, List<DataFileMeta> files)
List<Committable> prepareCommit(boolean waitCompaction, long checkpointId) throws IOException
IOException
boolean streamingMode()
void replace(FileStoreTable newTable) throws Exception
TableWriteImpl
with the one provided by newWriteProvider
. The state of the old TableWriteImpl
will also be transferred to
the new TableWriteImpl
by TableWriteImpl.checkpoint()
and TableWriteImpl.restore(List)
.
Currently, this method is only used by CDC sinks because they need to deal with schema
changes. TableWriteImpl
with the new schema will be provided by newWriteProvider
.
Exception
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.