org.apache.paimon.flink.action.cdc

Class MessageQueueSchemaUtils

java.lang.Object

org.apache.paimon.flink.action.cdc.MessageQueueSchemaUtils

public class MessageQueueSchemaUtils
extends Object

Utility class to build schema by trying to read and parse records from message queue.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	MessageQueueSchemaUtils.ConsumerWrapper Wrap the consumer for different message queues.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.flink.configuration.ConfigOption<String>	SCHEMA_REGISTRY_URL

Constructor Summary

Constructors

Constructor and Description
MessageQueueSchemaUtils()

Method Summary

Modifier and Type	Method and Description
static Schema	getSchema(MessageQueueSchemaUtils.ConsumerWrapper consumer, DataFormat dataFormat, TypeMapping typeMapping) Retrieves the Kafka schema for a given topic.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SCHEMA_REGISTRY_URL

public static final org.apache.flink.configuration.ConfigOption<String> SCHEMA_REGISTRY_URL

Constructor Detail

MessageQueueSchemaUtils

public MessageQueueSchemaUtils()

Method Detail

getSchema

public static Schema getSchema(MessageQueueSchemaUtils.ConsumerWrapper consumer,
                               DataFormat dataFormat,
                               TypeMapping typeMapping)
                        throws SyncTableActionBase.SchemaRetrievalException

Retrieves the Kafka schema for a given topic.

Parameters:

consumer - The wrapper of message queue consumer to fetch messages.

dataFormat - The data format for the messages in the message queue.

typeMapping - Data type mapping options.

Returns:

The schema for the topic.

Throws:

SyncTableActionBase.SchemaRetrievalException - If unable to retrieve the schema after max retries.