Package org.apache.flink.cdc.connectors.paimon.sink.v2

Class PaimonSink<InputT>

java.lang.Object

org.apache.flink.cdc.connectors.paimon.sink.v2.PaimonSink<InputT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.sink2.Sink<InputT>, org.apache.flink.api.connector.sink2.SupportsCommitter<org.apache.paimon.flink.sink.MultiTableCommittable>, org.apache.flink.api.connector.sink2.SupportsWriterState<InputT,PaimonWriterState>, org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,org.apache.paimon.flink.sink.MultiTableCommittable>, org.apache.flink.streaming.api.connector.sink2.SupportsPreCommitTopology<org.apache.paimon.flink.sink.MultiTableCommittable,org.apache.paimon.flink.sink.MultiTableCommittable>

Direct Known Subclasses:

PaimonEventSink

public class PaimonSink<InputT>
extends Object
implements org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,org.apache.paimon.flink.sink.MultiTableCommittable>, org.apache.flink.streaming.api.connector.sink2.SupportsPreCommitTopology<org.apache.paimon.flink.sink.MultiTableCommittable,org.apache.paimon.flink.sink.MultiTableCommittable>, org.apache.flink.api.connector.sink2.SupportsWriterState<InputT,PaimonWriterState>

A Sink for Paimon. Maintain this package until Paimon has it own sinkV2 implementation.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.Sink

org.apache.flink.api.connector.sink2.Sink.InitContext, org.apache.flink.api.connector.sink2.Sink.InitContextWrapper

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.SupportsWriterState

org.apache.flink.api.connector.sink2.SupportsWriterState.WithCompatibleState

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink.PrecommittingSinkWriter<InputT extends Object,CommT extends Object>

Field Summary

Fields

Modifier and Type	Field	Description
protected org.apache.paimon.options.Options	catalogOptions
protected String	commitUser	The commitUser should be restored in state and restore it in writer.
static String	DEFAULT_COMMIT_USER

Constructor Summary

Constructors

Constructor	Description
PaimonSink(org.apache.paimon.options.Options catalogOptions, String commitUser, PaimonRecordSerializer<InputT> serializer)
PaimonSink(org.apache.paimon.options.Options catalogOptions, PaimonRecordSerializer<InputT> serializer)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.streaming.api.connector.sink2.CommittableMessage<org.apache.paimon.flink.sink.MultiTableCommittable>>	addPreCommitTopology(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.streaming.api.connector.sink2.CommittableMessage<org.apache.paimon.flink.sink.MultiTableCommittable>> committables)
org.apache.flink.api.connector.sink2.Committer<org.apache.paimon.flink.sink.MultiTableCommittable>	createCommitter()
org.apache.flink.api.connector.sink2.Committer<org.apache.paimon.flink.sink.MultiTableCommittable>	createCommitter(org.apache.flink.api.connector.sink2.CommitterInitContext context)
PaimonWriter<InputT>	createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)	Deprecated.
PaimonWriter<InputT>	createWriter(org.apache.flink.api.connector.sink2.WriterInitContext context)
org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.paimon.flink.sink.MultiTableCommittable>	getCommittableSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.paimon.flink.sink.MultiTableCommittable>	getWriteResultSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<PaimonWriterState>	getWriterStateSerializer()
org.apache.flink.api.connector.sink2.StatefulSinkWriter<InputT,PaimonWriterState>	restoreWriter(org.apache.flink.api.connector.sink2.WriterInitContext context, Collection<PaimonWriterState> paimonWriterStates)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_COMMIT_USER

public static final String DEFAULT_COMMIT_USER

See Also:

Constant Field Values

catalogOptions

protected final org.apache.paimon.options.Options catalogOptions

commitUser

protected final String commitUser

The commitUser should be restored in state and restore it in writer.

Constructor Detail

PaimonSink

public PaimonSink(org.apache.paimon.options.Options catalogOptions,
                  PaimonRecordSerializer<InputT> serializer)

PaimonSink

public PaimonSink(org.apache.paimon.options.Options catalogOptions,
                  String commitUser,
                  PaimonRecordSerializer<InputT> serializer)

Method Detail

createWriter

public PaimonWriter<InputT> createWriter(org.apache.flink.api.connector.sink2.WriterInitContext context)

Specified by:

createWriter in interface org.apache.flink.api.connector.sink2.Sink<InputT>

createWriter

@Deprecated
public PaimonWriter<InputT> createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)

Deprecated.

Specified by:

createWriter in interface org.apache.flink.api.connector.sink2.Sink<InputT>

restoreWriter

public org.apache.flink.api.connector.sink2.StatefulSinkWriter<InputT,PaimonWriterState> restoreWriter(org.apache.flink.api.connector.sink2.WriterInitContext context,
                                                                                                             Collection<PaimonWriterState> paimonWriterStates)

Specified by:

restoreWriter in interface org.apache.flink.api.connector.sink2.SupportsWriterState<InputT,PaimonWriterState>

createCommitter

public org.apache.flink.api.connector.sink2.Committer<org.apache.paimon.flink.sink.MultiTableCommittable> createCommitter(org.apache.flink.api.connector.sink2.CommitterInitContext context)

Specified by:

createCommitter in interface org.apache.flink.api.connector.sink2.SupportsCommitter<InputT>

Specified by:

createCommitter in interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,org.apache.paimon.flink.sink.MultiTableCommittable>

createCommitter

public org.apache.flink.api.connector.sink2.Committer<org.apache.paimon.flink.sink.MultiTableCommittable> createCommitter()

Specified by:

createCommitter in interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,org.apache.paimon.flink.sink.MultiTableCommittable>

getCommittableSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.paimon.flink.sink.MultiTableCommittable> getCommittableSerializer()

Specified by:

getCommittableSerializer in interface org.apache.flink.api.connector.sink2.SupportsCommitter<InputT>

getWriteResultSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.paimon.flink.sink.MultiTableCommittable> getWriteResultSerializer()

Specified by:

getWriteResultSerializer in interface org.apache.flink.streaming.api.connector.sink2.SupportsPreCommitTopology<org.apache.paimon.flink.sink.MultiTableCommittable,org.apache.paimon.flink.sink.MultiTableCommittable>

addPreCommitTopology

public org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.streaming.api.connector.sink2.CommittableMessage<org.apache.paimon.flink.sink.MultiTableCommittable>> addPreCommitTopology(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.streaming.api.connector.sink2.CommittableMessage<org.apache.paimon.flink.sink.MultiTableCommittable>> committables)

Specified by:

addPreCommitTopology in interface org.apache.flink.streaming.api.connector.sink2.SupportsPreCommitTopology<org.apache.paimon.flink.sink.MultiTableCommittable,org.apache.paimon.flink.sink.MultiTableCommittable>

getWriterStateSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<PaimonWriterState> getWriterStateSerializer()

Specified by:

getWriterStateSerializer in interface org.apache.flink.api.connector.sink2.SupportsWriterState<InputT,PaimonWriterState>