Package org.apache.flink.cdc.connectors.base.source.reader

Class IncrementalSourceReaderWithCommit

java.lang.Object

org.apache.flink.connector.base.source.reader.SourceReaderBase<E,T,SplitT,SplitStateT>

org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<SourceRecords,T,SourceSplitBase,SourceSplitState>

org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceReader

org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceReaderWithCommit

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SourceReader

Direct Known Subclasses:

PostgresSourceReader

@Experimental
public class IncrementalSourceReaderWithCommit
extends IncrementalSourceReader

Record the LSN of checkpoint StreamSplit, which can be used to submit to the CDC source.

Field Summary

Fields

Modifier and Type	Field	Description
protected TreeMap<Long,Offset>	lastCheckpointOffsets

Fields inherited from class org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceReader

dialect, incrementalSourceReaderContext, sourceConfig, suspendedStreamSplit, uncompletedStreamSplits

Fields inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

config, context, eofRecordEvaluator, options, recordEmitter, splitFetcherManager

Constructor Summary

Constructors

Constructor

Description

IncrementalSourceReaderWithCommit(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue elementQueue, java.util.function.Supplier supplier, org.apache.flink.connector.base.source.reader.RecordEmitter recordEmitter, org.apache.flink.configuration.Configuration config, IncrementalSourceReaderContext incrementalSourceReaderContext, SourceConfig sourceConfig, SourceSplitSerializer sourceSplitSerializer, DataSourceDialect dialect)

Method Summary

Modifier and Type	Method	Description
void	notifyCheckpointComplete(long checkpointId)
List<SourceSplitBase>	snapshotState(long checkpointId)

Methods inherited from class org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceReader

addSplits, getFinishedUnackedSplits, getNextMetaGroupId, handleSourceEvents, initializedState, onSplitFinished, start, toSplitType, updateStreamSplitFinishedSplitsSize

Methods inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

close, getNumberOfCurrentlyAssignedSplits, isAvailable, notifyNoMoreSplits, pauseOrResumeSplits, pollNext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Field Detail

lastCheckpointOffsets

protected final TreeMap<Long,Offset> lastCheckpointOffsets

Constructor Detail

IncrementalSourceReaderWithCommit

public IncrementalSourceReaderWithCommit(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue elementQueue,
                                         java.util.function.Supplier supplier,
                                         org.apache.flink.connector.base.source.reader.RecordEmitter recordEmitter,
                                         org.apache.flink.configuration.Configuration config,
                                         IncrementalSourceReaderContext incrementalSourceReaderContext,
                                         SourceConfig sourceConfig,
                                         SourceSplitSerializer sourceSplitSerializer,
                                         DataSourceDialect dialect)

Method Detail

snapshotState

public List<SourceSplitBase> snapshotState(long checkpointId)

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SourceReader

Overrides:

snapshotState in class IncrementalSourceReader

notifyCheckpointComplete

public void notifyCheckpointComplete(long checkpointId)
                              throws Exception

Throws:

Exception