Package org.apache.flink.cdc.connectors.fluss.source.reader

Class FlussSourceReader<T>

java.lang.Object

org.apache.flink.connector.base.source.reader.SourceReaderBase<E,T,SplitT,SplitStateT>

org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<E,T,SplitT,SplitStateT>

org.apache.flink.cdc.source.SingleThreadMultiplexSourceReaderBaseAdapter<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

org.apache.flink.cdc.connectors.fluss.source.reader.FlussSourceReader<T>

Type Parameters:

T - The type of output records produced by this reader.

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SourceReader<T,FlussSplitBase>

public class FlussSourceReader<T>
extends org.apache.flink.cdc.source.SingleThreadMultiplexSourceReaderBaseAdapter<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

A generic SourceReader for Fluss, built on top of Flink's SingleThreadMultiplexSourceReaderBase. This delegates the low-level split management, fetcher lifecycle, and availability tracking to the base class, and only provides Fluss-specific initialization logic.

The output type T is determined by the provided FlussDeserializer, making this reader reusable for different output types.

Field Summary

Fields inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

config, context, eofRecordEvaluator, options, splitFetcherManager

Constructor Summary

Constructors

Constructor

Description

FlussSourceReader(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<FlussSourceRecord>> elementsQueue, org.apache.flink.api.connector.source.SourceReaderContext readerContext, org.apache.fluss.config.Configuration flussConfig, WrapperFlussMetricRegistry metricRegistry, FlussSourceReaderMetrics sourceReaderMetrics, FlussRecordEmitter<T> recordEmitter)

Method Summary

Modifier and Type	Method	Description
void	addSplits(List<FlussSplitBase> splits)
void	close()
void	handleSourceEvents(org.apache.flink.api.connector.source.SourceEvent sourceEvent)
protected FlussSplitState	initializedState(FlussSplitBase split)
protected void	onSplitFinished(Map<String,FlussSplitState> finishedSplitIds)
List<FlussSplitBase>	snapshotState(long checkpointId)
protected FlussSplitBase	toSplitType(String splitId, FlussSplitState splitState)

Methods inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

getNumberOfCurrentlyAssignedSplits, isAvailable, notifyNoMoreSplits, pauseOrResumeSplits, pollNext, start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Methods inherited from interface org.apache.flink.api.connector.source.SourceReader

notifyCheckpointComplete

Constructor Detail

FlussSourceReader

public FlussSourceReader(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<FlussSourceRecord>> elementsQueue,
                         org.apache.flink.api.connector.source.SourceReaderContext readerContext,
                         org.apache.fluss.config.Configuration flussConfig,
                         WrapperFlussMetricRegistry metricRegistry,
                         FlussSourceReaderMetrics sourceReaderMetrics,
                         FlussRecordEmitter<T> recordEmitter)

Method Detail

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

Throws:

Exception

initializedState

protected FlussSplitState initializedState(FlussSplitBase split)

Specified by:

initializedState in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

toSplitType

protected FlussSplitBase toSplitType(String splitId,
                                     FlussSplitState splitState)

Specified by:

toSplitType in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

snapshotState

public List<FlussSplitBase> snapshotState(long checkpointId)

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SourceReader<T,FlussSplitBase>

Overrides:

snapshotState in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

addSplits

public void addSplits(List<FlussSplitBase> splits)

Specified by:

addSplits in interface org.apache.flink.api.connector.source.SourceReader<T,FlussSplitBase>

Overrides:

addSplits in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

handleSourceEvents

public void handleSourceEvents(org.apache.flink.api.connector.source.SourceEvent sourceEvent)

Specified by:

handleSourceEvents in interface org.apache.flink.api.connector.source.SourceReader<T,FlussSplitBase>

Overrides:

handleSourceEvents in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>

onSplitFinished

protected void onSplitFinished(Map<String,FlussSplitState> finishedSplitIds)

Specified by:

onSplitFinished in class org.apache.flink.connector.base.source.reader.SourceReaderBase<FlussSourceRecord,T,FlussSplitBase,FlussSplitState>