Package org.apache.flink.cdc.connectors.mysql.debezium.reader

Class SnapshotSplitReader

java.lang.Object

org.apache.flink.cdc.connectors.mysql.debezium.reader.SnapshotSplitReader

All Implemented Interfaces:

DebeziumReader<SourceRecords,MySqlSplit>

public class SnapshotSplitReader
extends Object
implements DebeziumReader<SourceRecords,MySqlSplit>

A snapshot reader that reads data from Table in split level, the split is assigned by primary key range.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SnapshotSplitReader.SnapshotSplitChangeEventSourceContextImpl	ChangeEventSource.ChangeEventSourceContext implementation that keeps low/high watermark for each MySqlSnapshotSplit.

Field Summary

Fields

Modifier and Type	Field	Description
AtomicBoolean	hasNextElement
AtomicBoolean	reachEnd

Constructor Summary

Constructors

Constructor	Description
SnapshotSplitReader(StatefulTaskContext statefulTaskContext, int subtaskId)
SnapshotSplitReader(StatefulTaskContext statefulTaskContext, int subtaskId, SnapshotPhaseHooks hooks)
SnapshotSplitReader(MySqlSourceConfig sourceConfig, int subtaskId, SnapshotPhaseHooks hooks)

Method Summary

Modifier and Type	Method	Description
void	close()	Close the reader and releases all resources.
ExecutorService	getExecutorService()
boolean	isFinished()	Return the current split of the reader is finished or not.
Iterator<SourceRecords>	pollSplitRecords()	Reads records from MySQL.
Iterator<SourceRecords>	pollWithBuffer()
Iterator<SourceRecords>	pollWithoutBuffer()
void	submitSplit(MySqlSplit mySqlSplit)	Add to split to read, this should call only the when reader is idle.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

hasNextElement

public AtomicBoolean hasNextElement

reachEnd

public AtomicBoolean reachEnd

Constructor Detail

SnapshotSplitReader

public SnapshotSplitReader(MySqlSourceConfig sourceConfig,
                           int subtaskId,
                           SnapshotPhaseHooks hooks)

SnapshotSplitReader

public SnapshotSplitReader(StatefulTaskContext statefulTaskContext,
                           int subtaskId,
                           SnapshotPhaseHooks hooks)

SnapshotSplitReader

public SnapshotSplitReader(StatefulTaskContext statefulTaskContext,
                           int subtaskId)

Method Detail

submitSplit

public void submitSplit(MySqlSplit mySqlSplit)

Description copied from interface: DebeziumReader

Add to split to read, this should call only the when reader is idle.

Specified by:

submitSplit in interface DebeziumReader<SourceRecords,MySqlSplit>

isFinished

public boolean isFinished()

Description copied from interface: DebeziumReader

Return the current split of the reader is finished or not.

Specified by:

isFinished in interface DebeziumReader<SourceRecords,MySqlSplit>

pollSplitRecords

@Nullable
public Iterator<SourceRecords> pollSplitRecords()
                                         throws InterruptedException

Description copied from interface: DebeziumReader

Reads records from MySQL. The method should return null when reaching the end of the split, the empty Iterator will be returned if the data of split is on pulling.

Specified by:

pollSplitRecords in interface DebeziumReader<SourceRecords,MySqlSplit>

Throws:

InterruptedException

pollWithoutBuffer

public Iterator<SourceRecords> pollWithoutBuffer()
                                          throws InterruptedException

Throws:

InterruptedException

pollWithBuffer

public Iterator<SourceRecords> pollWithBuffer()
                                       throws InterruptedException

Throws:

InterruptedException

close

public void close()

Description copied from interface: DebeziumReader

Close the reader and releases all resources.

Specified by:

close in interface DebeziumReader<SourceRecords,MySqlSplit>

getExecutorService

@VisibleForTesting
public ExecutorService getExecutorService()