Package org.apache.flink.cdc.connectors.mysql.source.split

Class MySqlBinlogSplit

java.lang.Object

org.apache.flink.cdc.connectors.mysql.source.split.MySqlSplit

org.apache.flink.cdc.connectors.mysql.source.split.MySqlBinlogSplit

All Implemented Interfaces:

org.apache.flink.api.connector.source.SourceSplit

public class MySqlBinlogSplit
extends MySqlSplit

The split to describe the binlog of MySql table(s).

Field Summary

Fields inherited from class org.apache.flink.cdc.connectors.mysql.source.split.MySqlSplit

splitId

Constructor Summary

Constructors

Constructor	Description
MySqlBinlogSplit(String splitId, BinlogOffset startingOffset, BinlogOffset endingOffset, List<FinishedSnapshotSplitInfo> finishedSnapshotSplitInfos, Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas, int totalFinishedSplitSize)
MySqlBinlogSplit(String splitId, BinlogOffset startingOffset, BinlogOffset endingOffset, List<FinishedSnapshotSplitInfo> finishedSnapshotSplitInfos, Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas, int totalFinishedSplitSize, boolean isSuspended)

Method Summary

Modifier and Type	Method	Description
static MySqlBinlogSplit	appendFinishedSplitInfos(MySqlBinlogSplit binlogSplit, List<FinishedSnapshotSplitInfo> splitInfos)
boolean	equals(Object o)
static MySqlBinlogSplit	fillTableSchemas(MySqlBinlogSplit binlogSplit, Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas)
static MySqlBinlogSplit	filterOutdatedSplitInfos(MySqlBinlogSplit binlogSplit, io.debezium.relational.Tables.TableFilter currentTableFilter)	Filter out the outdated finished splits in MySqlBinlogSplit.
BinlogOffset	getEndingOffset()
List<FinishedSnapshotSplitInfo>	getFinishedSnapshotSplitInfos()
BinlogOffset	getStartingOffset()
String	getTables()
Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange>	getTableSchemas()
int	getTotalFinishedSplitSize()
int	hashCode()
boolean	isCompletedSplit()
boolean	isSuspended()
static MySqlBinlogSplit	toNormalBinlogSplit(MySqlBinlogSplit suspendedBinlogSplit, int totalFinishedSplitSize)
String	toString()
static MySqlBinlogSplit	toSuspendedBinlogSplit(MySqlBinlogSplit normalBinlogSplit)

Methods inherited from class org.apache.flink.cdc.connectors.mysql.source.split.MySqlSplit

asBinlogSplit, asSnapshotSplit, isBinlogSplit, isSnapshotSplit, splitId

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

MySqlBinlogSplit

public MySqlBinlogSplit(String splitId,
                        BinlogOffset startingOffset,
                        BinlogOffset endingOffset,
                        List<FinishedSnapshotSplitInfo> finishedSnapshotSplitInfos,
                        Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas,
                        int totalFinishedSplitSize,
                        boolean isSuspended)

MySqlBinlogSplit

public MySqlBinlogSplit(String splitId,
                        BinlogOffset startingOffset,
                        BinlogOffset endingOffset,
                        List<FinishedSnapshotSplitInfo> finishedSnapshotSplitInfos,
                        Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas,
                        int totalFinishedSplitSize)

Method Detail

getStartingOffset

public BinlogOffset getStartingOffset()

getEndingOffset

public BinlogOffset getEndingOffset()

getFinishedSnapshotSplitInfos

public List<FinishedSnapshotSplitInfo> getFinishedSnapshotSplitInfos()

getTableSchemas

public Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> getTableSchemas()

Specified by:

getTableSchemas in class MySqlSplit

getTotalFinishedSplitSize

public int getTotalFinishedSplitSize()

isSuspended

public boolean isSuspended()

isCompletedSplit

public boolean isCompletedSplit()

getTables

public String getTables()

equals

public boolean equals(Object o)

Overrides:

equals in class MySqlSplit

hashCode

public int hashCode()

Overrides:

hashCode in class MySqlSplit

toString

public String toString()

Overrides:

toString in class Object

appendFinishedSplitInfos

public static MySqlBinlogSplit appendFinishedSplitInfos(MySqlBinlogSplit binlogSplit,
                                                        List<FinishedSnapshotSplitInfo> splitInfos)

filterOutdatedSplitInfos

public static MySqlBinlogSplit filterOutdatedSplitInfos(MySqlBinlogSplit binlogSplit,
                                                        io.debezium.relational.Tables.TableFilter currentTableFilter)

Filter out the outdated finished splits in MySqlBinlogSplit.

When restore from a checkpoint, the finished split infos may contain some splits from the deleted tables. We need to remove these splits from the total finished split infos and update the size, while also removing the outdated tables from the table schemas of binlog split.

fillTableSchemas

public static MySqlBinlogSplit fillTableSchemas(MySqlBinlogSplit binlogSplit,
                                                Map<io.debezium.relational.TableId,io.debezium.relational.history.TableChanges.TableChange> tableSchemas)

toNormalBinlogSplit

public static MySqlBinlogSplit toNormalBinlogSplit(MySqlBinlogSplit suspendedBinlogSplit,
                                                   int totalFinishedSplitSize)

toSuspendedBinlogSplit

public static MySqlBinlogSplit toSuspendedBinlogSplit(MySqlBinlogSplit normalBinlogSplit)