Class MongoDBSource<T>
- java.lang.Object
-
- org.apache.flink.cdc.connectors.base.source.IncrementalSource<T,MongoDBSourceConfig>
-
- org.apache.flink.cdc.connectors.mongodb.source.MongoDBSource<T>
-
- Type Parameters:
T- the output type of the source.
- All Implemented Interfaces:
Serializable,org.apache.flink.api.connector.source.Source<T,SourceSplitBase,PendingSplitsState>,org.apache.flink.api.connector.source.SourceReaderFactory<T,SourceSplitBase>,org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>
@Internal @Experimental public class MongoDBSource<T> extends IncrementalSource<T,MongoDBSourceConfig>
The MongoDB CDC Source based on FLIP-27 which supports parallel reading snapshot of collection and then continue to capture data change from change stream.1. The source supports parallel capturing database(s) or collection(s) change. 2. The source supports checkpoint in split level when read snapshot data. 3. The source doesn't need apply any lock of MongoDB.MongoDBSource .<String>builder() .hosts("localhost:27017") .databaseList("mydb") .collectionList("mydb.users") .username(username) .password(password) .deserializer(new JsonDebeziumDeserializationSchema()) .build();See
MongoDBSourceBuilderfor more details.- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class org.apache.flink.cdc.connectors.base.source.IncrementalSource
configFactory, dataSourceDialect, deserializationSchema, offsetFactory, snapshotHooks, sourceSplitSerializer
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description static <T> MongoDBSourceBuilder<T>builder()Get a MongoDBSourceBuilder to build aMongoDBSource.protected org.apache.flink.connector.base.source.reader.RecordEmitter<SourceRecords,T,SourceSplitState>createRecordEmitter(SourceConfig sourceConfig, SourceReaderMetrics sourceReaderMetrics)-
Methods inherited from class org.apache.flink.cdc.connectors.base.source.IncrementalSource
createEnumerator, createReader, getBoundedness, getEnumeratorCheckpointSerializer, getProducedType, getSplitSerializer, restoreEnumerator, setSnapshotHooks
-
-
-
-
Method Detail
-
builder
@PublicEvolving public static <T> MongoDBSourceBuilder<T> builder()
Get a MongoDBSourceBuilder to build aMongoDBSource.- Returns:
- a MongoDB parallel source builder.
-
createRecordEmitter
protected org.apache.flink.connector.base.source.reader.RecordEmitter<SourceRecords,T,SourceSplitState> createRecordEmitter(SourceConfig sourceConfig, SourceReaderMetrics sourceReaderMetrics)
- Overrides:
createRecordEmitterin classIncrementalSource<T,MongoDBSourceConfig>
-
-