Skip to main content

Definition

Data Source is used to access metadata and read the changed data from external systems.
A Data Source can read data from multiple tables simultaneously.

Parameters

To describe a data source, the follows are required:

parametermeaningoptional/required
typeThe type of the source, such as mysql.required
nameThe name of the source, which is user-defined (a default value provided).optional
configurations of Data SourceConfigurations to build the Data Source e.g. connection configurations and source table properties.optional

Example

We could use yaml files to define a mysql source:

source:
type: mysql
name: mysql-source #optional,description information
host: localhost
port: 3306
username: admin
password: pass
tables: adb.*, bdb.user_table_[0-9]+, [app|web]_order_\.*