Class PipelineDef


  • public class PipelineDef
    extends Object
    Definition of a pipeline.

    A pipeline consists of following components:

    • Source: data source of the pipeline. Required in the definition.
    • Sink: data destination of the pipeline. Required in the definition.
    • Routes: routers specifying the connection between source tables and sink tables. Optional in the definition.
    • Transforms: transformations for applying modifications to data change events. Optional in the definition.
    • Config: configurations of the pipeline. Optional in the definition.

    This class keeps track of the raw pipeline definition made by users via pipeline definition file. A definition will be translated to a PipelineExecution by PipelineComposer before being submitted to the computing engine.