common-options.md

Source Common Options

Common parameters of source connectors

name	type	required	default value
result_table_name	string	no	-
parallelism	int	no	-

result_table_name [string]

When result_table_name is not specified, the data processed by this plugin will not be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) ;

When result_table_name is specified, the data processed by this plugin will be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) . The data set (dataStream/dataset) registered here can be directly accessed by other plugins by specifying source_table_name .

parallelism [int]

When parallelism is not specified, the parallelism in env is used by default.

When parallelism is specified, it will override the parallelism in env.

Example

source {
    FakeSourceStream {
        result_table_name = "fake"
    }
}

The result of the data source FakeSourceStream will be registered as a temporary table named fake . This temporary table can be used by any Transform or Sink plugin by specifying source_table_name .