From Doris¶
If the source link of a job is a Doris link, configure the source job parameters based on Table 1.
Type | Parameter | Description | Example Value |
|---|---|---|---|
Basic parameters | Use SQL Statement | Whether to use SQL statements to extract source data | No |
Schema/Tablespace | Name of the database to which data will be written. The schema can be automatically created. Click the icon next to the text box to select a schema or tablespace. | schema | |
Table Name | Name of the table from which data will be read. Click the button next to the text box. The dialog box for selecting the table is displayed. This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. Note If you have configured a macro variable of date and time and schedule a CDM job through DataArts Factory of DataArts Studio, the system replaces the macro variable of date and time with (Planned start time of the data development job - Offset) rather than (Actual start time of the CDM job - Offset). | table | |
Where Clause | If you set Use SQL Statement to No, you can add a where clause to add filter criteria. | age > 18 and age <= 60 | |
Partition Column | Column used to split data during data extraction to implement parallel extraction | id | |
Null in Partition Column | During concurrent extraction, if the partition column does not contain null, set this parameter to No to improve performance. If you are not sure whether the partition column contains null, set this parameter to Yes to avoid data loss. | No | |
Regain Symbol (in OBT) | Field as the resumable transfer flag. The source field is an incremental value or timestamp, and the destination field is of the same type as the source field. | id |