From MRS Hudi¶
If the source link of a job is an MRS Hudi link, configure the source job parameters based on Table 1.
Category | Parameter | Description | Example Value |
|---|---|---|---|
Basic parameters | Source Link Name | MRS Hudi link | hudi_from_cdm |
Database Name | Database name. Click the icon next to the text box. The dialog box for selecting the database is displayed. | default | |
Table Name | Hudi table name. Click the icon next to the text box. The dialog box for selecting the table is displayed. You can set a macro variable of date and time, and a path name can contain multiple macro variables. You can use macro variables of date and time in a scheduled job to synchronize incremental data periodically. For details, see Using Macro Variables of Date and Time. Note If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job - Offset) rather than (Actual start time of the CDM job - Offset). | TBL_E | |
Advanced attributes | Where Clause | This parameter indicates the where clause to be extracted. If this parameter is not set, the entire table is extracted. If the table to be migrated does not contain the fields specified by the where clause, the migration will fail. You can set a macro variable of date and time to extract the data generated on a specific date. For details, see Incremental Migration of Relational Databases. Note If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job - Offset) rather than (Actual start time of the CDM job - Offset). | age > 18 and age <= 60 |