Link to MRS Hudi¶
Table 1 describes the MRS Hudi link parameters.
Note
Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.
Parameter | Description | Example Value |
---|---|---|
Name | Link name | Hudilink |
Manager IP | Floating IP address of MRS Manager. Click Select next to the Manager IP text box to select an MRS cluster. CDM automatically fills in the authentication information. Note DataArts Studio does not support MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2, and only supports MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1. | 127.0.0.1 |
Authentication Method | Authentication method used for accessing MRS
| KERBEROS |
Account | Username for logging in to MRS Manager | cdm |
Password | Password for logging in to MRS Manager |
|
OBS storage support | Whether to support OBS storage. If the Hudi table data is stored in OBS, you need to enable this function. | Yes |
AK | This parameter is available when OBS storage support is set to Yes. AK and SK are used to log in to the OBS server. You need to create an access key for the current account and obtain an AK/SK pair. To obtain an access key, perform the following steps:
|
|
SK |
| |
OBS Test Path | This parameter is available when OBS storage support is set to Yes. Enter a complete file path. The permission to access the path will be verified through the metadata query API. Note
| obs://bucket/dir/test.txt |
Hive Properties | Names of the tables to be integrated. Use commas (,) to separate multiple table names. This parameter is mandatory and cannot contain spaces. |
|