section> Computing
  • Auto Scaling
  • Bare Metal Server
  • Dedicated Host
  • Elastic Cloud Server
  • FunctionGraph
  • Image Management Service
Network
  • Direct Connect
  • Domain Name Service
  • Elastic IP
  • Elastic Load Balancing
  • Enterprise Router
  • NAT Gateway
  • Private Link Access Service
  • Secure Mail Gateway
  • Virtual Private Cloud
  • Virtual Private Network
  • VPC Endpoint
Storage
  • Cloud Backup and Recovery
  • Cloud Server Backup Service
  • Elastic Volume Service
  • Object Storage Service
  • Scalable File Service
  • Storage Disaster Recovery Service
  • Volume Backup Service
Application
  • API Gateway (APIG)
  • Application Operations Management
  • Application Performance Management
  • Distributed Message Service (for Kafka)
  • Simple Message Notification
Data Analysis
  • Cloud Search Service
  • Data Lake Insight
  • Data Warehouse Service
  • DataArts Studio
  • MapReduce Service
  • ModelArts
  • Optical Character Recognition
Container
  • Application Service Mesh
  • Cloud Container Engine
  • Cloud Container Instance
  • Software Repository for Containers
Databases
  • Data Replication Service
  • Distributed Cache Service
  • Distributed Database Middleware
  • Document Database Service
  • GeminiDB
  • Relational Database Service
  • TaurusDB
Management & Deployment
  • Cloud Create
  • Cloud Eye
  • Cloud Trace Service
  • Config
  • Log Tank Service
  • Resource Formation Service
  • Tag Management Service
Security Services
  • Anti-DDoS
  • Cloud Firewall
  • Database Security Service
  • Dedicated Web Application Firewall
  • Host Security Service
  • Identity and Access Management
  • Key Management Service
  • Web Application Firewall
Other
  • Enterprise Dashboard
  • Marketplace
  • Price Calculator
  • Status Dashboard
APIs
  • REST API
  • API Usage Guidelines
  • Endpoints
Development and Automation
  • SDKs
  • Drivers and Tools
  • Terraform
  • Ansible
  • Cloud Create
Architecture Center
  • Best Practices
  • Blueprints
IaaSComputingAuto ScalingBare Metal ServerDedicated HostElastic Cloud ServerFunctionGraphImage Management ServiceNetworkDirect ConnectDomain Name ServiceElastic IPElastic Load BalancingEnterprise RouterNAT GatewayPrivate Link Access ServiceSecure Mail GatewayVirtual Private CloudVirtual Private NetworkVPC EndpointStorageCloud Backup and RecoveryCloud Server Backup ServiceElastic Volume ServiceObject Storage ServiceScalable File ServiceStorage Disaster Recovery ServiceVolume Backup ServicePaaSApplicationAPI Gateway (APIG)Application Operations ManagementApplication Performance ManagementDistributed Message Service (for Kafka)Simple Message NotificationData AnalysisCloud Search ServiceData Lake InsightData Warehouse ServiceDataArts StudioMapReduce ServiceModelArtsOptical Character RecognitionContainerApplication Service MeshCloud Container EngineCloud Container InstanceSoftware Repository for ContainersDatabasesData Replication ServiceDistributed Cache ServiceDistributed Database MiddlewareDocument Database ServiceGeminiDBRelational Database ServiceTaurusDBManagementManagement & DeploymentCloud CreateCloud EyeCloud Trace ServiceConfigLog Tank ServiceResource Formation ServiceTag Management ServiceSecuritySecurity ServicesAnti-DDoSCloud FirewallDatabase Security ServiceDedicated Web Application FirewallHost Security ServiceIdentity and Access ManagementKey Management ServiceWeb Application FirewallOtherOtherEnterprise DashboardMarketplacePrice CalculatorStatus Dashboard

DataArts Studio

  • Service Overview
  • Preparations
  • User Guide
    • Management Console
    • Management Center
    • DataArts Migration
      • Overview
      • Constraints
      • Supported Data Sources
      • Managing Clusters
      • Managing Links
        • Creating Links
        • Managing Drivers
        • Managing Agents
        • Managing Cluster Configurations
        • Link to OBS
        • Link to PostgreSQL/SQLServer
        • Link to DWS
        • Link to an RDS for MySQL/MySQL Database
        • Link to an Oracle Database
        • Link to DLI
        • Link to Hive
        • Link to HBase
        • Link to HDFS
        • Link to an FTP or SFTP Server
        • Link to Redis
        • Link to DDS
        • Link to CloudTable
        • Link to MongoDB
        • Link to Cassandra
        • Link to Kafka
        • Link to DMS Kafka
        • Link to CSS
        • Link to Elasticsearch
        • Link to SAP HANA
        • Link to a Database Shard
        • Link to MRS Hudi
        • Link to MRS ClickHouse
        • Link to a ShenTong Database
        • Link to CloudTable OpenTSDB
        • Link to Doris
      • Managing Jobs
      • Improving Migration Performance
      • Key Operation Guide
      • Tutorials
    • DataArts Factory
    • Audit Log
  • FAQs
  • Change History
  • User Guide
  • User Guide
  • DataArts Migration
  • Managing Links
  • Link to MRS Hudi

Link to MRS Hudi¶

Table 1 describes the MRS Hudi link parameters.

Note

Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.

Table 1 Hudi link parameters¶

Parameter

Description

Example Value

Name

Link name

Hudilink

Manager IP

Floating IP address of MRS Manager. Click Select next to the Manager IP text box to select an MRS cluster. CDM automatically fills in the authentication information.

Note

DataArts Studio does not support MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2, and only supports MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1.

127.0.0.1

Authentication Method

Authentication method used for accessing MRS

  • SIMPLE: Select this for non-security mode.

  • KERBEROS: Select this for security mode.

KERBEROS

Account

Username for logging in to MRS Manager

cdm

Password

Password for logging in to MRS Manager

-

OBS storage support

Whether to support OBS storage. If the Hudi table data is stored in OBS, you need to enable this function.

Yes

AK

This parameter is available when OBS storage support is set to Yes.

AK and SK are used to log in to the OBS server.

You need to create an access key for the current account and obtain an AK/SK pair.

To obtain an access key, perform the following steps:

  1. Log in to the management console, move the cursor to the username in the upper right corner, and select My Credentials from the drop-down list.

  2. On the My Credentials page, choose Access Keys, and click Create Access Key. See Figure 1.

    **Figure 1** Clicking Create Access Key

    Figure 1 Clicking Create Access Key¶

  3. Click OK and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the credentials.csv file to view Access Key Id and Secret Access Key.

    Note

    • Only two access keys can be added for each user.

    • To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.

-

SK

-

OBS Test Path

This parameter is available when OBS storage support is set to Yes.

Enter a complete file path. The permission to access the path will be verified through the metadata query API.

Note

  • For object storage, the path must be accurate to object, for example, obs://bucket/dir/test.txt. Otherwise, a 404 error occurs.

  • For a parallel file system, the path must be accurate to directory, for example, obs://bucket/dir.

obs://bucket/dir/test.txt

Hive Properties

Names of the tables to be integrated. Use commas (,) to separate multiple table names. This parameter is mandatory and cannot contain spaces.

-

  • Prev
  • Next
last updated: 2025-07-09 16:05 UTC - commit: 61336f3c2e25ce26cb038bce82678d028fe5d438
Edit pageReport Documentation Bug
Page Contents
  • Link to MRS Hudi
© T-Systems International GmbH
  • Contact
  • Data privacy
  • Disclaimer of Liabilities
  • Imprint