• MapReduce Service

mrs
  1. Help Center
  2. MapReduce Service
  3. User Guide
  4. Using MRS
  5. Using Loader
  6. Loader Link Configuration

Loader Link Configuration

Overview

Loader supports the following links. This section describes configurations of each link.

  • obs-connector
  • generic-jdbc-connector
  • ftp-connector or sftp-connector
  • hbase-connector, hdfs-connector, or hive-connector
  • voltdb-connector

OBS Link

An OBS link is a data exchange channel between Loader and OBS. Table 1 describes the configuration parameters.

Table 1 obs-connector configuration

Parameter

Description

Name

Name of a Loader link

OBS Server

Enter the OBS endpoint address. The common format is OBS.Region.DomainName.

For example, run the following command to view the OBS endpoint address:

cat /opt/Bigdata/apache-tomcat-7.0.78/webapps/web/WEB-INF/classes/cloud-obs.properties

Port

Port for accessing OBS data. The default value is 443.

Access Key

AK for a user to access OBS

Security Key

SK corresponding to AK

Relational Database Link

A relational database link is a data exchange channel between Loader and a relational database. Table 2 describes the configuration parameters.

NOTE:

Some parameters are hidden by default. They appear only after you click Show Senior Parameter.

Table 2 generic-jdbc-connector configuration

Parameter

Description

Name

Name of a Loader link

Database type

Data types supported by Loader links: ORACLEMYSQL, and MPPDB

Host

Database access address, which can be an IP address or domain name

Port

Port for accessing the database

Database

Name of the database saving data

Username

Username for accessing the database

Password

Password of the user. Use the actual password.

Table 3 Senior parameter configuration

Parameter

Description

Fetch Size

A maximum volume of data obtained during each database access

Connection Properties

Driver properties exclusive to the database link that is supported by databases of different types, for example, autoReconnect of MYSQL. If you want to define the driver properties, click Add.

Identifier enclose

Delimiter for reserving keywords in the database SQL. Delimiters defined in different databases vary.

File Server Link

File server links include FTP and SFTP links and serve as a data exchange channel between Loader and a file server. Table 4 describes the configuration parameters.

Table 4 ftp-connector or  sftp-connector configuration

Parameter

Description

Name

Name of a Loader link

Hostname/IP

Enter the file server access address, which can be a host name or IP address.

Port

Port for accessing the file server.

  • Use port 21 for FTP.
  • Use port 22 for SFTP.

Username

Username for logging in to the file server.

Password

Password of the user

MRS Cluster Link

MRS cluster links include HBase, HDFS, and Hive links and serve as a data exchange channel between Loader and data.

When configuring an MRS cluster name and link, select a connector, for example, hbase-connectorhdfs-connector, or hive-connector, and save it.

VoltDB Link

A VoltDB link is a data exchange channel between Loader and an in-memory database. Table 5 describes the configuration parameters.

NOTE:

Some parameters are hidden by default. They appear only after you click Show Senior Parameter.

Table 5 voltdb-connector configuration

Parameter

Description

Name

Name of a Loader link

Database servers

Database access address, which can be an IP address or domain name. You can configure multiple database addresses and separate them by comma (,).

Port

Port for accessing the database

Username

Username for accessing the database

Password

Password of the user. Use the actual password.

Table 6 Senior parameter configuration

Parameter

Description

Connection Properties

Delimiter for reserving keywords in the memory database SQL