• Data Warehouse Service

dws
  1. Help Center
  2. Data Warehouse Service
  3. Developer Guide
  4. Tutorial: Using GDS to Import Data
  5. Step 1: Preparing an ECS as the GDS Server

Step 1: Preparing an ECS as the GDS Server

This section describes the following operations:

  • Preparing an ECS as the GDS Server

    Before using GDS to import or export data, prepare one or more Linux Elastic Cloud Servers (ECSs) to install GDS.

    • For data import:

      Before data import, upload source data files to GDS servers. Then, the GDS servers can also be called data servers.

      If source data files are uploaded to multiple servers due to large data volume, you need to install, configure, and start GDS on each data server.

    • For data export:

      Data is exported from DWS as data files to GDS servers.

  • Downloading the GDS Package and SSL Certificate

    Before installing GDS, log in to the DWS management console and download the GDS package and SSL certificate that match the cluster version.

Preparing an ECS as the GDS Server

For details about how to purchase a Linux ECS, see "Purchasing and Logging In to a Linux ECS" in Elastic Cloud Server Quick Start.

The ECS used as the GDS server must meet the following requirements:

  • The GDS server must use an OS supported by the GDS package. For details, see Downloading the GDS Package and SSL Certificate.
  • The GDS server can communicate with DWS.
    • The ECS must be in the same region and on the same virtual private cloud (VPC) and subnet as DWS because DWS connects to a GDS server through an internal IP address.

      Internal IP addresses are recommended because the data import rate is limited by network bandwidth.

    • The GDS server can properly receive network access requests from DWS.

      Port: Plan a listening port for GDS. This port is used by DWS to connect to the GDS server. Specify the listening port when enabling GDS. If it is not specified, the default port 8098 is used.

      Firewall: If a firewall is enabled on the GDS server, add an inbound rule for the GDS listening port to allow DWS to connect to the GDS server. Otherwise, the connection cannot be set up.

      NOTE:

      Use the port that has been opened on the firewall when enabling GDS listening port.

      To create an ECS as the GDS server, you also need to:

      Open the GDS listening port in the inbound rule of the security group where the ECS resides.

      Table 1 Example inbound rule in a security group

      Parameter

      Example Value

      Protocol

      TCP

      Port

      5000

      NOTE:

      Set this parameter to the GDS listening port.

      Source IP Address

      Select IP Address and enter the IP address of DWS, for example, 192.168.0.10/32.

      Ensure that the GDS listening port is open on the firewall if the firewall is enabled on the ECS.

      iptables  -I INPUT -p tcp -m tcp --dport <gds_port> -j ACCEPT

Downloading the GDS Package and SSL Certificate

  1. Log in to the DWS management console at https://console.otc.t-systems.com/dws/.
  2. In the navigation tree on the left, click Connection Management.
  3. Select the DWS client package of the corresponding version from the gsql CLI Client drop-down list. The client package contains the GDS package and gsql client.

    Choose RedHat x64 or SUSE x64 based on the client OS.

    • RedHat x64 supports the following OSs:
      • RHEL6.4, 6.5, 6.6, 6.7, 7.1, 7.2
      • CentOS6.4, 6.5, 6.6, 6.7
      • EulerOS 2.0 SP2
    • SUSE x64 supports the following OSs:

      SLES11 SP1, SP2, SP3, SP4

  4. Click Download.
  5. (Optional) To start GDS in SSL mode, click here to download the SSL certificate in the Download Client and Driver area.

    In this mode, data transmission between the GDS server and DWS is encrypted for data security.

    NOTE:

    The SSL mode is more secure than other modes. You are advised to start GDS in SSL mode.