Configuring Pipeline

This section applies to MRS 3.x or later clusters.

  1. Configure files.

    • nettyconnector.registerserver.topic.storage: (Mandatory) Configures the path (on a third-party server) to information about IP address, port numbers, and concurrency of NettySink. For example:

      nettyconnector.registerserver.topic.storage: /flink/nettyconnector
      
    • nettyconnector.sinkserver.port.range: (Mandatory) Configures the range of port numbers of NettySink. For example:

      nettyconnector.sinkserver.port.range: 28444-28843
      
    • nettyconnector.ssl.enabled: Configures whether to enable SSL encryption between NettySink and NettySource. The default value is false. For example:

      nettyconnector.ssl.enabled: true
      
  2. Configure security authentication.

    • SASL authentication of ZooKeeper depends on the HA configuration in the flink-conf.yaml file.

    • SSL configurations such as keystore, truststore, keystore password, truststore password, and password inherit from flink-conf.yaml. For details, see Encrypted Transmission.