Checking the Consumption Status of Consumer Group

Scenario

This section describes how to view the current expenditure on the client based on service requirements.

Prerequisites

  • The system administrator has understood service requirements and prepared a system user.

  • The Kafka client has been installed.

Procedure

  1. Log in as a client installation user to the node on which the Kafka client is installed.

  2. Switch to the Kafka client installation directory, for example, /opt/kafkaclient.

    cd /opt/kafkaclient

  3. Run the following command to configure environment variables:

    source bigdata_env

  4. Run the following command to perform user authentication (skip this step in normal mode):

    kinit Component service user

  5. Run the following command to switch to the Kafka client installation directory:

    cd Kafka/kafka/bin

  6. Run the kafka-consumer-groups.sh command to check the current consumption status.

    • Check the Consumer Group list on Kafka saved by Offset:

      ./kafka-consumer-groups.sh --list --bootstrap-server <Service IP address of any broker node:21007> --command-config ../config/consumer.properties

      eg:./kafka-consumer-groups.sh --bootstrap-server 192.168.1.1:21007 --list --command-config ../config/consumer.properties

    • Check the consumption status of Consumer Group on Kafka saved by Offset:

      ./kafka-consumer-groups.sh --describe --bootstrap-server <Service IP address of any broker node:21007> --group Consumer group name --command-config ../config/consumer.properties

      eg:./kafka-consumer-groups.sh --describe --bootstrap-server 192.168.1.1:21007 --group example-group --command-config ../config/consumer.properties

    Important

    1. Ensure that the current consumer is online and consumes data.

    2. Configure the group.id in the consumer.properties configuration file and --group in the command to the group to be queried.

    3. The Kafka cluster's IP port number is 21007 in security mode and 9092 in normal mode.