Users can produce or consume messages in Kafka topics using the MRS cluster client. For clusters with Kerberos authentication enabled, the user must have the permission to perform these operations.
The client has been updated.
Record the IP address of any Kafka instance.
For example, if you have updated the client on the Master2 node, log in to the Master2 node to use the client. For details, see Client Management.
sudo su - omm
kinit Kafka username
For example, kinit admin
sh kafka-console-producer.sh --broker-list IP address of the node where the Kafka instance is located:21005 --topic Topic name --producer.config /opt/client/Kafka/kafka/config/producer.properties
You can input specified information as the messages produced by the producer and then press Enter to send the messages. To end message producing, press Ctrl + C to exit.
sh kafka-console-consumer.sh --topic Topic name --bootstrap-server IP address of the node where the Kafka instance is located:21005 --new-consumer --consumer.config /opt/client/Kafka/kafka/config/consumer.properties
In the configuration file, group.id (indicating the consumer group) is set to example-group1 by default. Users can change the value as required. The value takes effect each time a consumption occurs.
By default, the system reads unprocessed messages in the current consumer group when the command is executed. If a new consumer group is specified in the configuration file and the --from-beginning parameter is added to the command, the system reads all messages that have not been automatically deleted in Kafka.