From Kafka/DMS Kafka¶
If the source link of a job is the Link to Kafka or Link to DMS Kafka, configure the source job parameters based on Table 1.
Parameter | Description | Example Value |
---|---|---|
Topics | One or more topics can be entered. | est1,est2 |
Offset | Initial offset parameter
| Latest |
Permanent Running | Whether a job runs permanently. | Yes |
Consumer Group ID | Consumer group ID If you export data from DMS Kafka, enter any value for Kafka Platinum but a valid consumer group ID for Kafka Basic. | sumer-group |
Data Format | Format used for parsing data. The options are as follows:
| Binary |
Field Delimiter | The default value is space. To set the Tab key as the delimiter, set this parameter to \t. | , |
Max. Poll Records | (Optional) Maximum number of records per poll | 100 |
Max. Poll Interval | (Optional) Maximum interval between polls (seconds) | 100 |