[KAFKA-7819] Trogdor - Improve RoundTripWorker

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Assignee: Stanislav Kozlovski
• Reporter: Stanislav Kozlovski
• Created: 14/Jan/19 15:06
• Updated: 08/Dec/20 03:00
• Resolved: 08/Dec/20 03:00

Description

Trogdor's RoundTripWorker task has a couple of shortcomings:

• Consumer GroupID is hardcoded and consumers use `KafkaConsumer#assign()`: https://github.com/apache/kafka/blob/12947f4f944955240fd14ce8b75fab5464ea6808/tools/src/main/java/org/apache/kafka/trogdor/workload/RoundTripWorker.java#L314

Leaving you unable to run two separate instances of this worker on the same partition in the same cluster, as the consumers would overwrite each other's commits. It's probably better to add the task ID to the consumer group

• the task spec's `maxMessages` is an integer, leaving you unable to schedule long-winded tasks

Issue Links

• links to: GitHub Pull Request #6187