[KAFKA-16672] Fix flaky DedicatedMirrorIntegrationTest.testMultiNodeCluster

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.9.0
• Assignee: Johnny Hsu
• Reporter: Chia-Ping Tsai
• Created: 06/May/24 08:08
• Updated: 10/Jul/24 07:59
• Resolved: 10/Jul/24 07:59

Description

It is flaky on my jenkins, and sometimes it fails in Kafka CI[0]

The error happens in virtue of race condition. `KafkaBasedLog` loads records from topic via thread, so `RebalanceNeededException` will be thrown if we check the task configs too soon. It seems to me `RebalanceNeededException` is a temporary exception so we should treat it as a retryable exception in waiting.

In short, we should catch `RebalanceNeededException` in `awaitTaskConfigurations` [1]

[0] https://ge.apache.org/scans/tests?search.buildOutcome=failure&search.buildToolType=gradle&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=Asia%2FTaipei&tests.container=org.apache.kafka.connect.mirror.integration.DedicatedMirrorIntegrationTest&tests.test=testMultiNodeCluster()
[1] https://github.com/apache/kafka/blob/55a00be4e973f3f4c8869b6f70de1e285719e890/connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DedicatedMirrorIntegrationTest.java#L355

Issue Links

• links to: Pull Request