[KAFKA-14533] Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

• Type: Test
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: streams, unit tests
• Labels: flaky-test
• Assignee: Guozhang Wang
• Reporter: Greg Harris
• Created: 19/Dec/22 22:39
• Updated: 13/Oct/23 02:29

Description

The SmokeTestDriverIntegrationTest appears to be flakey failing in recent runs:
```
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1444/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1443/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1441/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1440/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1438/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
    https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/trunk/1434/tests/
        java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
```

The stacktrace appears to be:
```
java.util.concurrent.TimeoutException: shouldWorkWithRebalance(boolean) timed out after 600 seconds
at org.junit.jupiter.engine.extension.TimeoutExceptionFactory.create(TimeoutExceptionFactory.java:29)
at org.junit.jupiter.engine.extension.SameThreadTimeoutInvocation.proceed(SameThreadTimeoutInvocation.java:58)
at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156)
...

Suppressed: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.kafka.streams.integration.SmokeTestDriverIntegrationTest.shouldWorkWithRebalance(SmokeTestDriverIntegrationTest.java:151)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:727)
at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
at org.junit.jupiter.engine.extension.SameThreadTimeoutInvocation.proceed(SameThreadTimeoutInvocation.java:45)
... 134 more
```

The test appears to be timing out waiting for the SmokeTestClient to complete its asynchronous close, and taking significantly longer to do so (600s instead of 60s) than a typical local test execution time.

Issue Links

• relates to: KAFKA-8940 Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance
• relates to: KAFKA-14299 Benchmark and stabilize state updater
• links to: GitHub Pull Request #13147
• links to: GitHub Pull Request #13155
• links to: GitHub Pull Request #13156
• links to: GitHub Pull Request #13318