[FLINK-30879] KafkaShuffleITCase failed with multiple test failures due to a TimeoutException while creating topics

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: 1.17.0
• Component/s: Connectors / Kafka
• Labels: test-stability
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 02/Feb/23 08:51
• Updated: 16/Oct/23 07:08
• Resolved: 16/Oct/23 07:08

Description

The test topic creation failed for multiple tests in KafkaShuffleITCase.

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=45586&view=logs&j=fa307d6d-91b1-5ab6-d460-ef50f552b1fe&t=21eae189-b04c-5c04-662b-17dc80ffc83a&l=36821

Feb 02 02:45:42 java.lang.AssertionError: Create test topic : test_assigned_to_partition-c7f57154-bf5c-4270-9d26-8f54394573b7_IngestionTime failed, org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: createTopics
Feb 02 02:45:42 	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:199)
Feb 02 02:45:42 	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:97)
Feb 02 02:45:42 	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:213)
Feb 02 02:45:42 	at org.apache.flink.streaming.connectors.kafka.shuffle.KafkaShuffleITCase.testAssignedToPartition(KafkaShuffleITCase.java:295)
Feb 02 02:45:42 	at org.apache.flink.streaming.connectors.kafka.shuffle.KafkaShuffleITCase.testAssignedToPartitionIngestionTime(KafkaShuffleITCase.java:115)
Feb 02 02:45:42 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Feb 02 02:45:42 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Feb 02 02:45:42 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Feb 02 02:45:42 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
Feb 02 02:45:42 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Feb 02 02:45:42 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Feb 02 02:45:42 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Feb 02 02:45:42 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Feb 02 02:45:42 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Feb 02 02:45:42 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
Feb 02 02:45:42 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
Feb 02 02:45:42 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Feb 02 02:45:42 	at java.base/java.lang.Thread.run(Thread.java:829) 

The original cause might be a TimeoutException:

java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: createTopics
	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:175)
	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:97)
	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:213)
	at org.apache.flink.streaming.connectors.kafka.shuffle.KafkaShuffleITCase.testAssignedToPartition(KafkaShuffleITCase.java:295)
	at org.apache.flink.streaming.connectors.kafka.shuffle.KafkaShuffleITCase.testAssignedToPartitionIngestionTime(KafkaShuffleITCase.java:115) 

Issue Links

• is related to: FLINK-30298 KafkaTableITCase.testStartFromGroupOffsetsNone failed due to timeout
• is related to: FLINK-30503 KafkaSourceITCase$IntegrationTests.testSavepoint failed with timeout