[FLINK-32366] YarnConfigurationITCase.testFlinkContainerMemory fails with ConnectException (msg: Connection refused)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.18.0
• Component/s: Runtime / Coordination
• Labels: test-stability
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 16/Jun/23 12:01
• Updated: 16/Jun/23 15:51
• Resolved: 16/Jun/23 15:51

Description

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=50062&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=28490

The changes of in the related branch should be unrelated. We've also seen this issue in other Jira issues (FLINK-23105 or FLINK-23611) which were closed again.

Test org.apache.flink.yarn.YarnConfigurationITCase.testFlinkContainerMemory[testFlinkContainerMemory()] failed with:
java.util.concurrent.ExecutionException: org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: 3e2f99e5588a/172.28.0.2:32954
        at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
        at org.apache.flink.yarn.YarnConfigurationITCase.lambda$testFlinkContainerMemory$0(YarnConfigurationITCase.java:167)
        at org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:301)
        at org.apache.flink.yarn.YarnConfigurationITCase.testFlinkContainerMemory(YarnConfigurationITCase.java:69)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        [...]
        at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:185)
        at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
        at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
        at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
        at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
Caused by: org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: 3e2f99e5588a/172.28.0.2:32954
Caused by: java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716)
        at org.apache.flink.shaded.netty4.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)
        at org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
        at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
        at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
        at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
        at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
        at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
        at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at java.lang.Thread.run(Thread.java:748)

Issue Links

• Discovered while testing: FLINK-25002 Setup required --add-opens/--add-exports
• is related to: FLINK-23105 YARNSessionCapacitySchedulerITCase.testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots fails on azure
• is related to: FLINK-23611 YARNSessionCapacitySchedulerITCase.testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots hangs on azure