[FLINK-22312] YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents due to the heartbeat exception with Yarn RM

• Type: Technical Debt
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0, 1.13.1, 1.12.4
• Fix Version/s: 1.14.0, 1.12.5, 1.13.3
• Component/s: Deployment / YARN
• Labels: auto-deprioritized-critical pull-request-available test-stability
• Assignee: Xintong Song
• Reporter: Guowei Ma
• Created: 16/Apr/21 10:33
• Updated: 06/Feb/23 11:14
• Resolved: 09/Aug/21 02:10

Description

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16633&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=6b04ca5f-0b52-511d-19c9-52bf0d9fbdfa&l=26614

2021-04-15T22:11:39.5648550Z java.io.InterruptedIOException: Call interrupted
2021-04-15T22:11:39.5649145Z 	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1483) ~[hadoop-common-2.8.3.jar:?]
2021-04-15T22:11:39.5649823Z 	at org.apache.hadoop.ipc.Client.call(Client.java:1435) ~[hadoop-common-2.8.3.jar:?]
2021-04-15T22:11:39.5650488Z 	at org.apache.hadoop.ipc.Client.call(Client.java:1345) ~[hadoop-common-2.8.3.jar:?]
2021-04-15T22:11:39.5651387Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227) ~[hadoop-common-2.8.3.jar:?]
2021-04-15T22:11:39.5652193Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116) ~[hadoop-common-2.8.3.jar:?]
2021-04-15T22:11:39.5652675Z 	at com.sun.proxy.$Proxy32.allocate(Unknown Source) ~[?:?]
2021-04-15T22:11:39.5653478Z 	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.allocate(ApplicationMasterProtocolPBClientImpl.java:77) ~[hadoop-yarn-common-2.8.3.jar:?]
2021-04-15T22:11:39.5654223Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]
2021-04-15T22:11:39.5654742Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]
2021-04-15T22:11:39.5655269Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]
2021-04-15T22:11:39.5655625Z ]
2021-04-15T22:11:39.5655853Z 	at org.junit.Assert.fail(Assert.java:88)
2021-04-15T22:11:39.5656281Z 	at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:576)
2021-04-15T22:11:39.5656831Z 	at org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:86)
2021-04-15T22:11:39.5657360Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-04-15T22:11:39.5657777Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-04-15T22:11:39.5658252Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-04-15T22:11:39.5658723Z 	at java.lang.reflect.Method.invoke(Method.java:498)
2021-04-15T22:11:39.5659311Z 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2021-04-15T22:11:39.5659780Z 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2021-04-15T22:11:39.5660248Z 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2021-04-15T22:11:39.5660829Z 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
2021-04-15T22:11:39.5661247Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-04-15T22:11:39.5661652Z 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
2021-04-15T22:11:39.5662006Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-04-15T22:11:39.5662379Z 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2021-04-15T22:11:39.5662812Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2021-04-15T22:11:39.5663260Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2021-04-15T22:11:39.5663935Z 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2021-04-15T22:11:39.5664384Z 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2021-04-15T22:11:39.5664849Z 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2021-04-15T22:11:39.5665283Z 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2021-04-15T22:11:39.5665681Z 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2021-04-15T22:11:39.5666127Z 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-04-15T22:11:39.5666577Z 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-04-15T22:11:39.5667026Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-04-15T22:11:39.5667545Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-04-15T22:11:39.5667933Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-04-15T22:11:39.5668317Z 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2021-04-15T22:11:39.5668737Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
2021-04-15T22:11:39.5669235Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
2021-04-15T22:11:39.5669867Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
2021-04-15T22:11:39.5670341Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
2021-04-15T22:11:39.5670862Z 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
2021-04-15T22:11:39.5671398Z 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
2021-04-15T22:11:39.5671865Z 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
2021-04-15T22:11:39.5672324Z 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
2021-04-15T22:11:39.5672582Z 

Issue Links

• relates to: FLINK-21995 YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
• relates to: FLINK-30908 Fatal error in ResourceManager caused YARNSessionFIFOSecuredITCase.testDetachedMode to fail
• links to: GitHub Pull Request #16127
• links to: GitHub Pull Request #16232
• links to: GitHub Pull Request #16733