Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
2.7.2
-
None
-
None
Description
set YARN RM max wait and retry intervals to 0, try to talk to an RM, get an arithmetic exception
Caused by: java.lang.ArithmeticException: / by zero at org.apache.hadoop.io.retry.RetryPolicies$RetryUpToMaximumTimeWithFixedSleep.<init>(RetryPolicies.java:265) at org.apache.hadoop.io.retry.RetryPolicies.retryUpToMaximumTimeWithFixedSleep(RetryPolicies.java:89) at org.apache.hadoop.yarn.client.RMProxy.createRetryPolicy(RMProxy.java:237) at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:91) at org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceStart(YarnClientImpl.java:188) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.spark.deploy.history.yarn.server.YarnHistoryProvider.initYarnClient(YarnHistoryProvider.scala:931) at org.apache.spark.deploy.history.yarn.server.YarnHistoryProvider.init(YarnHistoryProvider.scala:296)
I'd have expected the code to recognise the caller is saying "don't retry", but clearly not