[KUDU-3019] Kudu client hangs in Deffered.join()

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 1.6.0
• Fix Version/s: NA
• Assignee: Unassigned
• Reporter: Zoltán Borók-Nagy
• Created: 12/Dec/19 10:41
• Updated: 02/Jun/20 19:07
• Resolved: 02/Jun/20 19:07

Description

In Impala we've seen the Kudu client hanging with the following stack trace:

Thread 53015: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
 - java.lang.Object.wait() @bci=2, line=502 (Compiled frame)
 - com.stumbleupon.async.Deferred.doJoin(boolean, long) @bci=77, line=1122 (Compiled frame)
 - com.stumbleupon.async.Deferred.join() @bci=3, line=1006 (Compiled frame)
 - org.apache.kudu.client.KuduClient.joinAndHandleException(com.stumbleupon.async.Deferred) @bci=1, line=340 (Compiled frame)
 - org.apache.kudu.client.KuduClient.openTable(java.lang.String) @bci=10, line=212 (Compiled frame)
 - org.apache.impala.planner.KuduScanNode.init(org.apache.impala.analysis.Analyzer) @bci=32, line=115 (Compiled frame)
 - org.apache.impala.planner.SingleNodePlanner.createScanNode(org.apache.impala.analysis.TableRef, org.apache.impala.analysis.AggregateInfo, org.apache.impala.analysis.Analyzer) @bci=252, line=1312 (Compiled frame)
...

The client hangs in Deferred.join():

https://github.com/apache/kudu/blob/a8c6ea258c06407c1a4fef260da3a1cb70529bd9/java/kudu-client/src/main/java/org/apache/kudu/client/KuduClient.java#L423

To at least mitigate the problem, maybe Deferred.join(long timeout) could be used instead.