Affects Version/s: None
Fix Version/s: 0.8.0
Quick fix a bug caused by
HIVE-243 HIVE-234 removed the codes to wait for the threads to finish and use ThreadPoolExector.shutdown() to wait for the results. The usage of ThreadPoolExecutor.shutdown(), however, is wrong. The codes assume that the function blocks until all threads finish running but it actually only marks status and won't block. It caused wrong result of Utilities.getInputSummary() and caused many jobs are executed as local mode while they have huge data.
Revert those changes quickly. We can have a follow-up to see how to deal with this more efficiently if you want.
|Status||Open [ 1 ]||Patch Available [ 10002 ]|
|Status||Patch Available [ 10002 ]||Resolved [ 5 ]|
|Assignee||Siying Dong [ sdong ]|
|Fix Version/s||0.8.0 [ 12316178 ]|
|Resolution||Fixed [ 1 ]|
|Status||Resolved [ 5 ]||Closed [ 6 ]|