[HIVE-2211] Fix a bug caused by HIVE-243

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Assignee: Siying Dong
• Reporter: Siying Dong
• Created: 09/Jun/11 21:26
• Updated: 16/Dec/11 23:56
• Resolved: 21/Jun/11 21:47

Description

Quick fix a bug caused by HIVE-243

HIVE-234 removed the codes to wait for the threads to finish and use ThreadPoolExector.shutdown() to wait for the results. The usage of ThreadPoolExecutor.shutdown(), however, is wrong. The codes assume that the function blocks until all threads finish running but it actually only marks status and won't block. It caused wrong result of Utilities.getInputSummary() and caused many jobs are executed as local mode while they have huge data.

Revert those changes quickly. We can have a follow-up to see how to deal with this more efficiently if you want.

Sub-Tasks

• unit test to compare results of getInputSummary() with single thread and multiple threads: Open