[HIVE-15807] MSCK operation hangs in HiveMetaStoreChecker.checkPartitionDirs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.2.0
• Assignee: Pengcheng Xiong
• Reporter: Subramanyam Pattipaka
• Created: 03/Feb/17 19:56
• Updated: 26/Jul/17 15:14
• Resolved: 07/Feb/17 05:25

Description

The seems to be a regression from HIVE-14511. The operation was hung in checkPartitionDirs. The data has 3 levels of partitions (month, date, id) which has total of 800 partitions.

An example path would look like month=9/day=30/id=12

The default value for hive config hive.mv.files.thread was set to 128. I have attached the jstack of hive process used to run msck command

checkPartitionDirs is implemented as recursive function which uses same pool to submit worker threads. It seems thread pool ran out of thread to do the actual work and all threads seems to be waiting and hung. Please take a look the stack and confirm if this is the case here.

Issue Links

• duplicates: HIVE-15803 msck can hang when nested partitions are present