[HIVE-14924] MSCK REPAIR table with single threaded is throwing null pointer exception

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0, 2.2.0
• Fix Version/s: 2.2.0
• Component/s: CLI
• Assignee: Pengcheng Xiong Assign to me
• Reporter: Ratheesh Kamoor
• Created: 10/Oct/16 22:40
• Updated: 26/Jul/17 00:03
• Resolved: 08/Nov/16 07:17

Description

MSCK REPAIR TABLE is throwing Null Pointer Exception while running on single threaded mode (hive.mv.files.thread=0)

Error:
2016-10-10T22:27:13,564 ERROR [e9ce04a8-2a84-426d-8e79-a2d15b8cee09 main([])]: exec.DDLTask (DDLTask.java:failed(581)) - java.lang.NullPointerException
at org.apache.hadoop.hive.ql.metadata.HiveMetaStoreChecker.checkPartitionDirs(HiveMetaStoreChecker.java:423)
at org.apache.hadoop.hive.ql.metadata.HiveMetaStoreChecker.findUnknownPartitions(HiveMetaStoreChecker.java:315)
at org.apache.hadoop.hive.ql.metadata.HiveMetaStoreChecker.checkTable(HiveMetaStoreChecker.java:291)
at org.apache.hadoop.hive.ql.metadata.HiveMetaStoreChecker.checkTable(HiveMetaStoreChecker.java:236)
at org.apache.hadoop.hive.ql.metadata.HiveMetaStoreChecker.checkMetastore(HiveMetaStoreChecker.java:113)
at org.apache.hadoop.hive.ql.exec.DDLTask.msck(DDLTask.java:1834)

In order to reproduce:

set hive.mv.files.thread=0 and run MSCK REPAIR TABLE command

Issue Links

• is related to: HIVE-13984 Use multi-threaded approach to listing files for msck