[HIVE-23347] MSCK REPAIR cannot discover partitions with upper case directory names.

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Standalone Metastore
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Adesh Kumar Rao
• Reporter: Sankar Hariappan
• Created: 30/Apr/20 17:53
• Updated: 17/Nov/22 08:50
• Resolved: 29/May/20 06:56

Description

For the following scenario, we expect MSCK REPAIR to discover partitions but it couldn't.
1. Have partitioned data path as follows.
hdfs://mycluster/datapath/t1/Year=2020/Month=03/Day=10
hdfs://mycluster/datapath/t1/Year=2020/Month=03/Day=11
2. create external table t1 (key int, value string) partitioned by (Year int, Month int, Day int) stored as orc location hdfs://mycluster/datapath/t1'';
3. msck repair table t1;
4. show partitions t1; --> Returns zero partitions
5. select * from t1; --> Returns empty data.

When the partition directory names are changed to lower case, this works fine.
hdfs://mycluster/datapath/t1/year=2020/month=03/day=10
hdfs://mycluster/datapath/t1/year=2020/month=03/day=11

Issue Links

• relates to: HIVE-23358 MSCK REPAIR should remove all insignificant zeroes from numeric partition values
• links to: GitHub Pull Request #1003
• links to: review-request