[HIVE-11926] Stats annotation might not extract stats for varchar/decimal columns

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Logical Optimizer, Statistics
• Assignee: Chaoyu Tang
• Reporter: Chaoyu Tang
• Created: 23/Sep/15 00:24
• Updated: 16/Feb/16 23:51
• Resolved: 24/Sep/15 19:06

Description

It is because StatsUtils uses the String.startWith to compare VARCHAR/DECIMAL column type name with serdeConstants which are in lowercase. But these type names in stats might not be in lower case. We ran into a case where the type name from TAB_COL_STATS/PART_COL_STATS was actually in uppercase (e.g. VARCHAR, DECIMAL) because these column stats were populated from other HMS clients like Impala.
We need changes these type name comparison to be case insensitive