[HIVE-21342] Analyze compute stats for column leave behind staging dir on hdfs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.2, 3.2.0, 4.0.0-alpha-1
• Component/s: Hive

Environment

hive-3.1

• Assignee: Rajkumar Singh
• Reporter: Rajkumar Singh
• Created: 28/Feb/19 06:04
• Updated: 27/Feb/24 22:23
• Resolved: 30/Mar/19 01:20

Description

staging dir cleanup does not happen for the "analyze table .. compute statistics for columns", this leads to stale directory on hdfs.
the problem seems to be with ColumnStatsSemanticAnalyzer which don't have hdfscleanup set for the context.
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java#L310