Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Hive is creating hdfs folders with format <table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
These are not being cleaned up even after long duration. The folder is used to load to the table. Example:
Loading data to table default.tablename from hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
This might be covered to some extent by HIVE-11940 but, want to make sure all cases are addressed.
Update: It seems HIVE-11940 did not cover this as the issue is seen in later versions too.