[IMPALA-4980] Drop partition against table with custom partition paths is failing with Error making 'dropPartition' RPC to Hive Metastore

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Not A Bug
• Affects Version/s: Impala 2.9.0
• Fix Version/s: Impala 2.9.0
• Component/s: Catalog
• Assignee: Alexander Behm
• Reporter: Mostafa Mokhtar
• Created: 23/Feb/17 19:28
• Updated: 02/Mar/17 02:18
• Resolved: 02/Mar/17 02:18

Description

100K-PARTITIONS-1M-FILES-CUSTOM-11-DROP-PARTITION
<class 'impala._thrift_gen.beeswax.ttypes.BeeswaxException'> ImpalaRuntimeException: Error making 'dropPartition' RPC to Hive Metastore: CAUSED BY: MetaException: Got exception: java.io.IOException Failed to move to trash: hdfs://foo:8020/user/hive/warehouse/metadata_benchmarks_new_part.db/part=custom_part

Repro steps

====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-04-INVALIDATE
invalidate metadata 100k_partitions_1m_files_custom;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-05-QUERY-AFTER-INV
select * from 100k_partitions_1m_files_custom limit 0;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-06-INVALIDATE
invalidate metadata 100k_partitions_1m_files_custom;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-07-REFRESH
REFRESH 100k_partitions_1m_files_custom;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-08-ADD-PARTITION
alter table 100k_partitions_1m_files_custom add partition (part="custom_part")  location '/user/hive/warehouse/metadata_benchmarks_new_part.db/part=custom_part/';
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-09-INVALIDATE
invalidate metadata 100k_partitions_1m_files_custom;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-10-REFRESH-AFTER-ADD-PARTITION
REFRESH 100k_partitions_1m_files_custom;
---- RESULTS
====
---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-11-DROP-PARTITION
alter table 100k_partitions_1m_files_custom drop partition (part="custom_part");
---- RESULTS