Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4980

Drop partition against table with custom partition paths is failing with Error making 'dropPartition' RPC to Hive Metastore

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Not A Bug
    • Impala 2.9.0
    • Impala 2.9.0
    • Catalog
    • None

    Description

      100K-PARTITIONS-1M-FILES-CUSTOM-11-DROP-PARTITION
      <class 'impala._thrift_gen.beeswax.ttypes.BeeswaxException'> ImpalaRuntimeException: Error making 'dropPartition' RPC to Hive Metastore: CAUSED BY: MetaException: Got exception: java.io.IOException Failed to move to trash: hdfs://foo:8020/user/hive/warehouse/metadata_benchmarks_new_part.db/part=custom_part

      Repro steps

      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-04-INVALIDATE
      invalidate metadata 100k_partitions_1m_files_custom;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-05-QUERY-AFTER-INV
      select * from 100k_partitions_1m_files_custom limit 0;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-06-INVALIDATE
      invalidate metadata 100k_partitions_1m_files_custom;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-07-REFRESH
      REFRESH 100k_partitions_1m_files_custom;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-08-ADD-PARTITION
      alter table 100k_partitions_1m_files_custom add partition (part="custom_part")  location '/user/hive/warehouse/metadata_benchmarks_new_part.db/part=custom_part/';
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-09-INVALIDATE
      invalidate metadata 100k_partitions_1m_files_custom;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-10-REFRESH-AFTER-ADD-PARTITION
      REFRESH 100k_partitions_1m_files_custom;
      ---- RESULTS
      ====
      ---- QUERY: 100K-PARTITIONS-1M-FILES-CUSTOM-11-DROP-PARTITION
      alter table 100k_partitions_1m_files_custom drop partition (part="custom_part");
      ---- RESULTS
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            alex.behm Alexander Behm
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment