Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9588

Reimplement HCatClientHMSImpl.dropPartitions() with HMSC.dropPartitions()

    XMLWordPrintableJSON

    Details

      Description

      HCatClientHMSImpl.dropPartitions() currently has an embarrassingly inefficient implementation. The partial partition-spec is converted into a filter-string. The partitions are fetched from the server, and then dropped one by one.

      Here's a reimplementation that uses the ExprNode-based HiveMetaStoreClient.dropPartitions(). It cuts out the excessive back-and-forth between the HMS and the client-side. It also reduces the memory footprint (from loading all the partitions that are to be dropped).

        Attachments

        1. HIVE-9588.1.patch
          11 kB
          Mithun Radhakrishnan
        2. HIVE-9588.2.patch
          9 kB
          Mithun Radhakrishnan
        3. HIVE-9588.3.patch
          10 kB
          Mithun Radhakrishnan
        4. HIVE-9588.4.patch
          11 kB
          Mithun Radhakrishnan

          Issue Links

            Activity

              People

              • Assignee:
                mithun Mithun Radhakrishnan
                Reporter:
                mithun Mithun Radhakrishnan
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: