Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25463

Add support to standalone Hive metastore for bulk dropping partitions out of the box

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.2
    • None
    • Standalone Metastore
    • None

    Description

      Today for setups that use standalone metastore, we set the following:

      <property>
        <name>metastore.expression.proxy</name>
        <value>org.apache.hadoop.hive.metastore.DefaultPartitionExpressionProxy</value>
      </property>
      

      However, DefaultPartitionExpressionProxy throws UnsupportedOperationException throughout, thus preventing any partition pruning to be successful.

      The effect of this is, other projects that rely on just standalone Hive Metastore (for example Trino) are unable to do things like invoke bulk partition drops using say, HiveMetaStore.drop_partitions_req via a Thrift client.

      We should implement a separate PartitionExpressionProxy implementation for such clients for use with standalone HMS. Note that an implementation like PartitionExpressionForMetastore cannot be used in such cases since standalone HMS installs will/should not have hive-exec dependencies.

      Please refer to Trino issue#7249 for more context

      Attachments

        Activity

          People

            Unassigned Unassigned
            ckulkarni Chinmay Kulkarni
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: