Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1609

Support partition filtering in metastore

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: Metastore
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added support for a new listPartitionsByFilter API in HiveMetaStoreClient. This returns the list of partitions matching a specified partition filter. The filter supports "=", "!=", ">", "<", ">=", "<=" and "LIKE" operations on partition keys of type string. "AND" and "OR" logical operations are supported in the filter. So for example, for a table having partition keys country and state, the filter can be 'country = "USA" AND (state = "CA" OR state = "AZ")'
      Show
      Added support for a new listPartitionsByFilter API in HiveMetaStoreClient. This returns the list of partitions matching a specified partition filter. The filter supports "=", "!=", ">", "<", ">=", "<=" and "LIKE" operations on partition keys of type string. "AND" and "OR" logical operations are supported in the filter. So for example, for a table having partition keys country and state, the filter can be 'country = "USA" AND (state = "CA" OR state = "AZ")'

      Description

      WARNING: This patch was subsequently disabled in HIVE-1853 due to stability concerns related to the JDO version upgrade.

      The metastore needs to have support for returning a list of partitions based on user specified filter conditions. This will be useful for tools which need to do partition pruning. Howl is one such use case. The way partition pruning is done during hive query execution need not be changed.

        Attachments

        1. hive_1609_2.patch
          192 kB
          Ajay Kidave
        2. hive_1609_3.patch
          132 kB
          Ajay Kidave
        3. hive_1609.patch
          187 kB
          Ajay Kidave

          Issue Links

            Activity

              People

              • Assignee:
                ajaykidave Ajay Kidave
                Reporter:
                ajaykidave Ajay Kidave
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: