Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9452 Use HBase to store Hive metadata
  3. HIVE-10289

Support filter on non-first partition key and non-string partition key

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Currently, partition filtering only handles the first partition key and the type for this partition key must be string. In order to break this limitation, several improvements are required:
      1. Change serialization format for partition key. Currently partition keys are serialized into delimited string, which sorted on string order not with regard to the actual type of the partition key. We use BinarySortableSerDe for this purpose.
      2. For filter condition not on the initial partition keys, push it into HBase RowFilter. RowFilter will deserialize the partition key and evaluate the filter condition.

        Attachments

        1. HIVE-10289.3.patch
          234 kB
          Daniel Dai
        2. HIVE-10289.2.patch
          224 kB
          Daniel Dai
        3. HIVE-10289.1.patch
          224 kB
          Daniel Dai

          Issue Links

            Activity

              People

              • Assignee:
                daijy Daniel Dai
                Reporter:
                daijy Daniel Dai
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: