Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3642

Hive List Bucketing - optimize transform()

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In list bucketing transform(), we create pruning tree for each partition.

      Although it is possible that different partitions have different skewed keys, chances are that there will be a lot of overlap.

      It would be a good idea to optimize that case.

        Attachments

          Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-3026 List Bucketing in Hive

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-3554 Hive List Bucketing - Query logic

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                gangtimliu Gang Tim Liu
                Reporter:
                gangtimliu Gang Tim Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: