Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5358

ReduceSinkDeDuplication should ignore column orders when check overlapping part of keys between parent and child

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None

      Description

      select key, value from (select key, value from src group by key, value) t group by key, value;
      

      This can be optimized by ReduceSinkDeDuplication

      select key, value from (select key, value from src group by key, value) t group by value, key;
      

      However the sql above can't be optimized by ReduceSinkDeDuplication currently due to different column orders of parent and child operator.

        Attachments

        1. D13113.1.patch
          39 kB
          Phabricator
        2. HIVE-5358.2.patch
          39 kB
          Chun Chen
        3. HIVE-5358.3.patch
          107 kB
          Chun Chen
        4. HIVE-5358.patch
          39 kB
          Chun Chen

          Activity

            People

            • Assignee:
              chenchun Chun Chen
              Reporter:
              chenchun Chun Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: