Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5358

ReduceSinkDeDuplication should ignore column orders when check overlapping part of keys between parent and child

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Query Processor
    • None

    Description

      select key, value from (select key, value from src group by key, value) t group by key, value;
      

      This can be optimized by ReduceSinkDeDuplication

      select key, value from (select key, value from src group by key, value) t group by value, key;
      

      However the sql above can't be optimized by ReduceSinkDeDuplication currently due to different column orders of parent and child operator.

      Attachments

        1. HIVE-5358.patch
          39 kB
          Chun Chen
        2. HIVE-5358.3.patch
          107 kB
          Chun Chen
        3. HIVE-5358.2.patch
          39 kB
          Chun Chen
        4. D13113.1.patch
          39 kB
          Phabricator

        Activity

          People

            chenchun Chun Chen
            chenchun Chun Chen
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: