Hive
  1. Hive
  2. HIVE-5358

ReduceSinkDeDuplication should ignore column orders when check overlapping part of keys between parent and child

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None

      Description

      select key, value from (select key, value from src group by key, value) t group by key, value;
      

      This can be optimized by ReduceSinkDeDuplication

      select key, value from (select key, value from src group by key, value) t group by value, key;
      

      However the sql above can't be optimized by ReduceSinkDeDuplication currently due to different column orders of parent and child operator.

      1. HIVE-5358.patch
        39 kB
        Chun Chen
      2. HIVE-5358.3.patch
        107 kB
        Chun Chen
      3. HIVE-5358.2.patch
        39 kB
        Chun Chen
      4. D13113.1.patch
        39 kB
        Phabricator

        Activity

          People

          • Assignee:
            Chun Chen
            Reporter:
            Chun Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development