Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4572

ColumnPruner cannot preserve RS key columns corresponding to un-selected join keys in columnExprMap

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None
    • Tags:
      ColumnPruner

      Description

      For a RS of a join operator, if the join key corresponding to this RS does not appear in the SELECT clause, ColumnPruner will drop the entry of this column in colExprMap.

      Example:

      SELECT x.key FROM src1 x JOIN src y ON (x.key = y.key);
      

      Before CP,

      colExprMap of RS corresponding to x: {VALUE._col3=Column[INPUT__FILE__NAME], VALUE._col2=Column[BLOCK__OFFSET__INSIDE__FILE], VALUE._col1=Column[value], VALUE._col0=Column[key]};
      colExprMap of RS corresponding to y: {VALUE._col3=Column[INPUT__FILE__NAME], VALUE._col2=Column[BLOCK__OFFSET__INSIDE__FILE], VALUE._col1=Column[value], VALUE._col0=Column[key]}.
      

      After CP,

      colExprMap of RS corresponding to x: {VALUE._col0=Column[key]};
      colExprMap of RS corresponding to y: {}.
      

        Attachments

        1. HIVE-4572.replay.patch
          2 kB
          Yin Huai
        2. HIVE-4572.D10941.2.patch
          9 kB
          Phabricator
        3. HIVE-4572.D10941.1.patch
          11 kB
          Phabricator
        4. HIVE-4572.2.patch.txt
          9 kB
          Yin Huai
        5. HIVE-4572.1.patch.txt
          2 kB
          Yin Huai

          Issue Links

            Activity

              People

              • Assignee:
                yhuai Yin Huai
                Reporter:
                yhuai Yin Huai
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: