Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17193

HoS: don't combine map works that are targets of different DPPs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • Spark
    • None

    Description

      Suppose srcpart is partitioned by ds. The following query can trigger the issue:

      explain
select * from
  (select srcpart.ds,srcpart.key from srcpart join src on srcpart.ds=src.key) a
join
  (select srcpart.ds,srcpart.key from srcpart join src on srcpart.ds=src.value) b
on a.key=b.key;

      Attachments

        1. HIVE-17193.1.patch
          14 kB
          Rui Li
        2. HIVE-17193.2.patch
          29 kB
          Rui Li
        3. HIVE-17193.3.patch
          27 kB
          Rui Li
        4. HIVE-17193.4.patch
          35 kB
          Rui Li
        5. HIVE-17193.5.patch
          35 kB
          Rui Li

        Issue Links

          requires

          Sub-task - The sub-task of the issue HIVE-17178 Spark Partition Pruning Sink Operator can't target multiple Works

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-17877 HoS: combine equivalent DPP sink works

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB link

          Activity

            People

              lirui Rui Li
              lirui Rui Li
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: