Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8888

Mapjoin with LateralViewJoin generates wrong plan in Tez

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.15.0
    • 1.0.0
    • None
    • None

    Description

      Queries like these 

      with sub1 as
(select aid, avalue from expod1 lateral view explode(av) avs as avalue ),
sub2 as
(select bid, bvalue from expod2 lateral view explode(bv) bvs as bvalue)
select sub1.aid, sub1.avalue, sub2.bvalue
from sub1,sub2
where sub1.aid=sub2.bid;

      generates twice the number of rows in Tez when compared to MR.

      Attachments

        1. HIVE-8888.1.patch
          20 kB
          Prasanth Jayachandran
        2. HIVE-8888.2.patch
          20 kB
          Prasanth Jayachandran
        3. HIVE-8888.3.patch
          19 kB
          Prasanth Jayachandran
        4. HIVE-8888.4.patch
          20 kB
          Gunther Hagleitner
        5. HIVE-8888.5.patch
          9 kB
          Gunther Hagleitner
        6. HIVE-8888-branch.5.patch
          1 kB
          Prasanth Jayachandran

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-10379 Wrong result when executing with tez

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: