Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8888

Mapjoin with LateralViewJoin generates wrong plan in Tez

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.15.0
    • 1.0.0
    • None
    • None

    Description

      Queries like these

      with sub1 as
      (select aid, avalue from expod1 lateral view explode(av) avs as avalue ),
      sub2 as
      (select bid, bvalue from expod2 lateral view explode(bv) bvs as bvalue)
      select sub1.aid, sub1.avalue, sub2.bvalue
      from sub1,sub2
      where sub1.aid=sub2.bid;
      

      generates twice the number of rows in Tez when compared to MR.

      Attachments

        1. HIVE-8888-branch.5.patch
          1 kB
          Prasanth Jayachandran
        2. HIVE-8888.5.patch
          9 kB
          Gunther Hagleitner
        3. HIVE-8888.4.patch
          20 kB
          Gunther Hagleitner
        4. HIVE-8888.3.patch
          19 kB
          Prasanth Jayachandran
        5. HIVE-8888.2.patch
          20 kB
          Prasanth Jayachandran
        6. HIVE-8888.1.patch
          20 kB
          Prasanth Jayachandran

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prasanth_j Prasanth Jayachandran Assign to me
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment