Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10379

Wrong result when executing with tez

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.13.0, 0.14.0
    • Fix Version/s: 1.0.0
    • Component/s: Tez
    • Labels:
      None
    • Environment:

      Hortonworks sandbox 2.1.1 & 2.2.0

      Description

      I do a left join with a lateral view outer , too many row are generated with tez .
      in map reduce , i have 125 rows , in tez 132 .....

      Example :

        drop table foo ;
      
        create table foo ( dummyfoo int  ) ;
        insert into table foo select count(*) from foo ;
      
        select count(*) as cnt from (
            select a.val,p.code from
                              ( select cast((((one*5)+two)*5+three) as int) as val from foo
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_1 as one
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_2 as two
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_3 as three ) as a
                              left join
                              ( select dummyfoo as code from foo ) p on p.code=a.val
        ) w ;
      
        set hive.execution.engine=tez;
        set hive.vectorized.execution.enabled=false;
      
        select count(*) as cnt from (
            select a.val,p.code from
                              ( select cast((((one*5)+two)*5+three) as int) as val from foo
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_1 as one
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_2 as two
                                              lateral view outer explode(split("0,1,2,3,4",",")) tbl_3 as three ) as a
                              left join
                              ( select dummyfoo as code from foo ) p on p.code=a.val
        ) w ;
      

        Attachments

        1. HIVE-10379.1.patch
          5 kB
          Gunther Hagleitner

          Issue Links

            Activity

              People

              • Assignee:
                hagleitn Gunther Hagleitner
                Reporter:
                ErwanMAS ErwanMAS
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: