Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18218

SMB Join : Handle buckets with no splits.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      While working on HIVE-18208, it was found that with SMB, the results are incorrect. This most likely is a product issue.

      auto_sortmerge_join_16 fails with wrong results due to this.

      cc hagleitn

      The current logic in CustomPartitionVertex assumes that there is a split for each bucket whereas in Tez, we can have no splits for empty buckets.

      Attachments

        1. HIVE-18218.1.patch
          31 kB
          Deepak Jaiswal
        2. HIVE-18218.2.patch
          270 kB
          Deepak Jaiswal
        3. HIVE-18218.3.patch
          271 kB
          Deepak Jaiswal
        4. HIVE-18218.4.patch
          51 kB
          Deepak Jaiswal
        5. HIVE-18218.5.patch
          84 kB
          Deepak Jaiswal

        Issue Links

          Activity

            People

              djaiswal Deepak Jaiswal
              djaiswal Deepak Jaiswal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: