Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3899

Certain join types fail to spill after they start probing if there are matches stored in the hash table

    Details

      Description

      The fix for IMPALA-1488 disabled spilling for certain hash join types (e.g. RIGHT OUTER JOIN, FULL OUTER JOIN) if there were any matches in the hash table. The underlying cause of this (if I understand correctly) is that we can spill partitions after we've built the hash table and started probing.

      As part of IMPALA-3567 I need to fix the underlying issue so that we don't spill additional build partitions while probing. As a consequence of that work, it should be possible to disable the IMPALA-1488 workaround.

        Attachments

          Activity

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: