Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5789

Prune all partitions if an always-false runtime filter is received

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Backend

      Description

      The scenario is as follows:

      • A query joins a large partitioned table with another table on a non-partition column.
      • All of the rows on the build side are filtered out, so the join has an empty build.

      Currently what happens is that all partitions of the large table are scanned and the runtime filter filters all the rows out after materialization.

      What would ideally happen is that the scan would notice that the runtime filter always returns false and prune all of the partitions.

        Issue Links

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              tianyiwang Tianyi Wang
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development