Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12849 Bucketing improvements follow-up
  3. SPARK-12850

Support bucket pruning (predicate pushdown for bucketed tables)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: SQL
    • Labels:
      None

      Description

      We now support bucketing. One optimization opportunity is to push some predicates into the scan to skip scanning files that definitely won't match the values.

        Attachments

          Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-12975 Throwing Exception when Bucketing Columns are part of Partitioning Columns

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #10942 [Github] Pull Request #10942 (gatorsmile)

            Activity

              People

              • Assignee:
                smilegator Xiao Li
                Reporter:
                rxin Reynold Xin
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: