Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12849 Bucketing improvements follow-up
  3. SPARK-12850

Support bucket pruning (predicate pushdown for bucketed tables)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: SQL
    • Labels:
      None

      Description

      We now support bucketing. One optimization opportunity is to push some predicates into the scan to skip scanning files that definitely won't match the values.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                smilegator Xiao Li
                Reporter:
                rxin Reynold Xin
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: