Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29277

DataSourceV2: Add early filter and projection pushdown

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SQL
    • None

    Description

      Spark uses optimizer rules that need stats before conversion to physical plan. DataSourceV2 should support early pushdown for those rules.

      Attachments

        Activity

          People

            rdblue Ryan Blue
            rdblue Ryan Blue
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: