Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32332

AQE doesn't adequately allow for Columnar Processing extension

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.1, 3.1.0
    • Component/s: SQL
    • Labels:
      None

      Description

      In SPARK-27396 we added support to extended Columnar Processing. We did the initial work as to what we thought was sufficient but adaptive query execution was being developed at the same time.

      We have discovered that the changes made to AQE are not sufficient for users to properly extend it for columnar processing because AQE hardcodes to look for specific classes/execs.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                cloud_fan Wenchen Fan
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: