Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35283 Support query some DDL with CTES
  3. SPARK-35378

Eagerly execute commands in QueryExecution instead of caller sides

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.2.0
    • SQL
    • None

    Description

      Currently, Spark doesn't support LeafRunnableCommand as sub query.
      Because the LeafRunnableCommand always output GenericInternalRow and some node(e.g. SortExec, AdaptiveExecutionExec, WholeCodegenExec) will convert GenericInternalRow to UnsafeRow. So will causes error as follows:

      java.lang.ClassCastException
org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow

      Attachments

        Activity

          People

            beliefer Jiaan Geng
            beliefer Jiaan Geng
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: