Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36352 Spark should check result plan's output schema name
  3. SPARK-48419

Foldable propagation replace foldable column should use origin column

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.3, 3.1.3, 3.2.4, 4.0.0, 3.5.1, 3.3.4
    • 4.0.0
    • SQL

    Description

      column name will be change by `FoldablePropagation` in optimizer

      befor optimizer:

      ```shell

      'Project ['x, 'y, 'z]
      +- 'Project 'a AS x#112, str AS Y#113, 'b AS z#114
         +- LocalRelation <empty>, a#0, b#1

      ```

      after optimizer:

      ```shell

      Project x#112, str AS Y#113, z#114
      +- Project a#0 AS x#112, str AS Y#113, b#1 AS z#114
         +- LocalRelation <empty>, a#0, b#1

      ```

      column name `y` will be replace to 'Y'

      Attachments

        Issue Links

          Activity

            People

              knightchess Knight Chess
              knightchess Knight Chess
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: