Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16839

CleanupAliases may leave redundant aliases at end of analysis state

    XMLWordPrintableJSON

    Details

      Description

      SPARK-9634 SPARK-9323 [SQL] introduced CleanupReferences which removes unnecessary Aliases while keeping required ones such as top level Projection and struct attributes. this mechanism is implemented by maintaining a boolean flag during a top-down expression transformation, I found a case where this mechanism leaves redundant aliases in the tree (within a right sibling of a create_struct node).

        Attachments

          Activity

            People

            • Assignee:
              eyalfa Eyal Farago
              Reporter:
              eyalfa Eyal Farago
              Shepherd:
              Wenchen Fan
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified