Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16839

CleanupAliases may leave redundant aliases at end of analysis state

    XMLWordPrintableJSON

Details

    Description

      SPARK-9634 SPARK-9323 [SQL] introduced CleanupReferences which removes unnecessary Aliases while keeping required ones such as top level Projection and struct attributes. this mechanism is implemented by maintaining a boolean flag during a top-down expression transformation, I found a case where this mechanism leaves redundant aliases in the tree (within a right sibling of a create_struct node).

      Attachments

        Activity

          People

            eyalfa Eyal Farago
            eyalfa Eyal Farago
            Wenchen Fan Wenchen Fan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified