Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14600

Push predicates through Expand

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      A grouping sets will be analyzed as Aggregate(Expand(Project)), the grouping attributes came from Project, but have different meaning in Project (equal to original grouping expression) and Expand (could be original grouping expression or null), this does not make sense, because the attribute has different result in different operator,

      A better way could be Aggregate(Expand()), then we need to fix SQL generation.

      Attachments

        Activity

          People

            cloud_fan Wenchen Fan
            davies Davies Liu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: