Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21222

Move elimination of Distinct clause from analyzer to optimizer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • SQL
    • None

    Description

      Move elimination of Distinct clause from analyzer to optimizer

      Distinct clause is useless after MAX/MIN clause. For example,
      "Select MAX(distinct a) FROM src from"
      is equivalent of
      "Select MAX(a) FROM src from"
      However, this optimization is implemented in analyzer. It should be in optimizer.

      Attachments

        Activity

          People

            Gengliang.Wang Gengliang Wang
            Gengliang.Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: