Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21222

Move elimination of Distinct clause from analyzer to optimizer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Move elimination of Distinct clause from analyzer to optimizer

      Distinct clause is useless after MAX/MIN clause. For example,
      "Select MAX(distinct a) FROM src from"
      is equivalent of
      "Select MAX(a) FROM src from"
      However, this optimization is implemented in analyzer. It should be in optimizer.

        Attachments

          Activity

            People

            • Assignee:
              Gengliang.Wang Gengliang Wang
              Reporter:
              Gengliang.Wang Gengliang Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: