Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39835

Fix EliminateSorts remove global sort below the local sort

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.1.4, 3.3.1, 3.2.3, 3.4.0
    • SQL
    • None

    Description

      If a global sort below locol sort, we should not remove the global sort becuase the output partitioning can be affected.

      This issue is going to worse since we pull out the V1 Write sort to logcial side.

      Attachments

        Activity

          People

            ulysses XiDuo You
            ulysses XiDuo You
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: