Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42651

Optimize global sort to driver sort

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 3.5.0
    • None
    • SQL
    • None

    Description

      If the size of plan is small enough, it's more efficient to sort all rows at driver side that saves one shuffle

      Attachments

        Activity

          People

            Unassigned Unassigned
            ulysses XiDuo You
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: