XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.2.0
    • SQL
    • None

    Description

      Currently, we don't support expand partition dynamically in AQE which is not friendly for some data skew job.

      Let's say if we have a simple query:

      SELECT * FROM table DISTRIBUTE BY col
      

      The column of `col` is skewed, then some shuffle partitions would handle too much data than others.

      If we haven't inroduced extra shuffle, we can optimize this case by expanding partitions in AQE.

      Attachments

        Activity

          People

            ulysses XiDuo You
            ulysses XiDuo You
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: