Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31329

Modify executor monitor to allow for moving shuffle blocks

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: Kubernetes, Spark Core
    • Labels:
      None

      Description

      To enable Spark-20629 we need to revisit code that assumes shuffle blocks don't move. Currently, the executor monitor assumes that shuffle blocks are immovable. We should modify this code.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                holden Holden Karau
                Reporter:
                holden Holden Karau
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: