Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20624 SPIP: Add better handling for node shutdown
  3. SPARK-20628

Keep track of nodes which are going to be shut down & avoid scheduling new tasks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0, 2.3.0
    • 3.1.0
    • Spark Core
    • None

    Description

      Keep track of nodes which are going to be shut down. We considered adding this for YARN but took a different approach, for instances where we can't control instance termination though (EC2, GCE, etc.) this may make more sense.

      Attachments

        Issue Links

          Activity

            People

              holden Holden Karau
              holden Holden Karau
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: