Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20624 SPIP: Add better handling for node shutdown
  3. SPARK-32653

Decommissioned host/executor should be considered as inactive in TaskSchedulerImpl

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • Spark Core
    • None

    Description

      The decommissioned host/executor should be considered as inactive in TaskSchedulerImpl, so the TaskSetManager won't include them as preferred location since the decommissioned executors will no longer be used to assign any tasks. 

      Attachments

        Activity

          People

            Ngone51 wuyi
            Ngone51 wuyi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: