Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22577

executor page blacklist status should update with TaskSet level blacklisting

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.1
    • Fix Version/s: 2.4.0
    • Component/s: Scheduler
    • Labels:
      None

      Description

      right now the executor blacklist status only updates with the BlacklistTracker after a task set has finished and propagated the blacklisting to the application level. We should change that to show at the taskset level as well. Without this it can be very confusing to the user why things aren't running.

        Attachments

        1. stage_blacklisting.png
          370 kB
          Attila Zsolt Piros
        2. node_blacklisting_for_stage.png
          79 kB
          Attila Zsolt Piros
        3. app_blacklisting.png
          340 kB
          Attila Zsolt Piros

          Issue Links

            Activity

              People

              • Assignee:
                attilapiros Attila Zsolt Piros
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: