Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22577

executor page blacklist status should update with TaskSet level blacklisting

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.1
    • 2.4.0
    • Scheduler, Spark Core
    • None

    Description

      right now the executor blacklist status only updates with the BlacklistTracker after a task set has finished and propagated the blacklisting to the application level. We should change that to show at the taskset level as well. Without this it can be very confusing to the user why things aren't running.

      Attachments

        1. node_blacklisting_for_stage.png
          79 kB
          Attila Zsolt Piros
        2. app_blacklisting.png
          340 kB
          Attila Zsolt Piros
        3. stage_blacklisting.png
          370 kB
          Attila Zsolt Piros

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23189 reflect stage level blacklisting on executor tab

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #20203 [Github] Pull Request #20203 (attilapiros)

          Activity

            People

              attilapiros Attila Zsolt Piros
              tgraves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: