Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23189

reflect stage level blacklisting on executor tab

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.1
    • 2.4.0
    • Web UI
    • None

    Description

      This issue is the came during working on SPARK-22577 where the conclusion was not only stage tab should reflect stage and application level backlisting but also the executor tab should be extended with stage level backlisting information.

      As irashid and tgraves are discussed the backlisted stages should be listed for an executor like "stage[ , ,...]". One idea was to list only the most recent 3 of the blacklisted stages another was list all the active stages which are blacklisted.  

       

      Attachments

        1. multiple_stages.png
          107 kB
          Attila Zsolt Piros
        2. multiple_stages_3.png
          104 kB
          Attila Zsolt Piros
        3. multiple_stages_2.png
          106 kB
          Attila Zsolt Piros
        4. multiple_stages_1.png
          105 kB
          Attila Zsolt Piros
        5. backlisted.png
          125 kB
          Attila Zsolt Piros
        6. afterStageCompleted.png
          108 kB
          Attila Zsolt Piros

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-22577 executor page blacklist status should update with TaskSet level blacklisting

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #20408 [Github] Pull Request #20408 (attilapiros)

          Activity

            People

              attilapiros Attila Zsolt Piros
              attilapiros Attila Zsolt Piros
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: