Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23147

Stage page will throw exception when there's no complete tasks

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: Web UI
    • Labels:
      None

      Description

      Current Stage page's task table will throw an exception when there's no complete tasks, to reproduce this issue, user could submit code like:

      sc.parallelize(1 to 20, 20).map { i => Thread.sleep(10000); i }.collect()
      

      Then open the UI and click into stage details. Below is the screenshot.

      Deep dive into the code, found that current UI can only show the completed tasks, it is different from 2.2 code.

        Attachments

          Activity

            People

            • Assignee:
              jerryshao Saisai Shao
              Reporter:
              jerryshao Saisai Shao
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: