Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23147

Stage page will throw exception when there's no complete tasks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • Web UI
    • None

    Description

      Current Stage page's task table will throw an exception when there's no complete tasks, to reproduce this issue, user could submit code like:

      sc.parallelize(1 to 20, 20).map { i => Thread.sleep(10000); i }.collect()
      

      Then open the UI and click into stage details. Below is the screenshot.

      Deep dive into the code, found that current UI can only show the completed tasks, it is different from 2.2 code.

      Attachments

        Activity

          People

            jerryshao Saisai Shao
            jerryshao Saisai Shao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: