Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4168

Completed Stages Number are misleading webUI when stages are more than 1000

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.3.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      The number of completed stages and failed stages showed on webUI will always be less than 1000. This is really misleading when there are already thousands of stages completed or failed. The number should be correct even when only partial of all stages listed on the webUI (stage info will be removed if the number is too large).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                liyezhang556520 Zhang, Liye
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: