Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2015 Spark UI issues at scale
  3. SPARK-8702

Avoid massive concating strings in Javascript

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • Web UI
    • None

    Description

      When there are massive tasks, such as sc.parallelize(1 to 100000, 10000).count(), the generated JS codes have a lot of string concatenations in the stage page, nearly 40 string concatenations for one task.

      We can generate the whole string for a task instead of execution string concatenations in the browser.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zsxwing Shixiong Zhu
            zsxwing Shixiong Zhu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment