Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2015 Spark UI issues at scale
  3. SPARK-8702

Avoid massive concating strings in Javascript

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • Web UI
    • None

    Description

      When there are massive tasks, such as sc.parallelize(1 to 100000, 10000).count(), the generated JS codes have a lot of string concatenations in the stage page, nearly 40 string concatenations for one task.

      We can generate the whole string for a task instead of execution string concatenations in the browser.

      Attachments

        Activity

          People

            zsxwing Shixiong Zhu
            zsxwing Shixiong Zhu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: