Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18085

SPIP: Better History Server scalability for many / large applications

    XMLWordPrintableJSON

    Details

    • Type: Umbrella
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.3.0
    • Component/s: Spark Core, Web UI
    • Labels:

      Description

      It's a known fact that the History Server currently has some annoying issues when serving lots of applications, and when serving large applications.

      I'm filing this umbrella to track work related to addressing those issues. I'll be attaching a document shortly describing the issues and suggesting a path to how to solve them.

        Attachments

        1. screenshot-1.png
          304 kB
          jincheng
        2. screenshot-2.png
          268 kB
          jincheng
        3. spark_hs_next_gen.pdf
          99 kB
          Marcelo Vanzin

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Vanzin
                Reporter:
                vanzin Marcelo Vanzin
                Shepherd:
                Marcelo Vanzin
              • Votes:
                9 Vote for this issue
                Watchers:
                66 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: