Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18085

SPIP: Better History Server scalability for many / large applications

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.3.0
    • Spark Core, Web UI

    Description

      It's a known fact that the History Server currently has some annoying issues when serving lots of applications, and when serving large applications.

      I'm filing this umbrella to track work related to addressing those issues. I'll be attaching a document shortly describing the issues and suggesting a path to how to solve them.

      Attachments

        1. screenshot-2.png
          268 kB
          Jincheng Sun
        2. screenshot-1.png
          304 kB
          Jincheng Sun
        3. spark_hs_next_gen.pdf
          99 kB
          Marcelo Masiero Vanzin

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Marcelo Masiero Vanzin Marcelo Masiero Vanzin
              Votes:
              9 Vote for this issue
              Watchers:
              68 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: