Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9103 Tracking spark's memory usage
  3. SPARK-9105

Add an additional WebUI Tab for Memory Usage

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Web UI
    • None

    Description

      Add a spark a WebUI Tab for Memory usage, the Tab should expose memory usage status in different spark components. It should show the summary for each executors and may also the details for each tasks. On this Tab, there may be some duplicated information with "Storage" Tab, but they are in different showing format, take RDD cache for example, the RDD cached size showed on "Storage" Tab is indexed with RDD name, while on "memory usage" Tab, the RDD can be indexed with Executors, or tasks. Also, the two Tabs can share some same Web Pages.

      Attachments

        Activity

          People

            Unassigned Unassigned
            liyezhang556520 Zhang, Liye
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: