Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23206 Additional Memory Tuning Metrics
  3. SPARK-24958

Add executors' process tree total memory information to heartbeat signals

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 3.0.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      Spark executors' process tree total memory information can be really useful. Currently such information are not available. The goal of this task is to compute such information for each executor, add these information to the heartbeat signals, and compute the peaks at the driver. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rezasafi Reza Safi
                Reporter:
                rezasafi Reza Safi
              • Votes:
                1 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: