Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.4.0
-
None
Description
Spark executors' process tree total memory information can be really useful. Currently such information are not available. The goal of this task is to compute such information for each executor, add these information to the heartbeat signals, and compute the peaks at the driver.
Attachments
Issue Links
- is a parent of
-
SPARK-26357 Expose executors' procfs metrics to Metrics system
-
- In Progress
-
- is duplicated by
-
SPARK-21157 Report Total Memory Used by Spark Executors
-
- Closed
-
- links to
(1 links to)