[SPARK-34005] Update peak memory metrics for each Executor on task end.

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.0, 3.2.0
• Fix Version/s: 3.1.0, 3.2.0
• Component/s: Spark Core
• Assignee: Kousuke Saruta
• Reporter: Kousuke Saruta
• Created: 05/Jan/21 07:32
• Updated: 20/Jan/21 11:52
• Resolved: 08/Jan/21 05:24

Description

Like other peak memory metrics (e.g, stage, executors in a stage), it's better to update the peak memory metrics for each Executor.

Issue Links

• links to: [Github] Pull Request #31029 (sarutak)
• links to: [Github] Pull Request #31261 (sarutak)