[YARN-10608] Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: log-aggregation
• Target Version/s: 3.5.0
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 02/Feb/21 08:25
• Updated: 04/Jan/24 08:31

Description

Now the yarn.nodemanager.delete.debug-delay-sec is a cluster level setting.

In our busy production cluster, we set it to 0 default for preventing local log boom.

But when we need deep into some spark/MR etc jobs errors such as core dump, i advice to support enable a job level setting for delay of deletion for local logs for reproduce the error.

 

wangda tangzhankun  xgong epayne

If you any advice about this support?