[YARN-10743] Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.1
• Fix Version/s: 3.4.0, 3.3.1
• Component/s: nodemanager
• Target Version/s: 3.4.0
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 19/Apr/21 13:14
• Updated: 27/Jan/24 00:27
• Resolved: 23/Apr/21 22:02

Description

Since YARN-10471 supported container log size limited for kill.

We'd better to add a policy that can not aggregated for those containers, so that to reduce the pressure of HDFS etc.

cc epayne Jim_Brennan ebadger

Issue Links

• is related to: YARN-10471 Prevent logs for any container from becoming larger than a configurable size.