[YARN-8930] CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: nodemanager
• Hadoop Flags: Reviewed
• Assignee: Haibo Chen
• Reporter: Haibo Chen
• Created: 22/Oct/18 19:23
• Updated: 20/Jul/21 05:47
• Resolved: 25/Oct/18 18:15

Description

When yarn.nodemanger.resource.memory.enforced is set to true with memory cgroup turned on, (aka strict memory enforcement), containers monitor relies on the under_oom status read from the container cgroup's memory.oom_control file.

However, when the root yarn container cgroup is under oom (e.g. when the node is overallocating iteself), the under_oom status is set for all yarn containers regardless of whether each individual container has run over its memory limit.

What essentially happens is that whenever the root cgroup is under oom, all yarn containers are killed.

Issue Links

• is related to: YARN-10863 CGroupElasticMemoryController is not work