[YARN-1747] Better physical memory monitoring for containers

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.0
• Component/s: nodemanager
• Assignee: Unassigned
• Reporter: Karthik Kambatla
• Created: 21/Feb/14 21:02
• Updated: 07/Jan/17 01:47

Description

YARN currently uses RSS to compute the physical memory being used by a container. This can lead to issues, as noticed in HDFS-5957.

Issue Links

• relates to: HDFS-5957 Provide support for different mmap cache retention policies in ShortCircuitCache.

Sub-Tasks

• Create SMAPBasedProcessTree to get PSS information: Closed
• cgroups based memory monitoring for containers: Resolved
• Set OOM control for memory cgroups: Resolved