[YARN-9437] RMNodeImpls occupy too much memory and causes RM GC to take a long time

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.9.1
• Component/s: resourcemanager
• Assignee: Unassigned
• Reporter: qiuliang
• Created: 04/Apr/19 01:59
• Updated: 14/Oct/19 15:38

Description

We use hadoop-2.9.1 in our production environment with 1600+ nodes. 95.63% of RM memory is occupied by RMNodeImpl. Analysis of RM memory found that each RMNodeImpl has approximately 14M. The reason is that there is a 130,000+ completedcontainers in each RMNodeImpl that has not been released.