[YARN-4862] Handle duplicate completed containers in RMNodeImpl

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: resourcemanager
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 24/Mar/16 04:30
• Updated: 03/Nov/16 14:47
• Resolved: 03/Nov/16 14:04

Description

As per comment from sharadag, there should be safe guard for duplicated container status in RMNodeImpl before creating UpdatedContainerInfo.
Or else in heavily loaded cluster where event processing is gradually slow, if any duplicated container are sent to RM(may be bug in NM also), there is significant impact that RMNodImpl always create UpdatedContainerInfo for duplicated containers. This result in increase in the heap memory and causes problem like YARN-4852.
This is an optimization for issue kind YARN-4852