[YARN-4344] NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.7.1, 2.6.2
• Fix Version/s: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
• Component/s: resourcemanager
• Hadoop Flags: Reviewed
• Assignee: Varun Vasudev
• Reporter: Varun Vasudev
• Created: 11/Nov/15 10:48
• Updated: 06/Jan/17 00:55
• Resolved: 23/Nov/15 20:48

Description

After YARN-3802, if an NM re-connects to the RM with changed capabilities, there can arise situations where the overall cluster resource calculation for the cluster will be incorrect leading to inconsistencies in scheduling.

Issue Links

• is related to: YARN-4761 NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler
• relates to: YARN-3802 Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.
• relates to: YARN-3286 Cleanup RMNode#ReconnectNodeTransition