[YARN-8193] YARN RM hangs abruptly (stops allocating resources) when running successive applications.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.2.0, 3.1.1, 2.10.1
• Component/s: yarn
• Target Version/s: 2.9.2
• Hadoop Flags: Reviewed
• Assignee: Zian Chen
• Reporter: Zian Chen
• Created: 20/Apr/18 21:36
• Updated: 30/Apr/20 19:39
• Resolved: 30/Apr/20 19:17

Description

When running massive queries successively, at some point RM just hangs and stops allocating resources. At the point RM get hangs, YARN throw NullPointerException  at RegularContainerAllocator.getLocalityWaitFactor.

There's sufficient space given to yarn.nodemanager.local-dirs (not a node health issue, RM didn't report any node being unhealthy). There is no fixed trigger for this (query or operation).

This problem goes away on restarting ResourceManager. No NM restart is required. 

 

 

Issue Links

• is duplicated by: YARN-8462 Resource Manager shutdown with FATAL Exception
• is duplicated by: YARN-8471 YARN RM hangs and stops allocating resources when applications successively running