[YARN-9858] Optimize RMContext getExclusiveEnforcedPartitions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.10.0, 3.3.0, 3.2.2, 3.1.4
• Labels: release-blocker
• Target Version/s: 2.10.0
• Assignee: Jonathan Hung
• Reporter: Jonathan Hung
• Created: 26/Sep/19 06:28
• Updated: 01/Oct/19 18:22
• Resolved: 01/Oct/19 10:46

Description

Follow-up from YARN-9730. RMContextImpl#getExclusiveEnforcedPartitions is a hot code path, need to optimize it .

Since AMS allocate invoked by multiple handlers locking on conf will occur

java.lang.Thread.State: BLOCKED (on object monitor)
 at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2841)
 - waiting to lock <0x00007f1f8107c748> (a org.apache.hadoop.yarn.conf.YarnConfiguration)
 at org.apache.hadoop.conf.Configuration.get(Configuration.java:1214)
 at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1268)

Issue Links

• relates to: YARN-9730 Support forcing configured partitions to be exclusive based on app node label