[YARN-10058] Capacity Scheduler dispatcher hang when async thread crash

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0, 3.2.1
• Fix Version/s: 3.2.1
• Component/s: capacity scheduler
• Target Version/s: 3.2.1
• Hadoop Flags: Reviewed
• Flags: Important
• Assignee: Unassigned
• Reporter: tuyu
• Created: 24/Dec/19 06:31
• Updated: 03/Mar/20 07:10

Description

when capacity scheduler enable global scheduler, if global scheduler's AsyncScheduleThread crash, the capacity scheduler dispatcher will hang for long time. This behavior is unreasonable. 

if this situation happen, In HA mode, current RM should change to standby

Issue Links

• Blocked: YARN-8737 Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile
• relates to: YARN-10178 Global Scheduler async thread crash caused by 'Comparison method violates its general contract
• links to: GitHub Pull Request #1781