[YARN-8995] Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0, 3.3.0
• Fix Version/s: 3.3.0, 3.2.1, 3.1.3
• Component/s: metrics, nodemanager, resourcemanager
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 09/Nov/18 07:01
• Updated: 16/Mar/21 08:01
• Resolved: 07/Sep/19 00:30

Description

In our growing cluster，there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.

Issue Links

• Blocked: YARN-9615 Add dispatcher metrics to RM
• causes: YARN-10643 Fix the race condition introduced by YARN-8995.
• causes: YARN-9817 Fix failing testcases due to not initialized AsyncDispatcher - ArithmeticException: / by zero