[YARN-8404] Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.1.0, 3.0.2
• Fix Version/s: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.4
• Labels: atsv2
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 07/Jun/18 05:37
• Updated: 15/Feb/19 06:18
• Resolved: 13/Jun/18 10:41

Description

It is observed that if ATS1/1.5 daemon is not running, RM recovery is delayed as long as timeline client get timed out for each applications. By default, timed out will take around 5 mins. If completed applications are more then amount of time RM will wait is (number of completed applications in a cluster * 5 minutes) which is kind of hanged.

Primary reason for this behavior is YARN-3044 YARN-4129 which refactor existing system metric publisher. This refactoring made appFinished event as synchronous which was asynchronous earlier.

Issue Links

• is broken by: YARN-4129 Refactor the SystemMetricPublisher in RM to better support newer events