[YARN-9848] revert YARN-4946

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: log-aggregation, resourcemanager
• Target Version/s: 3.3.0
• Hadoop Flags: Reviewed
• Assignee: Steven Rand
• Reporter: Steven Rand
• Created: 20/Sep/19 05:22
• Updated: 31/Dec/20 07:23
• Resolved: 27/Apr/20 20:47

Description

In YARN-4946, we've been discussing a revert due to the potential for keeping more applications in the state store than desired, and the potential to greatly increase RM recovery times.

 

I'm in favor of reverting the patch, but other ideas along the lines of YARN-9571 would work as well.

Issue Links

• Blocked: YARN-10557 Application may be leaked in state store when resourcemanager failover.
• is duplicated by: YARN-10244 backport YARN-9848 to branch-3.2
• relates to: YARN-4946 RM should not consider an application as COMPLETED when log aggregation is not in a terminal state