[MAPREDUCE-7294] Only application master should upload resource to Yarn Shared Cache

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.10.0, 3.3.0, 3.2.1, 3.1.4
• Fix Version/s: 3.2.2, 3.4.0, 3.3.1, 2.10.2
• Component/s: mrv2
• Hadoop Flags: Reviewed
• Assignee: zhenzhao wang
• Reporter: zhenzhao wang
• Created: 13/Aug/20 04:10
• Updated: 10/Jun/21 08:10
• Resolved: 22/Sep/20 19:00

Description

The design of yarn shared cache manager is only to allow application master should upload the jar/files/resource. However, there was a bug in the code since 2.9.0. Every node manager that take the job task will try to upload the jar/resources. Let's say one job have 5000 tasks. Then there will be up to 5000 NMs try to upload the jar. This is like DDOS and create a snowball effect. It will end up with inavailability of yarn shared cache manager. It wil cause time out in localization and lead to job failure.

Issue Links

• relates to: MAPREDUCE-6824 TaskAttemptImpl#createCommonContainerLaunchContext is longer than 150 lines
• links to: https://github.com/apache/hadoop/pull/2223
• links to: PR for 2.10.X