[MAPREDUCE-7159] FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.1
• Fix Version/s: 3.1.2, 3.3.0, 3.2.1
• Component/s: mrv2
• Hadoop Flags: Reviewed
• Assignee: Peter Bacsko
• Reporter: Peter Bacsko
• Created: 20/Nov/18 11:59
• Updated: 26/Feb/20 05:29
• Resolved: 06/Dec/18 21:05

Description

Using certain umask values (like 027) makes files unreadable to "others". This causes problems if the FrameworkUploader (https://github.com/apache/hadoop/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java) is used - it's necessary that the compressed MR framework is readable by all users, otherwise they won't be able to run MR jobs.

Issue Links

• relates to: MAPREDUCE-7033 Map outputs implicitly rely on permissive umask for shuffle