[MAPREDUCE-7221] _SUCCESS file should be created with permissions of parent directory

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.2
• Component/s: client
• Assignee: Unassigned
• Reporter: Kevin
• Created: 26/Jun/19 18:21
• Updated: 26/Jun/19 18:21

Description

The _SUCCESS file is created with the default user permissions ... often read-only to the current user.  This can prevent a second user from successfully performing operations in the directory that they would otherwise be able to perform.  The permissions of the directory are a much better representation of the intent of access and the _SUCCESS file's permissions should not interfere with this intent.

The specific case where I ran into this being a problem:  We have an "analytic pipeline" that can be used by many different users.  At the end of the pipeline, statistics are appended to a Hive table.  The _SUCCESS file must currently be deleted with elevated privileges before the statistics append at the end of the job.