[HIVE-16346] inheritPerms should be conditional based on the target filesystem

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 31/Mar/17 17:11
• Updated: 09/Apr/18 20:56
• Resolved: 28/Apr/17 17:46

Description

Right now, a lot of the logic in Hive.java attempts to set permissions of different files that have been moved / copied. This is only triggered if hive.warehouse.subdir.inherit.perms is set to true.

However, on blobstores such as S3, there is no concept of file permissions so these calls are unnecessary, which can hurt performance.

One solution would be to set hive.warehouse.subdir.inherit.perms to false, but this would be a global change that affects an entire HS2 instance. So HDFS tables will no longer have permissions inheritance.

A better solution would be to make the inheritance of permissions conditional on the target filesystem.

Issue Links

• blocks: HIVE-16542 make merge that targets acid 2.0 table fail-fast
• is related to: HIVE-16392 Remove hive.warehouse.subdir.inherit.perms and all permissions inheritance logic
• links to: RB