[SPARK-15731] orc writer directory permissions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 1.5.1
• Assignee: Unassigned
• Reporter: Ran Haim
• Created: 02/Jun/16 13:47
• Updated: 14/Oct/17 18:44
• Resolved: 14/Oct/17 18:44

Description

When saving orc files with partitions, the partition directories created do not have x permission (even tough umask is 002), then no other users can get inside those directories to read the orc file.
When writing parquet files there is no such issue.

code example:
datafrmae.write.format("orc").mode("append").partitionBy("date").save("/path")

Issue Links

• blocks: SPARK-20901 Feature parity for ORC with Parquet