Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15731

orc writer directory permissions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.5.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When saving orc files with partitions, the partition directories created do not have x permission (even tough umask is 002), then no other users can get inside those directories to read the orc file.
      When writing parquet files there is no such issue.

      code example:
      datafrmae.write.format("orc").mode("append").partitionBy("date").save("/path")

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ran.haim@optimalplus.com Ran Haim
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: