Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
2.9.0
-
None
-
None
-
Environment:
OS: Centos
PyArrow Version: 0.8.0
Python version: 3.6
HDFS: 2.9
Description
Problem:
I have a file (F-1) saved in HDFS with permissions set to "rw-rr-" with user "cnali". User "nndugudi" cannot overwrite F-1 (vice versa). hdfs.write will generate following exception:
org.apache.hadoop.security.AccessControlException: Permission denied: user=nndugudi, access=WRITE, inode="/cerebralcortex/data/00000000-f81c-44d2-9db8-fea69f468d58/00000000-5087-3d56-ad0e-0b27c3c83182/20171105.gz":cnali:supergroup:rw-rr-
However, user "nndugudi" can delete the file without any problem. So why overwriting file will produce AccessControlException and not the delete method?
Sample Code:
File: https://github.com/MD2Korg/CerebralCortex/blob/master/cerebralcortex/core/data_manager/raw/stream_handler.py
LOC: 659-705 (write_hdfs_day_file)
HDFS Configurations:
All configurations are set to default. Security is also disabled as of now.