[HDFS-13390] AccessControlException for overwrite but not for delete

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.9.0
• Component/s: hdfs

Environment

Environment:
OS: Centos
PyArrow Version: 0.8.0
Python version: 3.6
HDFS: 2.9

• External issue URL: https://github.com/apache/arrow/issues/1805#issuecomment-378177406
• Assignee: Unassigned
• Reporter: Nasir Ali
• Created: 03/Apr/18 13:44
• Updated: 20/Sep/18 12:29

Description

 

Problem:
I have a file (F-1) saved in HDFS with permissions set to "rw-rr-" with user "cnali". User "nndugudi" cannot overwrite F-1 (vice versa). hdfs.write will generate following exception:

org.apache.hadoop.security.AccessControlException: Permission denied: user=nndugudi, access=WRITE, inode="/cerebralcortex/data/00000000-f81c-44d2-9db8-fea69f468d58/00000000-5087-3d56-ad0e-0b27c3c83182/20171105.gz":cnali:supergroup:rw-rr-

However, user "nndugudi" can delete the file without any problem. So why overwriting file will produce AccessControlException and not the delete method?

Sample Code:
File: https://github.com/MD2Korg/CerebralCortex/blob/master/cerebralcortex/core/data_manager/raw/stream_handler.py

LOC: 659-705 (write_hdfs_day_file)

 

HDFS Configurations:

All configurations are set to default. Security is also disabled as of now.