[HDFS-13380] RBF: mv/rm fail after the directory exceeded the quota limit

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.10.0, 3.2.0
• Hadoop Flags: Reviewed
• Assignee: Yiqun Lin
• Reporter: Weiwei Wu
• Created: 02/Apr/18 09:42
• Updated: 15/May/18 00:45
• Resolved: 09/Apr/18 17:13

Description

It's always fail when I try to mv/rm a directory which have exceeded the quota limit.

[hadp@hadoop]$ hdfs dfsrouteradmin -ls
Mount Table Entries:
Source Destinations Owner Group Mode Quota/Usage
/ns10t ns10->/ns10t hadp hadp rwxr-xr-x [NsQuota: 1200/1201, SsQuota: -/-]

[hadp@hadoop]$ hdfs dfs -rm hdfs://ns-fed/ns10t/ns1mountpoint/aaaaaaaaaa.99
rm: Failed to move to trash: hdfs://ns-fed/ns10t/ns1mountpoint/aaaaaaaaaa.99: The NameSpace quota (directories and files) is exceeded: quota=1200 file count=1201

[hadp@hadoop]$ hdfs dfs -rm -skipTrash hdfs://ns-fed/ns10t/ns1mountpoint/aaaaaaaaaa.99
rm: The NameSpace quota (directories and files) is exceeded: quota=1200 file count=1201

I think we should add a parameter for the method getLocationsForPath, to determine if we need to perform quota verification on the operation. For example mv src directory parameter and rm directory parameter.

Issue Links

• is related to: HDFS-12934 RBF: Federation supports global quota