[HDFS-1189] Quota counts missed between clear quota and set quota

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.20.204.0, 0.21.1, Federation Branch, 0.22.0, 0.23.0
• Component/s: namenode
• Labels: hdfs quota
• Hadoop Flags: Reviewed
• Tags: hdfs quota
• Assignee: John George
• Reporter: Kang Xiao
• Created: 07/Jun/10 07:37
• Updated: 02/Sep/11 22:16
• Resolved: 01/Apr/11 22:44

Description

HDFS Quota counts will be missed between a clear quota operation and a set quota.

When setting quota for a dir, the INodeDirectory will be replaced by INodeDirectoryWithQuota and dir.isQuotaSet() becomes true. When INodeDirectoryWithQuota is newly created, quota counting will be performed. However, when clearing quota, the quota conf is set to -1 and dir.isQuotaSet() becomes false while INodeDirectoryWithQuota will NOT be replaced back to INodeDirectory.

FSDirectory.updateCount just update the quota count for inodes that isQuotaSet() is true. So after clear quota for a dir, its quota counts will not be updated and it's reasonable. But when re seting quota for this dir, quota counting will not be performed and some counts will be missed.

Issue Links

• relates to: HDFS-1258 Clearing namespace quota on "/" corrupts FS image