[HDFS-13553] RBF: Support global quota

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0, 2.10.0
• Hadoop Flags: Reviewed

Release Note

Federation supports and controls global quota at mount table level.

In a federated environment, a folder can be spread across multiple subclusters. Router aggregates quota that queried from these subclusters and uses that for the quota-verification.

• Assignee: Yiqun Lin Assign to me
• Reporter: Íñigo Goiri
• Created: 15/May/18 00:39
• Updated: 21/Nov/18 14:49
• Resolved: 25/Jul/18 14:18

Description

Add quota management to Router-based federation.

Issue Links

• is related to: HDFS-13811 RBF: Race condition between router admin quota update and periodic quota update service
• is related to: HDFS-12615 Router-based HDFS federation phase 2

Sub-Tasks

• RBF: Federation supports global quota: Resolved
• RBF: Display mount table quota info in Web UI and admin command: Resolved
• RBF: Document global quota supporting in federation: Resolved
• RBF: Quota management incorrect parent-child relationship judgement: Resolved
• RBF: Optimize setQuota error output: Resolved
• RBF: Improve the use of setQuota command: Resolved
• RBF: Fix synchronization of router quota and nameservice quota: Resolved
• RBF: mv/rm fail after the directory exceeded the quota limit: Resolved
• RBF: If a directory exceeds quota limit then quota usage is not refreshed for other mount entries: Resolved
• RBF: Router admin clrQuota is not synchronized with nameservice: Resolved
• RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable: Resolved