[HDFS-6763] Initialize file system-wide quota once on transitioning to active

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: ha, namenode
• Labels: BB2015-05-TBR
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Kihwal Lee
• Reporter: Daryn Sharp
• Created: 28/Jul/14 15:17
• Updated: 08/Feb/18 21:57
• Resolved: 10/Sep/15 14:19

Description

FSImage#loadEdits calls updateCountForQuota to recalculate & verify quotas for the entire namespace. A standby NN using shared edits calls this method every minute. The standby may appear to "hang" for many seconds.

Issue Links

• breaks: HDFS-9396 Total files and directories on jmx and web UI on standby is uninitialized
• is duplicated by: HDFS-13122 Tailing edits should not update quota counts on ObserverNode
• is duplicated by: HDFS-9143 updateCountForQuota method during EditlogTailer loadEdit can make SNN timeout very often
• is related to: HDFS-11254 Standby NameNode may crash during failover if loading edits takes too long
• is related to: HDFS-7728 Avoid updating quota usage while loading edits
• is related to: HDFS-8865 Improve quota initialization performance
• is related to: HDFS-6191 Disable quota checks when replaying edit log.