[HDFS-13122] Tailing edits should not update quota counts on ObserverNode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: hdfs, namenode
• Assignee: Erik Krogen
• Reporter: Erik Krogen
• Created: 08/Feb/18 01:56
• Updated: 08/Feb/18 21:57
• Resolved: 08/Feb/18 21:57

Description

Currently in FSImage#loadEdits(), after applying a set of edits, we call

updateCountForQuota(target.getBlockManager().getStoragePolicySuite(), target.dir.rootDir);

to update the quota counts for the entire namespace, which can be very expensive. This makes sense if we are about to become the ANN, since we need valid quotas, but not on an ObserverNode which does not need to enforce quotas.

This is related to increasing the frequency with which the SbNN can tail edits from the ANN to decrease the lag time for transactions to appear on the Observer.

Issue Links

• duplicates: HDFS-6763 Initialize file system-wide quota once on transitioning to active