[HDFS-12405] Clean up removed erasure coding policies from namenode

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: erasure-coding
• Labels: hdfs-ec-3.0-nice-to-have
• Assignee: Huafeng Wang
• Reporter: Sammi Chen
• Created: 08/Sep/17 06:53
• Updated: 03/Feb/19 12:24

Description

Currently, when an erasure coding policy is removed, it's been transited to "removed" state. User cannot apply policy with "removed" state to file/directory anymore. The policy cannot be safely removed from the system unless we know there are no existing files or directories that use this "removed" policy. To find out whether there are files or directories which are using the policy is time consuming in runtime and might impact the Namenode performance. So a better choice is doing the work when NameNode restarts and loads Inodes. Collecting the information at that time will not introduce much extra overhead.