[HDFS-15059] Cache finalized replica info during datanode shutdown for fast restarting

• Type: Improvement
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Component/s: datanode
• Assignee: Yang Yun
• Reporter: Yang Yun
• Created: 13/Dec/19 10:27
• Updated: 17/Apr/20 08:59

Description

HDFS-7928 persist the whole volume map on the disk and let the datanode read that file and create the volume map during startup. This significantly improve the datanode startup time.
But it not works for any cases. For example, if datanode is killed, it's no chance to save the volume map.
Add a shutdown hook to make sure the volume map is saved during shutdown.
If the datanode is terminated by kill or other methods, we only reload the finalized replca from cache. It's is safe because the DirectoryScanner will run soon to correct possible missmatch.

Issue Links

• is a child of: HDFS-14627 Improvements to make slow archive storage works on HDFS