[HDFS-11154] Block Storage : store server state to persistent storage

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HDFS-7240
• Component/s: hdfs
• Target Version/s: HDFS-7240
• Hadoop Flags: Reviewed
• Assignee: Chen Liang
• Reporter: Chen Liang
• Created: 17/Nov/16 23:06
• Updated: 26/Apr/18 21:48
• Resolved: 23/Nov/16 01:52

Description

Currently, all the storage state are kept in server memory. If server crashes, we would lose all the volume information. This JIRA stores server internal state into its local disk. Such that on server failure, we can simply restart server and restore volume information from disk.

More specifically, the internal state written to disk is mainly the mapping from volume to its underlying containers, plus some meta information such as volume size, block size, etc.

Note that this is only a simple, minimum set mechanism for persistence. It is more like a counterpart of fsimage in HDFS, but without edit logs.

Issue Links

• Dependent: HDFS-11138 Block Storage : add block storage server