Description
A server should never create a new directory unless RaftStorage.StartupOption.FORMAT is specified. Otherwise, it will cause data loss since the raft log committed in that server is (temporarily) lost. Consider the following
- Server A and Server B were fast and had commit index 100 while server C had commit index 90.
- The disk of Server A was bad and it was restarted with RECOVER. Since it cannot access its directory in the bad disk, it created a new directory in another disk. Then, its commit index was reset and became -1.
- Server C started a leader election and Server A voted for it. The commit index became 90 – it lost the commits from index 91 to index 100.
Attachments
Attachments
Issue Links
- breaks
-
RATIS-1694 Fix the compatibility issue of RATIS-1677
- Resolved
- is duplicated by
-
RATIS-1668 When an existing dir fails, server should not initialize a new dir
- Resolved
- relates to
-
RATIS-1995 Prevent data loss when a storage is accidentally re-formatted
- Open
-
HDDS-7103 Ratis log storage directories unchecked causing unhandled exception on datanode restart
- Resolved
-
RATIS-1871 Auto format RaftStorage when there is only one directory configured.
- Resolved
- links to