[IGNITE-18122] Track last applied term and group config in storages

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0
• Component/s: persistence
• Labels: ignite-3
• Epic Link: Storage support for Rebalancing
• Assignee: Roman Puchkovskiy
• Reporter: Roman Puchkovskiy
• Reviewer: Aleksandr Polovtsev
• Created: 11/Nov/22 08:11
• Updated: 04/Sep/24 16:19
• Resolved: 16/Nov/22 10:32

Description

We need last applied index, term and group config to build a snapshot meta. In the current implementation, only the index is stored our storages (MV and TX), but term and config are taken from JRaft's LogManager. This is unreliable as the log might be truncated.

We must store term and config in our storages as well (term in both of them as it is kinda required attribute of a RAFT index, and group only in MV storage).

Also, we must make sure that on ANY command processed by PartitionListener (and on configuration committed event, too), we update lastAppliedIndex+term in one of the storages, Otherwise, a resulting gap might hinder AppendEntries calls to followers requiring to install a snapshot in an infinite loop.

Issue Links

• is caused by: IGNITE-18079 Integrate RAFT streaming snapshots
• supercedes: IGNITE-18011 Avoid obtaining LogManager to stream RAFT snapshots
• links to: GitHub Pull Request #1331