[HDDS-7524] Compaction DAG node pruning (deleting part of the DAG > oldest retained snapshot)

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HDDS-6517-Snapshot
• Labels: pull-request-available
• Assignee: Hemant Kumar
• Reporter: Hemant Kumar
• Created: 21/Nov/22 21:55
• Updated: 02/Feb/23 05:06
• Resolved: 03/Jan/23 19:33

Description

We will have a concept of oldest Snapshot with compaction history. We will support efficient Snapdiffs from snapshots as old as this oldest with compaction history. We will delete SST file nodes in the compaction DAG that will not be used in any SnapDiff since this oldest retained Snapshot.

We will continue to support SnapDiffs from older Snapshots as well. But they will iterate over all the keys in the namespace.

Issue Links

• is cloned by: HDDS-7873 [Snapshot] Prune backup SST files that can be expanded periodically
• links to: GitHub Pull Request #4045
• links to: GitHub Pull Request #4163