Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7730

Ozone Snapshot Deletion & Garbage Collection

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.0
    • None
    • None
    • None

    Description

      This jira includes all the sub-tasks related to Ozone snapshot deletion garbage collection.

      This jira itself is a "sub-task" under HDDS-6517 Ozone snapshot feature.

      Design doc: https://fossil-i.notion.site/2a624480dc7c4bc3ad608cbf86a25541

      PDF of Feb 2, 2023 revision: 02022023-Design_Ozone_Snapshot_Deletion_Garbage_Collection_based_on_key_deletedTable.pdf

      Attachments

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue HDDS-6858 Snapshot aware Key Deletion Service

          • Major - Major loss of function.
          • Resolved
          Parent Feature

          New Feature - A new feature of the product, which has yet to be developed. HDDS-6517 Snapshot support for Ozone

          • Major - Major loss of function.
          • Resolved
          1.
          		 Snapshot aware Key Deletion Service Sub-task Resolved Unassigned
          2.
          		 [Snapshot] Implement Snapshot Delete CLI and API Sub-task Resolved Siyao Meng
          3.
          		 [Snapshot] Wrap up TestOMSnapshotDeleteResponse Sub-task Resolved Siyao Meng
          4.
          		 [Snapshot] Delete keys in snapshot scope from deleteTable during createSnapshot to accommodate snapshot garbage collection Sub-task Resolved Siyao Meng
          5.
          		 [Snapshot] DirectoryDeletingService should clean up Snapshot's deletedDirTable Sub-task Resolved Aswin Shakil
          6.
          		 [Snapshot] KeyDeletingService to be aware of Ozone snapshots Sub-task Resolved Aswin Shakil
          7.
          		 [Snapshot] Implement SnapshotDeletingTask Sub-task Resolved Aswin Shakil
          8.
          		 [Snapshot] Store Ozone keys ever renamed in renamedKeyTable for efficient lookup in SnapshotDeletingService Sub-task Resolved Aswin Shakil
          9.
          		 [Snapshot] Accommodate FSO, Key renames and implement OMSnapshotPurgeRequest for SnapshotDeletingService Sub-task Resolved Aswin Shakil
          10.
          		 [Snapshot] renamedKeyTable should only track keys in buckets that has at least one active snapshot Sub-task Resolved Aswin Shakil
          11.
          		 [Snapshot] Merge entries from snapshotRenamedKeyTable to next snapshot Sub-task Resolved Aswin Shakil
          12.
          		 [Snapshot] Handle Directory renames for FSO Buckets. Sub-task Resolved Aswin Shakil
          13.
          		 [Snapshot] Reconstruct snapshot chain during OM startup Sub-task Resolved Unassigned
          14.
          		 [Snapshot] Clean up FSO deletedDirTable as well during snapshot creation Sub-task Resolved Siyao Meng
          15.
          		 [Snapshot] Fix bugs and add tests for SnapshotDeletingService Sub-task Resolved Aswin Shakil
          16.
          		 [Snapshot] Improve KeyDeletingService to reclaim eligible key blocks in snapshot's deletedTable Sub-task Resolved Aswin Shakil
          17.
          		 [Snapshot] Revisit locks on deletedTable and deletedDirTable Sub-task Resolved Siyao Meng
          18.
          		 [Snapshot] Skip non active snapshots while walking snapshot chain for deletion processing Sub-task Resolved Aswin Shakil
          19.
          		 CreateCheckpoint needs to be idemp[otent Sub-task Resolved Aswin Shakil
          20.
          		 Garbage Reclaim old versions of key in Snapshot DeletedKeyTable Sub-task Resolved Aswin Shakil

          Activity

            People

              smeng Siyao Meng
              smeng Siyao Meng
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: