[HDFS-15524] Add edit log entry for Snapshot deletion GC thread snapshot deletion - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Convert to Issue

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.4.0
Fix Version/s: 3.4.0
Component/s: snapshots
Labels:
None

Target Version/s:

3.4.0
Hadoop Flags:

Reviewed

Description

Currently, Snapshot deletion Gc thread doesn't create an edit log transaction when the actual snapshot is garbage collected. In cases as such, what might happen is, if the gc thread deletes snapshots and then namenode is restarted, snapshots which were garbage collected by the snapshot gc thread prior restart will reapper till the gc thread again picks them up for garbage collection as the edits were not captured for actual garbage collection and at the same time data might have already been deleted from the datanodes which may lead to too many spurious missing block alerts.