[HDDS-10141] [hsync]Support hard limit and auto recovery for hsync file

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Labels: pull-request-available
• Assignee: Ashish Kumar
• Reporter: Ashish Kumar
• Created: 17/Jan/24 07:35
• Updated: 25/Jan/24 09:44
• Resolved: 25/Jan/24 09:44

Description

Introduce a new property “ozone.om.lease.hard.limit”(default 7d) for hsync open files. 

For an hsync open file in OpenFileTable, if file lifetime is already beyond the “ozone.om.lease.hard.limit” threshold, there are two cases, OpenKeyCleanupService will

1. If it has the “leaseRecovery” flag set, which means it is under an explicitly lease recovery, then OpenKeyCleanupService will keep it in OpenFileTable.

2. If it doesn’t has the “leaseRecovery” flag set, then OpenKeyCleanupService will auto commit it with the KeyInfo in openFileTable. In this case, the final block might lose some data at the block end which is hsynced.

Issue Links

• links to: GitHub Pull Request #6033