[HDDS-11201] worker queue of FullTableCache cleanup consume much memory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Ozone Manager
• Labels: pull-request-available
• Assignee: Sumit Agrawal
• Reporter: Sumit Agrawal
• Created: 18/Jul/24 05:56
• Updated: 05/Aug/24 04:03
• Resolved: 02/Aug/24 06:12

Description

As observed, FullTableCache cleanup queue consumes 4GB as events keeps getting added to queue (reached 28442228 for this case) for cleanup of evictionEntries. 

There is a possibility of this due to lock used in cleanup thread, and this lock is non-fair.

 

 

As part of this, need check if evictionEntries can be optimized as used for cache eviction when cache value is null and epoch is current value transaction Id. and/or fair locking mechanism.

Issue Links

• links to: GitHub Pull Request #6962