[HIVE-22290] ObjectStore.cleanWriteNotificationEvents and ObjectStore.cleanupEvents OutOfMemory on large number of pending events

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Component/s: HCatalog, repl
• Labels: pull-request-available
• Assignee: Naresh P R
• Reporter: Thomas Prelle
• Created: 03/Oct/19 13:43
• Updated: 16/Sep/20 03:07
• Resolved: 16/Sep/20 03:07

Description

As in https://jira.apache.org/jira/browse/HIVE-19430 if there are large number of events that haven't been cleaned up for some reason, then ObjectStore.cleanWriteNotificationEvents() and ObjectStore.cleanupEvents can run out of memory while it loads all the events to be deleted.
It should fetch events in batches.

Issue Links

• links to: GitHub Pull Request #1484