[HIVE-24070] ObjectStore.cleanWriteNotificationEvents OutOfMemory on large number of pending events

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-2
• Component/s: repl
• Assignee: Ramesh Kumar Thangarajan
• Reporter: Ramesh Kumar Thangarajan
• Created: 25/Aug/20 08:01
• Updated: 16/Nov/22 13:50
• Resolved: 14/Sep/20 08:05

Description

If there are large number of events that haven't been cleaned up for some reason, then ObjectStore.cleanWriteNotificationEvents() can run out of memory while it loads all the events to be deleted.
It should fetch events in batches.

Similar to https://issues.apache.org/jira/browse/HIVE-19430

Issue Links

• relates to: HIVE-24071 Continue cleaning the NotificationEvents till we have data greater than TTL