[HDDS-4678] Add an option to limit the number of OM events Recon retrieves in each batch

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.0
• Component/s: Ozone Recon
• Assignee: Unassigned
• Reporter: Siyao Meng
• Created: 12/Jan/21 18:44
• Updated: 22/Sep/22 17:32
• Resolved: 22/Sep/22 17:32

Description

Original comment: https://github.com/apache/ozone/pull/1680#pullrequestreview-549375494

Summary

Currently we don't have explicit control over how much events Recon will receive on each batch of events from OM. This can lead to Recon OOM like in HDDS-4570 when the max heap is too small and/or OM is too busy and/or sync interval is too long.

A good start point for looking into this might be at OzoneManagerServiceProviderImpl#syncDataFromOM.