[HDDS-5105] SCM is OOM due to too many ContainerReport is queued.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.2.0
• Component/s: SCM
• Assignee: Unassigned
• Reporter: Glen Geng
• Created: 14/Apr/21 07:52
• Updated: 12/Sep/23 08:22
• Resolved: 12/Sep/23 08:22

Description

The heap dump 

https://drive.google.com/file/d/1k4rRSDv6lazsViwTouF8MXSPLF_AvY6w/view?usp=sharing

 

Some Info,
1. SCM's  max heap is 10GB. SCM is OOM after it's first restart after a cluster wise upgrade and restart.  Recon is on at that time.  Then we restart the SCM and turn off the Recon. SCM works well after that.
2. There are totally 400K+ containers in the cluster of 40 DNs.
 

Sub-Tasks

• Add trace for contaner report: Resolved