[HBASE-27805] The chunk created by mslab may cause memory fragement and lead to fullgc

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: documentation
• Assignee: Zheng Wang
• Reporter: Zheng Wang
• Created: 20/Apr/23 02:38
• Updated: 27/Jul/23 19:47
• Resolved: 27/Jul/23 02:02

Description

The default size of chunk is 2m, when we use G1, if heapRegionSize equals 4m, these chunks are allocated as humongous objects, exclusively allocating one region, then the remaining 2m become memory fragement.

Lots of memory fragement may lead to fullgc even if the percent of used heap not high enough.

I have tested to reduce the chunk size to 2047k(2m-1k, a bit lesser than half of heapRegionSize), there was no repeat of the above.

BTW, in G1, humongous objects are objects larger or equal the size of half a region, and the heapRegionSize is automatically calculated based on the heap size parameter if not explicitly specified.

 

Issue Links

• links to: GitHub Pull Request #5193