[HBASE-26429] HeapMemoryManager fails memstore flushes with NPE if enabled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.8
• Fix Version/s: 2.5.0, 3.0.0-alpha-2, 2.3.8, 2.4.9
• Component/s: Operability, regionserver
• Hadoop Flags: Reviewed
• Assignee: Andrew Kyle Purtell
• Reporter: Andrew Kyle Purtell
• Created: 05/Nov/21 22:01
• Updated: 10/Nov/21 02:42
• Resolved: 09/Nov/21 02:31

Description

Nonstandard configuration under test:

<property>
<name>hfile.block.cache.size.min.range</name>
<value>0.1</value>
</property>
<property>
<name>hfile.block.cache.size.max.range</name>
<value>0.5</value>
</property>

<property>
<name>hbase.regionserver.global.memstore.size.min.range</name>
<value>0.2</value>
</property>
<property>
<name>hbase.regionserver.global.memstore.size.max.range</name>
<value>0.7</value>
</property>

The NPE:

2021-11-05 21:52:13,828 ERROR [MemStoreFlusher.1] regionserver.MemStoreFlusher: Cache flusher failed for entry [flush region IntegrationTestLoadCommonCrawl,com.yeqingteng.www//gysy/28,1636143958130.4be7e8d968cc73cf729cb4713328f729.]
java.lang.NullPointerException
        at org.apache.hadoop.hbase.regionserver.HeapMemoryManager$HeapMemoryTunerChore.flushRequested(HeapMemoryManager.java:402)
        at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.notifyFlushRequest(MemStoreFlusher.java:661)
        at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:616)
        at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:586)
        at org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$1000(MemStoreFlusher.java:68)
        at org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:360)

The reason for the NPE is obvious in MemStoreFlusher.java.

Issue Links

• links to: GitHub Pull Request #3819

Sub-Tasks

• Increase DefaultHeapMemoryTuner log level: Resolved