[HBASE-3551] Loaded hfile indexes occupy a good chunk of heap; look into shrinking the amount used

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 20/Feb/11 05:13
• Updated: 12/Jun/22 00:51
• Resolved: 10/Mar/11 20:07

Description

I hung with a user Marc and we were looking over configs and his cluster profile up on ec2. One thing we noticed was that his 100+ 1G regions of two families had ~2.5G of heap resident. We did a bit of math and couldn't get to 2.5G so that needs looking into. Even still, 2.5G is a bunch of heap to give over to indices (He actually OOME'd when he had his RS heap set to just 3G; we shouldn't OOME, we should just run slower). It sounds like he needs the indices loaded but still, for some cases we should drop indices for unaccessed files.