[HBASE-17765] Reviving the merge possibility in the CompactingMemStore

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0

Release Note

Reviving the merge of the compacting pipeline: making the limit on the number of the segments in the pipeline configurable and adding the merge test.

In order to customize the pipeline size limit change the value of the "hbase.hregion.compacting.pipeline.segments.limit" in the hbase-site.xml

Value 1 means to merge the segments on any flush-in-memory. Value higher than 16 means no merge.

• Assignee: Anastasia Braginsky
• Reporter: Anastasia Braginsky
• Created: 09/Mar/17 19:11
• Updated: 24/Jun/22 18:21
• Resolved: 27/Mar/17 12:43

Description

According to the new performance results presented in the HBASE-16417 we see that the read latency of the 90th percentile of the BASIC policy is too big due to the need to traverse through too many segments in the pipeline. In this JIRA we correct the bug in the merge sizing calculations and allow pipeline size threshold to be a configurable parameter.