Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14867

SimpleRegionNormalizer needs to have better heuristics to trigger merge operation

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.0, 1.3.0, 2.0.0
    • master
    • None
    • Reviewed

    Description

      SimpleRegionNormalizer needs to have better heuristics to trigger merge operation. SimpleRegionNormalizer is not able to trigger a merge action if the table's smallest region has neighboring regions that are larger than table's average region size, whereas there are other smaller regions whose combined size is less than the average region size.

      For example,

      • Consider a table with six region, say r1 to r6.
      • Keep r1 as empty and create some data say, 100K rows of data for each of the regions r2, r3 and r4. Create smaller amount of data for regions r5 and r6, say about 27K rows of data.
      • Run the normalizer. Verify the number the regions for that table and also check the master log to see if any merge action was triggered as a result of normalization.

      In such scenario, it would be better to have a merge action triggered for those two smaller regions r5 and r6 even though either of them is not the smallest one

      Attachments

        1. 14867-v2.txt
          7 kB
          Ted Yu
        2. 14867-v3.txt
          10 kB
          Ted Yu
        3. 14867-v4.txt
          10 kB
          Ted Yu

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yuzhihong@gmail.com Ted Yu
            romil.choksi Romil Choksi
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment