Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15357

TableInputFormatBase getSplitKey does not handle signed bytes correctly

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0, 2.0.0
    • mapreduce
    • None
    • Reviewed

    Description

      When auto-balance is enabled in TableInputFormatBase and the table key is a binary key, the getSplitKey method does not function correctly for signed bytes. The proposed solution it to utilize org.apache.hadoop.hbase.util.Bytes#split method to find the split key. org.apache.hadoop.hbase.util.Bytes#split is stated to be a expensive operation, so if another solution is preferred, that is fine. In addition, handling of a split key that is equal to the TableSplit end key is added to calculateRebalancedSplits.

      Attachments

        1. HBASE-15357.patch
          11 kB
          Nathan Schile
        2. 15357.v2.txt
          11 kB
          Ted Yu
        3. 15357-branch-1.v2.txt
          9 kB
          Ted Yu
        4. 15357-branch-1.v3.txt
          12 kB
          Nathan Schile

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            nathan.schile@gmail.com Nathan Schile
            nathan.schile@gmail.com Nathan Schile
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment