Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10017

HRegionPartitioner, rows directed to last partition are wrongly mapped.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Abandoned
    • 0.94.6
    • None
    • mapreduce
    • None

    Description

      Inside HRegionPartitioner class there is getPartition() method which should map first numPartitions regions to appropriate partitions 1:1. But based on condition last region is hashed which could lead to last reducer not having any data. This is considered serious issue.

      I reproduced this only starting from 16 regions per table. Original defect was found in 0.94.6 but at least today's trunk and 0.91 branch head have the same HRegionPartitioner code in this part which means the same issue.

      Attachments

        1. HBASE-10017-r1544633.patch
          4 kB
          Roman Nikitchenko
        2. HBASE-10017-r1544633.patch
          4 kB
          Roman Nikitchenko
        3. patchSiteOutput.txt
          1001 kB
          Roman Nikitchenko
        4. TestHRegionServerBulkLoad-more-splits.txt
          0.9 kB
          Nick Dimiduk
        5. TEST-org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.xml.gz
          57 kB
          Nick Dimiduk
        6. TestHRegionServerBulkLoad-more-splits.txt
          2 kB
          Nick Dimiduk

        Activity

          People

            Unassigned Unassigned
            rn Roman Nikitchenko
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: