[HBASE-1183] New MR splitting algorithm and other new features need a way to split a key range in N chunks

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.20.0
• Component/s: util
• Assignee: Jonathan Gray
• Reporter: Jonathan Gray
• Created: 03/Feb/09 22:07
• Updated: 02/May/13 02:29
• Resolved: 27/Apr/09 18:06

Description

For HBASE-1172 and other functionality coming soon, we need to be able to take a [start,stop) range and divide it into chunks.

For example, we have 10 regions but want to run 30 maps. We need to divide each region into three key ranges for the start/stop of each scanner.

Implementing using java.math.BigInteger

Will also include a couple additional helpers in Bytes to make life easy.

Issue Links

• blocks: HBASE-1349 Add Support to skip bad records on MR jobs
• is depended upon by: HBASE-1172 Modify TableInputFormat splitting algorithm to allow any number of mappers
• is related to: HBASE-32 [hbase] Add row count estimator
• is related to: HBASE-635 Individual TableMap tasks don't report percentage complete.