[TAJO-1004] UniformRangePartition cannot deal with unicode ranges

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Assignee: Hyunsik Choi
• Reporter: Hyunsik Choi
• Created: 13/Aug/14 06:07
• Updated: 18/Sep/14 08:32
• Resolved: 18/Sep/14 08:32

Description

UniformRangePartition plays a role to divide a given range into multiple sub ranges. It is used for range shuffle.

When UniformRangePartition divides a range of text fields, it Internally transforms arrays of bytes into unsigned integer. But, a byte represent -127 to 127, and unicode is out of range in byte representation. So, the current approach can cause errors in this case.