[MAPREDUCE-4771] KeyFieldBasedPartitioner not partitioning properly when configured

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.3, 2.0.1-alpha
• Fix Version/s: 2.0.3-alpha, 0.23.5
• Component/s: mrv2
• Target Version/s: 2.0.3-alpha, 0.23.5
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 05/Nov/12 19:13
• Updated: 03/Sep/14 23:17
• Resolved: 05/Nov/12 22:32

Description

Relative to Hadoop 0.20/1.x, KeyFieldBasedPartitioner is not distributing across partitions properly when configured. This is related to the double-configure issue as described in HADOOP-7425. KeyFieldBasedPartitioner is getting configured twice, and that ends up duplicating the keyspecs and causing the keys to be hashed twice.

KeyFieldBasedPartitioner should not duplicate keyspecs when configured twice.

Issue Links

• is related to: HADOOP-7425 ReflectionUtils.setConf would configure anything Configurable twice