[MAPREDUCE-735] ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.1
• Fix Version/s: 0.20.1
• Hadoop Flags: Reviewed
• Tags: ygridqa
• Assignee: Amar Kamat
• Reporter: Suman Sehgal
• Created: 08/Jul/09 05:43
• Updated: 22/Jul/09 14:48
• Resolved: 22/Jul/09 14:48

Description

KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of the specified key is missing.
Scenario :
=======
when value of num.key.fields.for.partition is greater than the separators provided in the input.
Command:
========
hadoop jar streaming.jar -Dmapred.reduce.tasks=3 -Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer org.apache.hadoop.mapred.lib.IdentityReducer -inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner

Issue Links

• blocks: MAPREDUCE-2 ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key