Details
Description
In the setConf method of org.apache.hadoop.util.ReflectionUtils, any instance of Configurable would be configured twice.
In 0.21.0, KeyFieldBasedPartitioner implements the Configurable interface. When configured twice, it get two KeyDescription and gives out wrong partition number.
public static void setConf(Object theObject, Configuration conf) {
if (conf != null) {
if (theObject instanceof Configurable)
setJobConf(theObject, conf);
}
}
Attachments
Attachments
Issue Links
- is blocked by
-
MAPREDUCE-2709 Test case to ensure ReflectionUtils.setConf configures the target object only once
- Resolved
- relates to
-
MAPREDUCE-4771 KeyFieldBasedPartitioner not partitioning properly when configured
- Closed