[MAPREDUCE-5782] Sort Use TableOrderPartitioner cannot find the path of _partition.lst int the container cwd.

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.23.10, 2.4.0
• Release Note: Fix the sort example when TotalOrderPartitioner is specified.
• Assignee: Unassigned
• Reporter: Bing Jiang
• Created: 07/Mar/14 06:49
• Updated: 22/Mar/15 19:46

Description

hadoop jar hadoop-mapreduce-examples.jar sort sort \
-inFormat org.apache.hadoop.mapreduce.lib.input.KeyValueTextInputFormat \
-outFormat org.apache.hadoop.mapreduce.lib.output.TextOutputFormat \
-outKey org.apache.hadoop.io.Text \
-outValue org.apache.hadoop.io.Text \
-totalOrder 0.1 10000 10 \
input output
It prints cannot find the file _partition.lst in the container's cwd.
Error: java.lang.IllegalArgumentException: Can't read partitions file
at
org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.setConf(TotalOrderPartitioner.java:116)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:642)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:710)
at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158)