Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
0.23.10, 2.4.0
-
None
-
None
-
None
-
Fix the sort example when TotalOrderPartitioner is specified.
Description
hadoop jar hadoop-mapreduce-examples.jar sort sort \
-inFormat org.apache.hadoop.mapreduce.lib.input.KeyValueTextInputFormat \
-outFormat org.apache.hadoop.mapreduce.lib.output.TextOutputFormat \
-outKey org.apache.hadoop.io.Text \
-outValue org.apache.hadoop.io.Text \
-totalOrder 0.1 10000 10 \
input output
It prints cannot find the file _partition.lst in the container's cwd.
Error: java.lang.IllegalArgumentException: Can't read partitions file
at
org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.setConf(TotalOrderPartitioner.java:116)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:642)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:710)
at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158)