Details
-
Bug
-
Status: Closed
-
Blocker
-
Resolution: Fixed
-
0.14.0
-
None
-
None
Description
I recently started running the unit tests with -Dcompile.c++=yes so that pipes is compiled and it's unit tests are run.
TestPipes.testPipes consistently fails on Linux with
junit.framework.AssertionFailedError: got exception: java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:625)
at org.apache.hadoop.mapred.pipes.Submitter.submitJob(Submitter.java:250)
at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:404)
at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:173)
at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)
at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:180)
at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)
which is perhaps caused by
2007-08-14 02:10:18,831 INFO mapred.TaskRunner (ReduceTaskRunner.java:close(45)) - task_200708140209_0003_r_000000_0 done; removing files.
2007-08-14 02:10:18,841 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(371)) - Error from task_200708140209_0003_r_000000_0: java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:130)
at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:103)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:328)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1778)
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
at java.net.SocketOutputStream.write(SocketOutputStream.java:115)
at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:278)
at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:258)
at org.apache.hadoop.mapred.pipes.BinaryProtocol.close(BinaryProtocol.java:281)
at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:95)
... 2 more