Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      I recently started running the unit tests with -Dcompile.c++=yes so that pipes is compiled and it's unit tests are run.

      TestPipes.testPipes consistently fails on Linux with
      junit.framework.AssertionFailedError: got exception: java.io.IOException: Job failed!
      at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:625)
      at org.apache.hadoop.mapred.pipes.Submitter.submitJob(Submitter.java:250)
      at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:404)
      at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:173)
      at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)

      at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:180)
      at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)

      which is perhaps caused by
      2007-08-14 02:10:18,831 INFO mapred.TaskRunner (ReduceTaskRunner.java:close(45)) - task_200708140209_0003_r_000000_0 done; removing files.
      2007-08-14 02:10:18,841 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(371)) - Error from task_200708140209_0003_r_000000_0: java.io.IOException: pipe child exception
      at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:130)
      at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:103)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:328)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1778)
      Caused by: java.net.SocketException: Broken pipe
      at java.net.SocketOutputStream.socketWrite0(Native Method)
      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
      at java.net.SocketOutputStream.write(SocketOutputStream.java:115)
      at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
      at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:278)
      at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:258)
      at org.apache.hadoop.mapred.pipes.BinaryProtocol.close(BinaryProtocol.java:281)
      at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:95)
      ... 2 more

        Activity

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Nigel Daley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development