Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      I recently started running the unit tests with -Dcompile.c++=yes so that pipes is compiled and it's unit tests are run.

      TestPipes.testPipes consistently fails on Linux with
      junit.framework.AssertionFailedError: got exception: java.io.IOException: Job failed!
      at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:625)
      at org.apache.hadoop.mapred.pipes.Submitter.submitJob(Submitter.java:250)
      at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:404)
      at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:173)
      at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)

      at org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:180)
      at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)

      which is perhaps caused by
      2007-08-14 02:10:18,831 INFO mapred.TaskRunner (ReduceTaskRunner.java:close(45)) - task_200708140209_0003_r_000000_0 done; removing files.
      2007-08-14 02:10:18,841 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(371)) - Error from task_200708140209_0003_r_000000_0: java.io.IOException: pipe child exception
      at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:130)
      at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:103)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:328)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1778)
      Caused by: java.net.SocketException: Broken pipe
      at java.net.SocketOutputStream.socketWrite0(Native Method)
      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
      at java.net.SocketOutputStream.write(SocketOutputStream.java:115)
      at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
      at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:278)
      at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:258)
      at org.apache.hadoop.mapred.pipes.BinaryProtocol.close(BinaryProtocol.java:281)
      at org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:95)
      ... 2 more

        Activity

        Nigel Daley created issue -
        Owen O'Malley made changes -
        Field Original Value New Value
        Attachment fix-test-pipes.patch [ 12363807 ]
        Owen O'Malley made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Doug Cutting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s pipes [ 12311773 ]

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Nigel Daley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development