Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4164

Hadoop 22 Exception thrown after task completion causes its reexecution

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.1
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Target Version/s:

      Description

      2012-02-28 19:17:08,504 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 1969310 bytes
      2012-02-28 19:17:08,694 INFO org.apache.hadoop.mapred.Task: Task:attempt_201202272306_0794_m_000094_0 is done. And is in the process of commiting
      2012-02-28 19:18:08,774 INFO org.apache.hadoop.mapred.Task: Communication exception: java.io.IOException: Call to /127.0.0.1:35400 failed on local exception: java.nio.channels.ClosedByInterruptException
      at org.apache.hadoop.ipc.Client.wrapException(Client.java:1094)
      at org.apache.hadoop.ipc.Client.call(Client.java:1062)
      at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198)
      at $Proxy0.statusUpdate(Unknown Source)
      at org.apache.hadoop.mapred.Task$TaskReporter.run(Task.java:650)
      at java.lang.Thread.run(Thread.java:662)
      Caused by: java.nio.channels.ClosedByInterruptException
      at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)
      at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:341)
      at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:60)
      at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
      at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:151)
      at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:112)
      at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
      at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
      at java.io.DataOutputStream.flush(DataOutputStream.java:106)
      at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:769)
      at org.apache.hadoop.ipc.Client.call(Client.java:1040)
      ... 4 more

      2012-02-28 19:18:08,825 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201202272306_0794_m_000094_0' done.

      ================>>>>>> SHOULD be <++++++++++++++
      2012-02-28 19:17:02,214 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 1974104 bytes
      2012-02-28 19:17:02,408 INFO org.apache.hadoop.mapred.Task: Task:attempt_201202272306_0794_m_000000_0 is done. And is in the process of commiting
      2012-02-28 19:17:02,519 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201202272306_0794_m_000000_0' done.

        Activity

        Mayank Bansal created issue -
        Mayank Bansal made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-4164.patch [ 12523056 ]
        Konstantin Shvachko made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Target Version/s 0.22.1 [ 12319242 ]
        Fix Version/s 0.22.1 [ 12319242 ]
        Resolution Fixed [ 1 ]
        Konstantin Shvachko made changes -
        Affects Version/s 0.22.0 [ 12314184 ]

          People

          • Assignee:
            Mayank Bansal
            Reporter:
            Mayank Bansal
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development