Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3398

Client will not retry when primaryDN is down once it's just got pipeline

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      Scenario:
      =========
      Start NN and three DN"S

      Get the datanode to which blocks has to be replicated.
      from

      nodes = nextBlockOutputStream(src);
      
      

      Before start writing to the DN ,kill the primary DN.

      // write out data to remote datanode
                blockStream.write(buf.array(), buf.position(), buf.remaining());
                blockStream.flush();
      

      Now write will fail with the exception

      2012-05-10 14:21:47,993 WARN  hdfs.DFSClient (DFSOutputStream.java:run(552)) - DataStreamer Exception
      java.io.IOException: An established connection was aborted by the software in your host machine
      	at sun.nio.ch.SocketDispatcher.write0(Native Method)
      	at sun.nio.ch.SocketDispatcher.write(Unknown Source)
      	at sun.nio.ch.IOUtil.writeFromNativeBuffer(Unknown Source)
      	at sun.nio.ch.IOUtil.write(Unknown Source)
      	at sun.nio.ch.SocketChannelImpl.write(Unknown Source)
      	at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:60)
      	at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
      	at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:151)
      	at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:112)
      	at java.io.BufferedOutputStream.write(Unknown Source)
      	at java.io.DataOutputStream.write(Unknown Source)
      	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:513)
      
      

      .

        Attachments

        1. HDFS_3398_3.patch
          1 kB
          amith
        2. HDFS-3398.patch
          0.6 kB
          amith
        3. HDFS-3398.patch
          0.6 kB
          amith

          Activity

            People

            • Assignee:
              amithdk amith
              Reporter:
              brahmareddy Brahma Reddy Battula
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: