Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3398

Client will not retry when primaryDN is down once it's just got pipeline

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      Scenario:
      =========
      Start NN and three DN"S

      Get the datanode to which blocks has to be replicated.
      from

      nodes = nextBlockOutputStream(src);
      
      

      Before start writing to the DN ,kill the primary DN.

      // write out data to remote datanode
                blockStream.write(buf.array(), buf.position(), buf.remaining());
                blockStream.flush();
      

      Now write will fail with the exception

      2012-05-10 14:21:47,993 WARN  hdfs.DFSClient (DFSOutputStream.java:run(552)) - DataStreamer Exception
      java.io.IOException: An established connection was aborted by the software in your host machine
      	at sun.nio.ch.SocketDispatcher.write0(Native Method)
      	at sun.nio.ch.SocketDispatcher.write(Unknown Source)
      	at sun.nio.ch.IOUtil.writeFromNativeBuffer(Unknown Source)
      	at sun.nio.ch.IOUtil.write(Unknown Source)
      	at sun.nio.ch.SocketChannelImpl.write(Unknown Source)
      	at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:60)
      	at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
      	at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:151)
      	at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:112)
      	at java.io.BufferedOutputStream.write(Unknown Source)
      	at java.io.DataOutputStream.write(Unknown Source)
      	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:513)
      
      

      .

      1. HDFS-3398.patch
        0.6 kB
        amith
      2. HDFS-3398.patch
        0.6 kB
        amith
      3. HDFS_3398_3.patch
        1 kB
        amith

        Activity

        Brahma Reddy Battula created issue -
        Brahma Reddy Battula made changes -
        Field Original Value New Value
        Issue Type Task [ 3 ] Bug [ 1 ]
        Todd Lipcon made changes -
        Fix Version/s 3.0.0 [ 12320356 ]
        Target Version/s 2.0.0 [ 12320353 ]
        Component/s hdfs client [ 12312928 ]
        Uma Maheswara Rao G made changes -
        Target Version/s 2.0.0 [ 12320353 ] 2.0.0, 3.0.0 [ 12320353, 12320356 ]
        amith made changes -
        Attachment HDFS-3398.patch [ 12528207 ]
        amith made changes -
        Assignee amith [ amithdk ]
        amith made changes -
        Attachment HDFS-3398.patch [ 12528208 ]
        amith made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        amith made changes -
        Attachment HDFS_3398_3.patch [ 12529871 ]
        Uma Maheswara Rao G made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.0.1-alpha [ 12321440 ]
        Fix Version/s 3.0.0 [ 12320356 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322472 ]
        Fix Version/s 2.1.0-alpha [ 12321440 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320356 ]

          People

          • Assignee:
            amith
            Reporter:
            Brahma Reddy Battula
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development