Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3555

idle client socket triggers DN ERROR log (should be INFO or DEBUG)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 2.0.2-alpha
    • Component/s: datanode, hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Datanode service is logging java.net.SocketTimeoutException at ERROR level.
      This message indicates that the datanode is not able to send data to the client because the client has stopped reading. This message is not really a cause for alarm and should be INFO level.

      2012-06-18 17:47:13 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode DatanodeRegistration(x.x.x.x:50010, storageID=DS-196671195-10.10.120.67-50010-1334328338972, infoPort=50075, ipcPort=50020):DataXceiver
      java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready for write. ch : java.nio.channels.SocketChannel[connected local=/10.10.120.67:50010 remote=/10.10.120.67:59282]
      at org.apache.hadoop.net.SocketIOWithTimeout.waitForIO(SocketIOWithTimeout.java:246)
      at org.apache.hadoop.net.SocketOutputStream.waitForWritable(SocketOutputStream.java:159)
      at org.apache.hadoop.net.SocketOutputStream.transferToFully(SocketOutputStream.java:198)
      at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:397)
      at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:493)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:267)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:163)

      1. hdfs-3555-3.txt
        3 kB
        Andy Isaacson
      2. hdfs-3555-2.txt
        2 kB
        Andy Isaacson
      3. hdfs-3555.patch
        3 kB
        Andy Isaacson

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322472 ]
        Fix Version/s 2.1.0-alpha [ 12321440 ]
        Harsh J made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 2.0.1-alpha [ 12321440 ]
        Fix Version/s 2.0.1-alpha [ 12321440 ]
        Resolution Fixed [ 1 ]
        Harsh J made changes -
        Environment Red Hat Enterprise Linux Server release 6.2 (Santiago)
        Harsh J made changes -
        Hadoop Flags Reviewed [ 10343 ]
        Component/s data-node [ 12312927 ]
        Component/s hdfs client [ 12312928 ]
        Andy Isaacson made changes -
        Attachment hdfs-3555-3.txt [ 12535733 ]
        Andy Isaacson made changes -
        Attachment hdfs-3555-2.txt [ 12533151 ]
        Andy Isaacson made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Andy Isaacson made changes -
        Attachment hdfs-3555.patch [ 12532986 ]
        Andy Isaacson made changes -
        Project Hadoop Common [ 12310240 ] Hadoop HDFS [ 12310942 ]
        Key HADOOP-8519 HDFS-3555
        Affects Version/s 0.20.2 [ 12314204 ]
        Affects Version/s 0.20.2 [ 12314203 ]
        Target Version/s 2.0.1-alpha [ 12321441 ] 2.0.1-alpha [ 12321440 ]
        Andy Isaacson made changes -
        Summary ERROR level log message should probably be changed to INFO idle client socket triggers DN ERROR log (should be INFO or DEBUG)
        Issue Type Task [ 3 ] Bug [ 1 ]
        Target Version/s 2.0.1-alpha [ 12321441 ]
        Andy Isaacson made changes -
        Assignee Andy Isaacson [ adi2 ]
        Jeff Lord made changes -
        Field Original Value New Value
        Issue Type Bug [ 1 ] Task [ 3 ]
        Jeff Lord created issue -

          People

          • Assignee:
            Andy Isaacson
            Reporter:
            Jeff Lord
          • Votes:
            1 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development