Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10766

Exceptions thrown by requestShortCircuitFdsForRead can be lost

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • logging
    • HDP-2.4

    • Patch

    Description

      There was some error while creating requestShortCircuitFdsForRead and the exception is thrown when logging the info message

      In this scenario, the actual exception was lost

      To get the actual exception message it needs to be handled properly.

      2016-07-25 13:11:54,323 ERROR datanode.DataNode (DataXceiver.java:run(278)) - xyz.com:50010:DataXceiver error processing REQUEST_SHORT_CIRCUIT_FDS operation src: unix:/var/lib/hadoop-hdfs/dn_socket dst: <local>
      org.apache.hadoop.fs.InvalidRequestException: there is no shared memory segment registered with shmId 0773fa8b13b4643cb5be98893af5a873
      at org.apache.hadoop.hdfs.server.datanode.ShortCircuitRegistry.unregisterSlot(ShortCircuitRegistry.java:371)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.requestShortCircuitFds(DataXceiver.java:364)
      at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opRequestShortCircuitFds(Receiver.java:187)
      at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:89)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:251)
      at java.lang.Thread.run(Thread.java:745)

      Attachments

        1. HDFS-10766-1.patch
          2 kB
          Karthik Palanisamy
        2. HDFS-10766-2.patch
          2 kB
          Karthik Palanisamy

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kpalanisamy Karthik Palanisamy
            kpalanisamy Karthik Palanisamy

            Dates

              Created:
              Updated:

              Slack

                Issue deployment