Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10766

Exceptions thrown by requestShortCircuitFdsForRead can be lost

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: logging
    • Labels:
    • Environment:

      HDP-2.4

    • Flags:
      Patch

      Description

      There was some error while creating requestShortCircuitFdsForRead and the exception is thrown when logging the info message

      In this scenario, the actual exception was lost

      To get the actual exception message it needs to be handled properly.

      2016-07-25 13:11:54,323 ERROR datanode.DataNode (DataXceiver.java:run(278)) - xyz.com:50010:DataXceiver error processing REQUEST_SHORT_CIRCUIT_FDS operation src: unix:/var/lib/hadoop-hdfs/dn_socket dst: <local>
      org.apache.hadoop.fs.InvalidRequestException: there is no shared memory segment registered with shmId 0773fa8b13b4643cb5be98893af5a873
      at org.apache.hadoop.hdfs.server.datanode.ShortCircuitRegistry.unregisterSlot(ShortCircuitRegistry.java:371)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.requestShortCircuitFds(DataXceiver.java:364)
      at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opRequestShortCircuitFds(Receiver.java:187)
      at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:89)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:251)
      at java.lang.Thread.run(Thread.java:745)

        Attachments

        1. HDFS-10766-1.patch
          2 kB
          Karthik Palanisamy
        2. HDFS-10766-2.patch
          2 kB
          Karthik Palanisamy

          Activity

            People

            • Assignee:
              kpalanisamy Karthik Palanisamy
              Reporter:
              kpalanisamy Karthik Palanisamy
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: