Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13571 Deadnode detection
  3. HDFS-15552

Let DeadNode Detector also work for EC cases

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      Currently, the EC stream (`DFSStripedInputStream`) is not handled properly while exception occurs.

      For example, while reading EC-blocks, if the client timed out when connecting to the DataNode, it will throws `SocketTimeoutException` , then add current DN to localDeadNode.

      However, the local dead nodes will not be removed until the stream is closed, which will cause missing block IOException to be thrown in the use scenario of Hbase.

      So we need to use detector to deal with dead nodes under EC to avoid reading failures.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                imbajin imbajin
                Reporter:
                dark_num dark_num
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m