Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13571 Deadnode detection
  3. HDFS-15552

Let DeadNode Detector also work for EC cases

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      Currently, the EC stream (`DFSStripedInputStream`) is not handled properly while exception occurs.

      For example, while reading EC-blocks, if the client timed out when connecting to the DataNode, it will throws `SocketTimeoutException` , then add current DN to localDeadNode.

      However, the local dead nodes will not be removed until the stream is closed, which will cause missing block IOException to be thrown in the use scenario of Hbase.

      So we need to use detector to deal with dead nodes under EC to avoid reading failures.

       

        Attachments

          Activity

            People

            • Assignee:
              imbajin imbajin
              Reporter:
              dark_num dark_num

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment