Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15661

The DeadNodeDetector shouldn't be shared by different DFSClients.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.1, 3.4.0
    • 3.3.1, 3.4.0
    • datanode
    • None
    • Reviewed

    Description

      Currently the DeadNodeDetector is a member of ClientContext. That means it is shared by many different DFSClients. When one DFSClient.close() is invoked, the DeadNodeDetecotor thread would be interrupted and impact other DFSClients.

      From the original design of HDFS-13571 we could see the DeadNodeDetector is supposed to share dead nodes of many input streams from the same client. 

      We should move the DeadNodeDetector as a member of DFSClient instead of ClientContext. 

      Attachments

        1. HDFS-15661.001.patch
          17 kB
          Jinglun
        2. HDFS-15661.002.patch
          8 kB
          Jinglun
        3. HDFS-15661.003.patch
          9 kB
          Jinglun
        4. HDFS-15661.004.patch
          9 kB
          Jinglun
        5. HDFS-15661.005.patch
          9 kB
          Jinglun

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13571 Deadnode detection

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              LiJinglun Jinglun
              LiJinglun Jinglun
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: