Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-724

Pipeline close hangs if one of the datanode is not responsive.

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      In the new pipeline design, pipeline close is implemented by sending an additional empty packet. If one of the datanode does not response to this empty packet, the pipeline hangs. It seems that there is no timeout.

      Attachments

        1. h724_20091021.patch
          5 kB
          Tsz-wo Sze
        2. pipelineHeartbeat.patch
          11 kB
          Hairong Kuang
        3. pipelineHeartbeat1.patch
          27 kB
          Hairong Kuang
        4. pipelineHeartbeat2.patch
          26 kB
          Hairong Kuang
        5. stuckWriteAppend20.patch
          28 kB
          Hairong Kuang
        6. hbAckReply.patch
          0.8 kB
          Hairong Kuang
        7. HDFS-724.20-security.1.patch
          29 kB
          Jitendra Nath Pandey

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-2861 regionserver's logsyncer thread hangs on DFSClient$DFSOutputStream.waitForAckedSeqno

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Test - A new unit, integration or system test. HDFS-714 Create fault injection test for the new pipeline close

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: