Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-793

DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.20.2, 0.21.0
    • datanode
    • None
    • Incompatible change, Reviewed

    Description

      Currently BlockReceiver#PacketResponder interleaves receiving ack message and sending ack message for the same packet. It reads a portion of the message, sends a portion of its ack, and continues like this until it hits the end of the message. The problem is that if it gets an error receiving the ack, it is not able to send an ack that reflects the source of the error.

      The PacketResponder should receives the whole packet ack message first and then constuct and sends out its ack.

      Attachments

        1. separateSendRcvAck2.patch
          18 kB
          Hairong Kuang
        2. separateSendRcvAck1.patch
          18 kB
          Hairong Kuang
        3. separateSendRcvAck-0.20-yahoo.patch
          14 kB
          Hairong Kuang
        4. separateSendRcvAck-0.20.patch
          14 kB
          Hairong Kuang
        5. separateSendRcvAck.patch
          16 kB
          Hairong Kuang

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-101 DFS write pipeline : DFSClient sometimes does not detect second datanode failure

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-142 In 0.20, move blocks being written into a blocksBeingWritten directory

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-872 DFSClient 0.20.1 is incompatible with HDFS 0.20.2

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: