Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-793

DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.2, 0.21.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      Currently BlockReceiver#PacketResponder interleaves receiving ack message and sending ack message for the same packet. It reads a portion of the message, sends a portion of its ack, and continues like this until it hits the end of the message. The problem is that if it gets an error receiving the ack, it is not able to send an ack that reflects the source of the error.

      The PacketResponder should receives the whole packet ack message first and then constuct and sends out its ack.

      1. separateSendRcvAck.patch
        16 kB
        Hairong Kuang
      2. separateSendRcvAck-0.20.patch
        14 kB
        Hairong Kuang
      3. separateSendRcvAck-0.20-yahoo.patch
        14 kB
        Hairong Kuang
      4. separateSendRcvAck1.patch
        18 kB
        Hairong Kuang
      5. separateSendRcvAck2.patch
        18 kB
        Hairong Kuang

        Issue Links

          Activity

          Gavin made changes -
          Link This issue is depended upon by HDFS-142 [ HDFS-142 ]
          Gavin made changes -
          Link This issue blocks HDFS-142 [ HDFS-142 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Todd Lipcon made changes -
          Affects Version/s 0.20-append [ 12315103 ]
          Nicolas Spiegelberg made changes -
          Link This issue blocks HDFS-142 [ HDFS-142 ]
          Nicolas Spiegelberg made changes -
          Affects Version/s 0.20-append [ 12315103 ]
          Tom White made changes -
          Fix Version/s 0.22.0 [ 12314241 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck-0.20-yahoo.patch [ 12437808 ]
          Allen Wittenauer made changes -
          Link This issue relates to HDFS-872 [ HDFS-872 ]
          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck2.patch [ 12427428 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck-0.20.patch [ 12427427 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Incompatible change, Reviewed]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427277 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427275 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427275 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck.patch [ 12427009 ]
          Hairong Kuang made changes -
          Field Original Value New Value
          Link This issue blocks HDFS-101 [ HDFS-101 ]
          Hairong Kuang created issue -

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development