Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-793

DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.2, 0.21.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      Currently BlockReceiver#PacketResponder interleaves receiving ack message and sending ack message for the same packet. It reads a portion of the message, sends a portion of its ack, and continues like this until it hits the end of the message. The problem is that if it gets an error receiving the ack, it is not able to send an ack that reflects the source of the error.

      The PacketResponder should receives the whole packet ack message first and then constuct and sends out its ack.

      1. separateSendRcvAck2.patch
        18 kB
        Hairong Kuang
      2. separateSendRcvAck1.patch
        18 kB
        Hairong Kuang
      3. separateSendRcvAck-0.20-yahoo.patch
        14 kB
        Hairong Kuang
      4. separateSendRcvAck-0.20.patch
        14 kB
        Hairong Kuang
      5. separateSendRcvAck.patch
        16 kB
        Hairong Kuang

        Issue Links

          Activity

          Hairong Kuang created issue -
          Hairong Kuang made changes -
          Field Original Value New Value
          Link This issue blocks HDFS-101 [ HDFS-101 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck.patch [ 12427009 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427275 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427275 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck1.patch [ 12427277 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Incompatible change, Reviewed]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck-0.20.patch [ 12427427 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck2.patch [ 12427428 ]
          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Allen Wittenauer made changes -
          Link This issue relates to HDFS-872 [ HDFS-872 ]
          Hairong Kuang made changes -
          Attachment separateSendRcvAck-0.20-yahoo.patch [ 12437808 ]
          Tom White made changes -
          Fix Version/s 0.22.0 [ 12314241 ]
          Nicolas Spiegelberg made changes -
          Affects Version/s 0.20-append [ 12315103 ]
          Nicolas Spiegelberg made changes -
          Link This issue blocks HDFS-142 [ HDFS-142 ]
          Todd Lipcon made changes -
          Affects Version/s 0.20-append [ 12315103 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue blocks HDFS-142 [ HDFS-142 ]
          Gavin made changes -
          Link This issue is depended upon by HDFS-142 [ HDFS-142 ]

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development