Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6247

Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.6.0
    • Component/s: balancer & mover, datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently there is no response sent from target Datanode to Balancer for the replaceBlock() calls.

      Since the Block movement for balancing is throttled, complete block movement will take time and this could result in timeout at Balancer, which will be trying to read the status message.

      To Avoid this during replaceBlock() call in in progress Datanode can send IN_PROGRESS status messages to Balancer to avoid timeouts and treat BlockMovement as failed.

        Attachments

        1. HDFS-6247.patch
          9 kB
          Vinayakumar B
        2. HDFS-6247.patch
          8 kB
          Vinayakumar B
        3. HDFS-6247.patch
          8 kB
          Vinayakumar B
        4. HDFS-6247.patch
          8 kB
          Vinayakumar B
        5. HDFS-6247.patch
          8 kB
          Vinayakumar B
        6. HDFS-6247.patch
          8 kB
          Vinayakumar B
        7. HDFS-6247.patch
          8 kB
          Vinayakumar B
        8. HDFS-6247.patch
          8 kB
          Vinayakumar B

          Activity

            People

            • Assignee:
              vinayakumarb Vinayakumar B
              Reporter:
              vinayakumarb Vinayakumar B
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: