Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14769

Add throttler for DataNode#DataTransfer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      When a amount of block replicas are moving, the bandwidth will be full without throtter in DataNode#DataTransfer.
      This will affect normal reading and writing.

      /**
 * Do the deed, write the bytes
 */
@Override
public void run() {
    // send data & checksum
    blockSender.sendBlock(out, unbufOut, null);
}

      Attachments

        1. HDFS-14769.001.patch
          14 kB
          Lisheng Sun
        2. HDFS-14769.002.patch
          3 kB
          Lisheng Sun
        3. HDFS-14769.003.patch
          3 kB
          Lisheng Sun

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-12904 Add DataTransferThrottler to the Datanode transfers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              leosun08 Lisheng Sun
              leosun08 Lisheng Sun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: