Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11083

ExportSnapshot should provide capability to limit bandwidth consumption

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: snapshots
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This capability was first brought up in this thread:
      http://search-hadoop.com/m/DHED4Td8Xb1

      The rewritten distcp already provides this capability.
      See MAPREDUCE-2765

      distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling on a specified InputStream.

      As a first step, we can

      • add an option to ExportSnapshot which expresses bandwidth per map in MB
      • utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().

        Attachments

          Activity

            People

            • Assignee:
              yuzhihong@gmail.com Ted Yu
              Reporter:
              yuzhihong@gmail.com Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: