HBase
  1. HBase
  2. HBASE-11083

ExportSnapshot should provide capability to limit bandwidth consumption

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: snapshots
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This capability was first brought up in this thread:
      http://search-hadoop.com/m/DHED4Td8Xb1

      The rewritten distcp already provides this capability.
      See MAPREDUCE-2765

      distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling on a specified InputStream.

      As a first step, we can

      • add an option to ExportSnapshot which expresses bandwidth per map in MB
      • utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().

        Activity

          People

          • Assignee:
            Ted Yu
            Reporter:
            Ted Yu
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development