Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11090

Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0, 0.98.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
      Here is one approach for backporting:

      Create the following classes (class name is tentative):
      hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
      hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java

      each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2

      ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility module gets bundled.

      ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which went into 1.2.0 release.
      We need to decide how hadoop releases earlier than 1.2.0 should be supported.

      Second approach for backporting is to make a copy of ThrottledInputStream and include it in hbase codebase.

        Attachments

        1. 11090-98.txt
          9 kB
          Ted Yu
        2. 11090-trunk-v2.txt
          6 kB
          Ted Yu
        3. 11090-trunk.txt
          6 kB
          Ted Yu
        4. 11090-0.98-v1.txt
          9 kB
          Ted Yu

          Activity

            People

            • Assignee:
              yuzhihong@gmail.com Ted Yu
              Reporter:
              yuzhihong@gmail.com Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: