[HBASE-11090] Backport HBASE-11083 ExportSnapshot should provide capability to limit bandwidth consumption

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.99.0, 0.98.3
• Hadoop Flags: Reviewed
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 28/Apr/14 16:10
• Updated: 21/Feb/15 23:30
• Resolved: 19/May/14 16:25

Description

HBASE-11083 allows ExportSnapshot to limit bandwidth usage.
Here is one approach for backporting:

Create the following classes (class name is tentative):
hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/util/ThrottledInputStream.java

each of which extends the corresponding ThrottledInputStream in hadoop-1 / hadoop-2

ExportSnapshot would reference util.ThrottledInputStream, depending on which compatibility module gets bundled.

ThrottledInputStream.java in hadoop-1 branch was backported through MAPREDUCE-5081 which went into 1.2.0 release.
We need to decide how hadoop releases earlier than 1.2.0 should be supported.

Second approach for backporting is to make a copy of ThrottledInputStream and include it in hbase codebase.