[HBASE-11083] ExportSnapshot should provide capability to limit bandwidth consumption

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.99.0
• Component/s: snapshots
• Hadoop Flags: Reviewed
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 26/Apr/14 00:47
• Updated: 21/Feb/15 23:29
• Resolved: 27/Apr/14 04:59

Description

This capability was first brought up in this thread:
http://search-hadoop.com/m/DHED4Td8Xb1

The rewritten distcp already provides this capability.
See MAPREDUCE-2765

distcp implementation utilizes ThrottledInputStream which provides bandwidth throttling on a specified InputStream.

As a first step, we can

• add an option to ExportSnapshot which expresses bandwidth per map in MB
• utilize ThrottledInputStream in ExportSnapshot#ExportMapper#copyFile().