[HBASE-15806] An endpoint-based export tool

• Type: New Feature
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: Coprocessors, tooling
• Hadoop Flags: Reviewed

Release Note

org.apache.hadoop.hbase.coprocessor.Export
Instructs HBase to dump the contents of table to HDFS in a sequence file
+ replaces MR by endpoint (see org.apache.hadoop.hbase.mapreduce.Export)
+ no large data to be transfered between hbase server and client
+ same command line as org.apache.hadoop.hbase.mapreduce.Export
- user needs to alter table for deploying ExportEndpoint
- user needs to adjust the endpoint timeout for dumping large data
- user needs to get the EXECUTE permission

• Assignee: Chia-Ping Tsai
• Reporter: Chia-Ping Tsai
• Created: 09/May/16 17:24
• Updated: 17/Feb/18 22:35
• Resolved: 30/Aug/17 06:13

Description

The time for exporting table can be reduced, if we use the endpoint technique to export the hdfs files by the region server rather than by hbase client.

In my experiments, the elapsed time of endpoint-based export can be less than half of current export tool (enable the hdfs compression)

But the shortcomings is we need to alter table for deploying the endpoint

any comments about this? thanks

Issue Links

• is blocked by: HBASE-18503 Change ***Util and Master to use TableDescriptor and ColumnFamilyDescriptor
• links to: review board

Sub-Tasks

• Document the coprocessor.Export: Resolved