[HADOOP-18629] Hadoop DistCp supports specifying favoredNodes for data copying

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.4
• Component/s: tools/distcp
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: zhuyaogai
• Created: 14/Feb/23 03:12
• Updated: 06/Mar/23 12:37

Description

When importing large scale data to HBase, we always generate the hfiles with other Hadoop cluster, use the Distcp tool to copy the data to the HBase cluster, and bulkload data to HBase table. However, the data locality is rather low which may result in high query latency. After taking a compaction it will recover. Therefore, we can increase the data locality by specifying the favoredNodes in Distcp.

Could I submit a pull request to optimize it?

Issue Links

• links to: GitHub Pull Request #5391