[HIVE-17757] REPL LOAD need to use customised configurations to execute distcp/remote copy.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: HiveServer2, repl
• Labels: DR pull-request-available replication
• Assignee: Sankar Hariappan
• Reporter: Sankar Hariappan
• Created: 10/Oct/17 10:32
• Updated: 22/May/18 23:13
• Resolved: 11/Oct/17 05:54

Description

As REPL LOAD command needs to read repl dump directory and data files from source cluster, it needs to use some of the configurations to read data securely through distcp.
Some of the HDFS configurations cannot be added to whitelist as they pose security threat. So, it is necessary for REPL LOAD command to take such configs as input and use it when trigger distcp.
Proposed syntax:
REPL LOAD [<dbname>[.<tablename>]] FROM <dirname> [WITH ('key1'='value1', 'key2'='value2')];

Issue Links

• links to: GitHub Pull Request #260