[HIVE-16898] Validation of source file after distcp in repl load

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: HiveServer2
• Labels: pull-request-available
• Assignee: Daniel Dai
• Reporter: Anishek Agarwal
• Created: 14/Jun/17 09:24
• Updated: 22/May/18 23:58
• Resolved: 02/Oct/17 06:17

Description

time between deciding the source and destination path for distcp to invoking of distcp can have a change of the source file, hence distcp might copy the wrong file to destination, hence we should an additional check on the checksum of the source file path after distcp finishes to make sure the path didnot change during the copy process. if it has take additional steps to delete the previous file on destination and copy the new source and repeat the same process as above till we copy the correct file.

Issue Links

• links to: GitHub Pull Request #254
• links to: RB