[HIVE-20476] CopyUtils used by REPL LOAD and EXPORT/IMPORT operations ignore distcp error.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0, 4.0.0-alpha-1
• Component/s: HiveServer2, repl
• Labels: DR Export Import Replication pull-request-available
• Target Version/s: 3.2.0, 4.0.0
• Assignee: Sankar Hariappan
• Reporter: Sankar Hariappan
• Created: 28/Aug/18 10:38
• Updated: 17/Nov/22 08:54
• Resolved: 04/Sep/18 10:26

Description

CopyUtils uses FileUtils.distCp to copy files but doesn't check the return value. It returns false if the copy fails.
Now, REPL LOAD and EXPORT/IMPORT commands internally uses CopyUtils to copy data files across clusters and here it may return success even if file copy fails and may cause data loss.

Need to throw error and retry.

Issue Links

• links to: GitHub Pull Request #424