[HIVE-21717] Rename is failing for directory in move task

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: HiveServer2
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: mahesh kumar behera
• Reporter: mahesh kumar behera
• Created: 10/May/19 14:18
• Updated: 17/Nov/22 08:50
• Resolved: 14/May/19 13:02

Description

Rename fails with destination directory not empty in case a directory is move directly to the table location from staging directory as rename cannot overwrite non empty destination directory.

 

In replication scenarios, if user does some concurrent write during bootstrap dump, it may happen that some data which are already replicated through bootstrap, will be tried during next incremental load also. This is handled by making the operations reentrant during repl load. But here move task is not able to delete the directory created by bootstrap load even though replace flag is set to true. This is causing the incremental load to fail.

Issue Links

• links to: GitHub Pull Request #624