[HADOOP-15086] NativeAzureFileSystem file rename is not atomic

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.1.0, 3.0.1
• Component/s: fs/azure
• Target Version/s: 2.9.0, 3.0.0-beta1, 2.7.5
• Assignee: Thomas Marqardt
• Reporter: Shixiong Zhu
• Created: 01/Dec/17 23:42
• Updated: 04/Jan/18 18:01
• Resolved: 22/Dec/17 11:41

Description

When multiple threads rename files to the same target path, more than 1 threads can succeed. It's because check and copy file in `rename` is not atomic.

I would expect it's atomic just like HDFS.

Issue Links

• is depended upon by: HADOOP-15156 backport HADOOP-15086 rename fix to branch-2