[HADOOP-12057] swiftfs rename on partitioned file attempts to consolidate partitions

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: fs/swift
• Assignee: David Dobbins
• Reporter: David Dobbins
• Due: 02/Jun/15
• Created: 03/Jun/15 00:54
• Updated: 29/Apr/16 01:14

Description

In the swift filesystem for openstack, a rename operation on a partitioned file uses the swift COPY operation, which attempts to consolidate all of the partitions into a single object. This causes the rename to fail when the total size of all the partitions exceeds the maximum object size for swift. Since partitioned files are primarily created to allow a file to exceed the maximum object size, this bug makes writing to swift extremely unreliable.

Issue Links

• is depended upon by: HADOOP-12109 Distcp of file > 5GB to swift fails with HTTP 413 error
• is depended upon by: HADOOP-12046 Avoid creating "._COPYING_" temporary file when copying file to Swift file system