Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12057

swiftfs rename on partitioned file attempts to consolidate partitions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/swift
    • Labels:
      None
    • Target Version/s:

      Description

      In the swift filesystem for openstack, a rename operation on a partitioned file uses the swift COPY operation, which attempts to consolidate all of the partitions into a single object. This causes the rename to fail when the total size of all the partitions exceeds the maximum object size for swift. Since partitioned files are primarily created to allow a file to exceed the maximum object size, this bug makes writing to swift extremely unreliable.

        Attachments

        1. HADOOP-12057.007.patch
          12 kB
          David Dobbins
        2. HADOOP-12057.patch
          8 kB
          David Dobbins
        3. HADOOP-12057.patch
          8 kB
          David Dobbins
        4. HADOOP-12057.patch
          8 kB
          David Dobbins
        5. HADOOP-12057.patch
          8 kB
          David Dobbins
        6. HADOOP-12057.patch
          4 kB
          David Dobbins
        7. HADOOP-12057-006.patch
          9 kB
          Steve Loughran
        8. HADOOP-12057-008.patch
          14 kB
          David Dobbins

          Issue Links

            Activity

              People

              • Assignee:
                highlycaffeinated David Dobbins
                Reporter:
                highlycaffeinated David Dobbins
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated: