Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-8640

Uploads to S3 Secondary Storage fail, stay at 0% completed

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.5.1, Future
    • Fix Version/s: 4.6.0
    • Component/s: SystemVM
    • Security Level: Public (Anyone can view this level - this is the default.)
    • Environment:
      Ceph RADOS Gateway with Civetweb as Secondary Storage

      Description

      I noticed this after upgrading to 4.5.2 (build from 4.5 branch).

      Uploads never completed when a template was downloaded en directly uploaded to S3 secondary storage provided by Ceph's RADOS Gateway using Multipart.

      After searching for hours I found this: http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/event/ProgressEvent.html#getBytesTransferred()

      The ProgressEvent of the returned that 0 bytes had been transferred. But when using the getBytes() method it actually works.

      The upload succeeds, but we check if the amount of uploaded bytes is equal or more then what we expected. If not, we say the upload failed.

      This happens inside S3TemplateDownloader (which really needs some fixes btw....)

      Tracing this down if it's related to Ceph or actually something in S3TemplateDownloader.

      I also tried the Amazon SDK 1.9.34, but that didn't make a difference.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                widodh Wido den Hollander
                Reporter:
                widodh Wido den Hollander
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: