Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.2.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      managed to create on a parallel test run

      org.apache.hadoop.fs.s3a.AWSServiceThrottledException: delete on s3a://hwdev-steve-ireland-new/fork-0005/test/existing-dir/existing-file: com.amazonaws.services.dynamodbv2.model.ProvisionedThroughputExceededException: The level of configured provisioned throughput for the table was exceeded. Consider increasing your provisioning level with the UpdateTable API. (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ProvisionedThroughputExceededException; Request ID: RDM3370REDBBJQ0SLCLOFC8G43VV4KQNSO5AEMVJF66Q9ASUAAJG): The level of configured provisioned throughput for the table was exceeded. Consider increasing your provisioning level with the UpdateTable API. (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ProvisionedThroughputExceededException; Request ID: RDM3370REDBBJQ0SLCLOFC8G43VV4KQNSO5AEMVJF66Q9ASUAAJG)
      	at 
      
      

      We should be able to handle this. 400 "bad things happened" error though, not the 503 from S3.

      We need a retry handler for DDB throttle operations

        Attachments

        1. Screen Shot 2018-07-24 at 15.16.46.png
          113 kB
          Steve Loughran
        2. Screen Shot 2018-07-25 at 16.22.10.png
          47 kB
          Steve Loughran
        3. Screen Shot 2018-07-25 at 16.28.53.png
          24 kB
          Steve Loughran
        4. HADOOP-15426-001.patch
          42 kB
          Steve Loughran
        5. HADOOP-15426-002.patch
          68 kB
          Steve Loughran
        6. Screen Shot 2018-07-27 at 14.07.38.png
          94 kB
          Steve Loughran
        7. org.apache.hadoop.fs.s3a.s3guard.ITestDynamoDBMetadataStoreScale-output.txt
          37 kB
          Steve Loughran
        8. HADOOP-15426-003.patch
          85 kB
          Steve Loughran
        9. HADOOP-15426-004.patch
          84 kB
          Steve Loughran
        10. HADOOP-15426-005.patch
          88 kB
          Steve Loughran
        11. HADOOP-15426-006.patch
          88 kB
          Steve Loughran
        12. HADOOP-15426-007.patch
          88 kB
          Steve Loughran
        13. HADOOP-15426-008.patch
          91 kB
          Steve Loughran
        14. HADOOP-15426-009.patch
          91 kB
          Steve Loughran
        15. HADOOP-15426-010.patch
          92 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: