Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19353 Über-jira: S3A Hadoop 3.4.2 features
  3. HADOOP-15347

S3ARetryPolicy to handle AWS 500 responses/error code TooBusyException with the throttle backoff policy

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • fs/s3
    • None

    Description

      FLINK-9061 implies that some 500 responses are caused by server-side overload of some form. 

      That means they should really have the throttle retry policy applied, not the connectivity one

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-9061 Add entropy to s3 path for better scalability

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: