Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.2.0, 3.1.2
    • 3.3.0
    • fs/s3
    • None
    • The S3A filesystem now backs off exponentially on failures. if you have customized the fs.s3a.retry.limit and fs.s3a.retry.interval options you may wish to review these settings

    Description

      the fixed s3a retry policy doesnt leave big enough gaps for cached 404s to expire; we cant recover from this

      HADOOP-16490 is a full fix for this, but one we can backport is moving from fixed to exponential retries

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: