Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14531

[Umbrella] Improve S3A error handling & reporting

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.8.1
    • Fix Version/s: 3.1.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      Improve S3a error handling and reporting

      this includes

      1. looking at error codes and translating to more specific exceptions
      2. better retry logic where present
      3. adding retry logic where not present
      4. more diagnostics in exceptions
      5. docs

      Overall goals

      • things that can be retried and will go away are retried for a bit
      • things that don't go away when retried failfast (302, no auth, unknown host, connection refused)
      • meaningful exceptions are built in translate exception
      • diagnostics are included, where possible
      • our troubleshooting docs are expanded with new failures we encounter

      AWS S3 error codes: http://docs.aws.amazon.com/AmazonS3/latest/API/ErrorResponses.html

        Attachments

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: