Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14531 [Umbrella] Improve S3A error handling & reporting
  3. HADOOP-13205

S3A to support custom retry policies; failfast on unknown host

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.8.0
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      Noticed today that when connections are down, S3A retries on UnknownHostExceptions logging noisily in the process.

      1. it should be possible to define or customize retry policies for an FS instance (fail fast, exponential backoff, etc)
      2. we may want to explicitly have a fail-fast-if-offline retry policy, catching the common connectivity ones.

      Testing will be fun here.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: